Skip to main content

Advertisement

International Journal of Educational Technology in Higher Education
International Journal of Educational Technology in Higher Education Cover Image
Download PDF

Using a gamified mobile app to increase student engagement, retention and academic achievement

International Journal of Educational Technology in Higher Education volume 14, Article number: 31 (2017) Cite this article

Abstract

This study investigated whether the use of a gamified mobile learning app influenced students’ academic performance and boosted their engagement in the subject. Created to better engage students in lecture content, the app was used to deliver multiple-choice content-based quizzes directly to students’ personal mobile devices post-lecture and pre-tutorial. After measuring the relationships between students’ app usage and their engagement, retention and academic achievement in the subject, it is suggested that following the app’s introduction, student retention rates and academic performance increased, and there was a positive correlation between students’ scoring highly on the app and achieving higher academic grades. While the app’s affordances for learning are promising, the causal relationship between the app usage and improved student outcomes requires further investigation. Conclusions made in the context of the wider scholarship of mobile app enhanced learning and applied game principles in HE.

Introduction

Mobile applications (apps) used as learning and teaching tools are not uncommon in Higher Education (HE) (Pechenkina, 2017). However, what makes an educational mobile app effective is a subject of ongoing interest to academics, lecturers, learning designers and other stakeholders invested in education (Hirsh-Pasek et al., 2015). Recent studies report on various HE mobile app offerings which despite the differences in their design and intended uses are united by a common goal of enhancing learning to improve student outcomes. For instance, HE mobile apps can be used to facilitate learners’ knowledge acquisition and transfer (Hannon, 2017), simulate experiential situations to train medical students (Amer, Mur, Amer, & Ilyas, 2017), assess in-class activities to provide immediate feedback (Deb, Fuad, & Kanan, 2017), and engage students in situated learning using augmented reality affordances (Bower, Howe, McCredie, Robinson, & Grover, 2014). Apps with gamified elements integrated into their design, in addition to facilitating learning, can further engage and motivate students (Hamari, Koivisto, & Sarsa, 2014) – where engagement is of particular importance because it may factor into student retention.

Many gaps still remain in the HE mobile app research, with further studies needed to better inform impactful app designs. Contributing to this goal, this article presents the findings of a study which investigated whether the use of a gamified mobile learning app positively affected students’ academic performance and engagement in the subject. The app in question was created specifically to better engage students in lecture content by delivering multiple-choice quizzes directly to students’ personal mobile devices post-lecture and pre-tutorial. The app’s customisation capability meant it could be tailored to suit any discipline-specific content, curriculum or a mode of teaching. Digital leaderboards and badges were embedded into the app’s design to keep students motivated to use the app, while push notifications alerted students each time a new quiz became available, allowing them to do the quiz ‘on the go’ regardless of their physical location. Grounded in the pedagogy of spaced education (Kelley & Whatson, 2013), the app’s primary purpose was to systemically test students on what they learnt in the low-stakes environment, hence consolidating their knowledge of the content. After its initial trial with a first-year accounting unit, the app was then also introduced into several first-year science units. Considering small student numbers in each unit using the app, all cohorts were combined into one sample to ensure meaningful statistical results. Findings are contextualised in the wider scholarship of mobile app enhanced learning and applied game principles in HE.

Mobile app technologies in higher education: An overview

Compared to the fast-growing body of scholarship concerned with educational mobile apps for children (Hirsh-Pasek et al., 2015; Hswen, Murti, Vormawor, Bhattacharjee, & Naslund, 2013; Judge, Floyd, & Jeffs, 2015), more evidence-based research into the impact of HE mobile learning apps is urgently needed. Where a mobile learning app’s effectiveness is concerned, some factors remain constant regardless of a student’s age: such as, learning is most effective when learners are engaged, cognitively active and guided by a goal, and when learning activities are scaffolded and interactive (Hirsh-Pasek et al., 2015). For older learners, however, a set of additional factors may influence their learning patterns and behaviours, such as their motivations, expectations and prior experiences (Salmon, Pechenkina, Chase, & Ross, 2016). All these factors need to be taken into account when designing mobile apps to enhance HE learner experience.

A number of mechanisms were found effective in the task of keeping learners engaged. Question-prompting and automated immediate feedback combined with explanatory strategies (Byun, Lee, & Cerreto, 2014; Sung, Chang, & Liu, 2016) were among them. The ‘push notification’ technology was also deemed useful when tasked with encouraging immediate learning and helping learners stay up-to-date with content (Garbrick & Clariana, 2015; Kudo et al., 2015). A mobile learning intervention’s length is another significant factor attributed to the intervention’s effectiveness, with longer interventions found more effective as they allowed to fully integrate students into the learning process, with the desired effects achieved over time (Sung et al., 2016). While learners’ age did not appear to factor into a mobile app intervention’s success, groups of learners homogenous in age showed higher rates of impact compared to the mixed-age cohorts (Sung et al., 2016). At the same time, mobile learning apps with gamified elements did not appear to achieve significant positive effects on learning (Sung et al., 2016). However, other studies found that when mindfully integrated into an intervention’s design, the game elements worked in accord with other aspects of the intervention to positively impact on student learning (Laine, Nygren, Dirin, & Suk, 2016; Woo, 2014).

Several educational psychology principles attributed to effective learning must also be considered when designing mobile learning app interventions. Based on Ebbinghaus’s (2013) theorising of ‘the forgetting curve’ as a way to explain the finer workings of human cognition and memory, the spacing effect and the testing effect emerged as two pedagogical principles significant when designing mobile apps for learning. With some positive results recoded (Kerfoot, Turchin, Breydo, Gagnon, & Conlin, 2014; Shenoi et al., 2016), when operationalised within an app’s design, these principles could allow students to revisit and consolidate what was learnt by being systematically tested on their knowledge.

The spacing and testing effects and the pedagogy of spaced education (Kelley & Whatson, 2013) behind them are well aligned with a knowledge organisation principle known as ‘chunking’. In the HE context, ‘chunking’ is best understood as a cognitive strategy used to enhance mental performance, where a bulk of information is (re)organised into smaller segments (‘chunks’) for improved comprehension (Afflerbach, Pearson, & Paris, 2008; Cowan, 2014). Enabled by smartphones and similar devices, mobile app technology is well suited to facilitate student engagement with such ‘chunk-sized’ knowledge, leading to better comprehension of lecture material (Lah, Saat, & Hassan, 2014).

Considering student demand for personalised learning options is growing (Shah, Sid Nair, & Bennett, 2013; Wanner & Palmer, 2015) while personal mobile devices become ubiquitous (Mackay, 2014), it is timely to take advantage of mobile app technologies to create new ways for students to personalise their educational experiences. These considerations are particularly salient where the experiences of first-year HE students are concerned as these students are at higher risk of dropping-out compared to their senior peers (O'Keeffe, 2013; Ryan, 2004).

Applying game principles in mobile app design

Gamification in education can be broadly understood as the use of game elements in non-game contexts (Deterding, 2011; Domínguez et al., 2013), purposed with increasing student engagement and motivation. With various studies reporting significant correlations between introducing the gamified elements into the learning process and increased student motivations (Domínguez et al., 2013), some gamification scholars (Hamari et al., 2014; Koivisto & Hamari, 2014) point out that success of any gamification initiative is greatly dependent on the context of its implementation and the attitudes of its intended users. Other recent research found that students generally hold positive perceptions of gamified learning and appreciate social interaction, engagement and immediate feedback it affords (Cheong, Filippou, & Cheong, 2014). Taking all these success factors into account, when strategically embedded into an online learning initiative, game elements have a potential to improve student outcomes (Hirsh-Pasek et al., 2015; Jere-Folotiya et al., 2014; Ke, 2015; Laine et al., 2016; Werbach & Hunter, 2015).

Learner motivation remains a primary concern of game-based mobile learning initiatives, with developers and educators alike trialling different approaches of introducing game elements into the learning process. These include ‘progression trees’, score-generated leaderboards, and digital badges (Abramovich, Schunn, & Higashi, 2013; Ahn, Pellicone, & Butler, 2014; Lokuge Dona, Gregory, & Pechenkina, 2016). Further, considering that low-stakes assessments offered early on in the teaching period build confidence and engagement, and, in turn, have a beneficial effect on retention (Meer & Chapman, 2014), delivered in a gamified format such assessments can make a mobile learning app more effective in its task (Weitze & Söbke, 2016).

Drawing on various examples of impactful mobile learning gamification initiatives, the app at the centre of this study was fitted with such features as push notifications, leaderboards and digital badges, while the pedagogy of spaced education operationalised through multiple-choice quizzes strategically scheduled post-lectures and pre-tutorials was used to boost student engagement.

The app’s development process

After noticing her first-year accounting students growing disengaged whenever a difficult concept was introduced, the unit’s head lecturer turned to mobile technology to improve the situation. Student disengagement is not uncommon in the discipline of accounting (Byrne, Flood, & Griffin, 2014), but the unit in question also ‘suffered’ from being a mandatory breadth (or foundation) unit as it tended to attract students who did not specialise in accounting and who were generally direct-school leavers entering university for the first time. As a result, the unit routinely showed low test performance and high attrition. The lecturer experimented with using such online tools as Kahoot! to boost in-class engagement, but the issue of keeping students engaged in learning after the lecture was over remained an ongoing concern. Because of the proliferation of personal mobile devices among the students, it was decided that a mobile app was the most efficient way to reach out to them and keep them interested in the unit.

Before embarking on an app development process, a number of existing commercial HE learning apps were analysed, but deemed as either too costly and/or failing to combine all of the features and tools identified as desirable during the project’s scoping phase. For instance, it was deemed crucial that the lecturer would have full control over the app’s weekly content and curate quiz questions and their timed release. This would make the app fully customisable and allow its use across various disciplines and classrooms. Therefore, after securing an internal seed grant from the university’s Teaching and Learning Unit, the app was developed ‘in-house’ for both Android and Apple devices. All students in the accounting unit were invited to download the app. Those who elected to use the app would receive regular post-lecture and pre-tutorial push notifications delivered directly to their mobile devices, inviting them to test their knowledge of the concepts introduced in-class by taking a multiple-choice quiz. Based on the students’ app engagement, various data was collected through the app’s analytics centre, including the speed of student responses to quiz prompts and the number of attempts it took a student to get the answer right. Based on these statistics, a leader scoreboard was populated and a winner announced each week. The app’s usage statistics were also ‘fed’ into the university’s learning management system where students could view their current leaderboard placement and digital badges awarded based on quiz performance. Students could also opt out from the leaderboard component and use the app solely for the purpose of revision.

After its initial trial with the accounting unit, the app was also introduced into several first-year science units. While the app’s structure and features remained the same, the quiz questions were tailored to suit the content of each participating unit. Considering small student numbers in each unit using the app, all cohorts were combined into one sample to ensure meaningful statistical results. After the app’s Semester 2, 2015 implementation, its impact on student learning was evaluated. This research was driven by the following questions:

  • Did the app’s introduction correlate with improved student retention rates?

  • Did the app’s student usage correlate with improved academic performance?

  • Did students’ app performance correlate with their academic performance in the unit?

Methods

Rationale

Due to time constraints and limited resources necessary to conduct an in-depth qualitative or mixed methods study, it was decided that as a first step, there would be a quantitative statistically-driven study into the app. The decision was reinforced by the immediate availability of analytical data generated by the students’ app use as well as the relative ease of accessing aggregate student data on retention and academic performance. Finally, the quantitative research undertaken is envisaged as a foundation for the study’s next phases, which would include qualitative investigations.

Sampling

Student participants in this mobile learning app trial were recruited from the wider cohort of students enrolled in the first-year accounting and sciences units in Semester 2, 2015. Of 462 students enrolled in the accounting unit, 265 (57%) opted to use the app; and out of 249 science students, 129 (52%) opted in to use the app. Average grades and retention rates for the pre-app cohorts (enrolled in Semesters 1, 2015 and in both Semesters in 2014 and 2013) were obtained via institutional learning management system. After initially conducting a comparative analysis between the accounting and science cohorts, it was decided to combine all cohorts into one sample to achieve a higher total number and ensure statistically meaningful outcomes. As a result, of the combined sample of 711 students, 394 (55%) signed up to use the app and consented to have their engagement data analytics collected for research purposes.

The study has received clearance from the university’s ethics committee. In regards to student consent mechanism, in the first instance of accessing the app, each new student user was asked to create an account and then proceed directly to the app under the condition that their data would be collected in a de-identified aggregate manner for the purposes of the app improvement and research. Students, however, had a chance to click the ‘opt out’ button if they did not wish to have their analytics data used for research purposes. If the latter option was chosen, student usage analytics would still be recorded but in a separate database, hence would not be used for research purposes. Furthermore, students were informed via email about the research projects, its goals and parameters, and advised to contact the first author (who had no teaching or assessment duties in any of the units involved in this research) with any questions and concerns. None of the students who decided to use the app opted out of the research and no queries or complaints were received.

Both participating lecturers were guided in the process of creating multiple-choice quizzes in alignment with their lecture topics. Commencing on the first day of the semester, one quiz question was set to release daily and expire at midnight of the same day. Once a student commenced the quiz, a timer was set allowing between 20 and 60 s to answer a question. For each correct answer a student was assigned points, which, when accumulated would convert into digital badges based on the following achievement levels: for giving five consequent correct answers, for answering a question in under 15 s, for earning more than 100 points and for reaching the top of the leaderboard.

Statistical analysis was conducted using SPSS with the following data:

  • Final student grades for pre and post app cohorts, where the goal was to measure the relationships between the average final grades (percentages) and the app engagement and uptake data; and

  • The app usage analytics (such as scores achieved when using the app).

Results

The app’s introduction and student retention rates

In Semester 2, 2015 when the mobile app was first introduced in the trial units, there was an improvement in student retention (calculated at 12.23%), when compared with the pre-app cohorts of Semester 1, 2015. The same pattern of improvement (though not as strong) was also found when compared with Semester 2, 2014 (improvement of 9.22% recorded) and Semester 2, 2013 (improvement of 5.37% recorded) (Fig. 1).

Fig. 1
figure1

Student retention rates for accounting and science cohort, before and after the mobile app was introduced in Semester 2, 2015 (N = 6939)

Full size image

The app’s usage and academic performance

Students who used the app demonstrated an average grade/percentage mark of 65.19% compared to those who did not use the app, the latter averaging a grade/percentage mark of 58.16%. Therefore, the app users on average achieved marks 7.03% higher compared to students who chose not using the app.

Students’ performance within the app and their academic performance in the unit

A significant positive correlation of .40 was found between performing well on the app tasks and achieving higher academic grades (as per Fig. 2).

Fig. 2
figure2

Correlation between app score and percentage mark (academic performance) (N = 6939)

Full size image

Limitations

This study’s focus was on correlations between students’ app usage and their academic performance in the unit, however causal relations between these variables would need to be gauged further through future in-depth studies of student experience. A potential limitation of this study is attributed to the novelty effect which must be taken into account when evaluating educational technology initiatives as it can skew the results (Clark, 2015). A common phenomenon that students can experience during a course of study, particularly so when new technologies such as gamification are introduced (Koivisto & Hamari, 2014), the novelty effect has implications for extended application. For instance, the perceived usefulness of gamification declines with use and with learner’s age (Koivisto & Hamari, 2014). At the same time, because participants in our experimental group self-selected to use the app, it was likely there was a sampling bias which may have resulted in more conscientious students who were open to new experiences participating in the experimental group (Cochran, 1977).

Another limitation of our study lies in the sample composition. While our initial goal was to undertake analysis separately for the accounting and sciences cohorts (see Figs. 3 and 4, for examples of initial findings), a decision was made to combine the cohorts to create a larger sample and produce statistically meaningful results. It is worth noting that when analysed separately, the app’s positive impact for the combined science cohorts was found to be significantly lower than for the accounting cohort, showing only 5–7% improvements in retention rates. These differences can be explained with disciplinary specifics of the accounting and science cohorts.

Fig. 3
figure3

Student retention rates for sciences and accounting

Full size image
Fig. 4
figure4

Student retention rates by course

Full size image

Conclusion

This study evaluated the effectiveness of a gamified mobile app as a learning tool. Relationships between student retention rates, academic achievement and the app usage were studied, with a number of positive correlations emerging. With interdisciplinary comparisons deemed problematic due to small cohort numbers, combining accounting and several sciences cohorts into one larger sample allowed for more statistically significant findings to be generated.

Keeping in mind that correlations do not necessarily entail causations and that other factors outside the study’s purview could be at play, the marked increase of student retention rate by 12.23% may suggest there was indeed some important trigger present for this increase to happen, especially since other variables (teaching staff, curriculum, and assessment types) did not change. This increased retention phenomenon is of interest, considering the expected decrease in first-year university student retention rates (O'Keeffe, 2013). At the same time, a 7.03% increase in students’ average academic performance may also suggest there is a potential to go beyond simply ‘engaging’ students in the learning activities with the app to actually boosting their academic knowledge acquisition and retention, converting it into higher final grades.

Finally, the positive correlation of .40 between students’ scoring highly on the app and achieving higher academic grades is also of importance as it can be used as a measure of internal consistency, suggesting that a subject-integrated app is well-positioned to help guide students towards better learning outcomes. With its design drawing on such pedagogical principles as spacing and testing effects as well as taking advantage of such known motivation-boosting features as digital badges and leaderboards, the app worked in synch with other learning processes, serving as a self-regulated but content-aligned learning tool. Considering evidence that mobile learning interventions tailored to learner groups homogenous in age have generally stronger impact (Sung et al., 2016), the fact that the presented intervention was introduced in the units traditionally populated by direct school leavers likely factored into the overall positive findings. Further trials, including those involving inter-class control groups and comparative studies with different disciplines and modes of learning can help clarify the findings further.

General implications of the findings are concerned with three main stakeholder groups in HE: universities, lecturers and students. In regards to the implications for universities, economic and social consequences of student attrition are substantial and can be understood in terms of lost tuition fees, forfeited funding for student places, reputational damage, bad publicity and various resources used up on students who ultimately do not complete their degrees (Johnson, 2012). The presented analysis of student engagement with the app and the consequent increased student retention suggests it is worth continuing to explore the retention-boosting potential of mobile app technologies.

Another set of implications are of concern to lecturers, and educators more widely. The following affordances of the app emerge as important to be considered when designing impactful mobile app offerings for students: an option to customise content to a specific course, the ease of use and general flexibility, the automated collection of the app usage analytics, and taking advantage of students’ existing patterns of engagement with mobile technologies to integrate the learning app into their daily usage repertoire.

In regards to students as stakeholders of mobile learning initiatives, there are three key implications. First, as students’ demand for personalised education is growing, mobile apps can enable student access to course material at a time of their own choosing by ‘pushing’ the quizzes to their mobile devices in sync with lecture and tutorial cycle. Second, the app’s leaderboard and digital badges features generate feedback for students allowing them to see how they are performing compared to their peers, with points and badges serving as milestones of the learning process. Third, the app can be used as a revision tool students can utilise when preparing for assessments.

The implications for these three groups of stakeholders present some useful considerations for HE institutions, academics and students, who are interested in taking better advantage of mobile technologies for learning.

References

  1. Abramovich S., Schunn C., & Higashi R. M. (2013). Are badges useful in education?: It depends upon the type of badge and expertise of learner. Educational Technology Research and Development, 61, 217–232.

  2. Afflerbach P., Pearson P. D., & Paris S. G. (2008). Clarifying differences between reading skills and reading strategies. The Reading Teacher, 61(5), 364–373.

  3. Ahn, J., Pellicone, A., & Butler, B. S. (2014). Open badges for education: What are the implications at the intersection of open systems and badging?. Research in Learning Technology, 22. doi:10.3402/rlt.v22.23563

  4. Amer, K. M., Mur, T., Amer, K., & Ilyas, A. M. (2017). A mobile-based surgical simulation application: A comparative analysis of efficacy using a carpal tunnel release module. The Journal of Hand Surgery. doi:10.1016/j.jhsa.2017.02.008

  5. Bower M., Howe C., McCredie N., Robinson A., & Grover D. (2014). Augmented Reality in education–cases, places and potentials. Educational Media International, 51(1), 1–15.

  6. Byrne M., Flood B., & Griffin J. (2014). Measuring the academic self-efficacy of first-year accounting students. Accounting Education, 23(5), 407–423.

  7. Byun H., Lee J., & Cerreto F. A. (2014). Relative effects of three questioning strategies in ill-structured, small group problem solving. Instructional Science, 42(2), 229–250.

  8. Cheong C., Filippou J., & Cheong F. (2014). Towards the gamification of learning: Investigating student perceptions of game elements. Journal of Information Systems Education, 25(3), 233–244.

  9. Clark K. R. (2015). The effects of the flipped model of instruction on student engagement and performance in the secondary mathematics classroom. Journal of Educators Online, 12(1), 91–115.

  10. Cochran W. G. (1977). Sampling techniques. New York: John Wiley & Sons.

  11. Cowan N. (2014). Working memory underpins cognitive development, learning, and education. Educational Psychology Review, 26(2), 197–223.

  12. Deb D., Fuad M. M., & Kanan M. (2017). Creating engaging exercises with mobile response system (MRS). In Proceedings of the 2017 ACM SIGCSE Technical Symposium on Computer Science Education (pp. 147–152) ACM.

  13. Deterding S. (2011). Situated motivational affordances of game elements: A conceptual model. In Gamification: Using Game Design Elements in Non-Gaming Contexts, a Workshop at CHI. Presented at CHI 2011 (pp. 1–4). Vancouver, BC: ACM.

  14. Domínguez A., Saenz-de-Navarrete J., De-Marcos L., Fernández-Sanz L., Pagés C., & Martínez-Herráiz J.-J. (2013). Gamifying learning experiences: Practical implications and outcomes. Computers & Education, 63, 380–392.

  15. Ebbinghaus, H. (2013). Memory: A contribution to experimental psychology. Annals of Neurosciences, 20(4), 155–156. doi:10.5214/ans.0972.7531.200408.

  16. Garbrick A., & Clariana R. (2015). How notifications influence participants in asynchronous discussion forums: A case study. In Proceedings of E-Learn: World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education 2015 (pp. 777–784). Chesapeake, VA: Association for the Advancement of Computing in Education (AACE).

  17. Hamari, J., Koivisto, J., & Sarsa, H. (2014). Does gamification work?-A literature review of empirical studies on gamification. In System Sciences (HICSS) Proceedings: 2014 47th Hawaii International Conference on IEEE. (pp. 3025–3034).

  18. Hannon, K. (2017). Utilization of an educational web based mobile app for acquisition and transfer of critical anatomical knowledge, thereby increasing classroom and laboratory preparedness in veterinary students. Online Learning, 21(1), 201–208. doi:10.24059/olj.v21i1.882

  19. Hirsh-Pasek K., Zosh J. M., Golinkoff R. M., Gray J. H., Robb M. B., & Kaufman J. (2015). Putting education in “educational” apps: Lessons from the science of learning. Psychological Science in the Public Interest, 16(1), 3–34.

  20. Hswen, Y., Murti, V., Vormawor, A. A., Bhattacharjee, R., & Naslund, J. A. (2013). Virtual avatars, gaming, and social media: Designing a mobile health app to help children choose healthier food options. Journal of Mobile Technology in Medicine, 2(2), 8–14. doi:10.7309/jmtm.2.2.3

  21. Jere-Folotiya J., Chansa-Kabali T., Munachaka J. C., Sampa F., Yalukanda C., Westerholm J., & Lyytinen H. (2014). The effect of using a mobile literacy game to improve literacy levels of grade one students in Zambian schools. Educational Technology Research and Development, 62(4), 417–436.

  22. Johnson N. (2012). The institutional costs of student attrition. The institutional costs of student attrition. Washington, DC: American Institutes for Research.

  23. Judge S., Floyd K., & Jeffs T. (2015). Using mobile media devices and apps to promote young children’s learning. In K. L. Heider, & M. Renck Jalongo (Eds.), Young children and families in the information age (pp. 117–131). Dordrecht: Springer.

  24. Ke, F. (2015). Designing and integrating purposeful learning in game play: A systematic review. Educational Technology Research and Development, 64(2), 219–244. doi:10.1007/s11423-015-9418-1

  25. Kelley, P., & Whatson, T. (2013). Making long-term memories in minutes: a spaced learning pattern from memory research in education. Frontiers in Human Neuroscience, 7(589). doi:https://doi.org/10.3389/fnhum.2013.00589

  26. Kerfoot B. P., Turchin A., Breydo E., Gagnon D., & Conlin P. R. (2014). An online spaced-education game among clinicians improves their patients’ time to blood pressure control. Circulation: Cardiovascular Quality and Outcomes, 7(3), 468–474.

  27. Koivisto, J., & Hamari, J. (2014). Demographic differences in perceived benefits from gamification. Computers in Human Behavior, 35, 179–188. doi:10.1016/j.chb.2014.03.007

  28. Kudo, C., Kohara, N., Urata, M., Endo, M., Yasuda, T., Hamatani, T., & Mouri, K. (2015). Developing an astronomy education system in science museum using push notifications. In Proceedings 2015 IEEE: (GCCE), 4th Global Conference on Consumer Electronics. IEEE. (pp. 614–618).

  29. Lah N. C., Saat R. M., & Hassan R. (2014). Cognitive strategy in learning chemistry: How chunking and learning get together. Malaysian Online Journal of Educational Sciences, 2(1), 9–15.

  30. Laine, T. H., Nygren, E., Dirin, A., & Suk, H.-J. (2016). Science Spots AR: A platform for science learning games with augmented reality. Educational Technology Research and Development, 64(3), 507–531. doi:10.1007/s11423-015-9419-0

  31. Lokuge Dona K., Gregory J., & Pechenkina E. (2016). Digital badges as motivator in MOOCs - the Carpe Diem MOOC experience. In L. Muilenburg, & Z. Berge (Eds.), Digital badges in education: Trends, issues, and cases (pp. 238–248). Oxford: Routledge.

  32. Mackay, M. M. (2014). Australian mobile phone lieftyle index. Mobile phone use compared to the tablet and personal computer. The Digital Industry Association of Australia. http://www.sponsor-ed.com.au/app/webroot/uploaded_files/media/Ampli%202013%20Report_Final_October%2024.pdf. Accessed 17 July 2017.

  33. Meer, N. M., & Chapman, A. (2014). Assessment for confidence: exploring the impact that low-stakes assessment design has on student retention. The International Journal of Management Education, 12(2), 186–192. doi:10.1016/j.ijme.2014.01.003

  34. O'Keeffe P. (2013). A sense of belonging: Improving student retention. College Student Journal, 47(4), 605–613.

  35. Pechenkina E. (2017). Developing a typology of mobile apps in higher education: A national case-study. Australasian Journal of Educational Technology, 33(4), 134–146. https://doi.org/10.14742/ajet.3228.

  36. Ryan J. F. (2004). The relationship between institutional expenditures and degree attainment at baccalaureate colleges. Research in Higher Education, 45(2), 97–114.

  37. Salmon, G., Pechenkina, E., Chase, A.-M., & Ross, B. (2016). Designing Massive Open Online Courses to take account of participant motivations and expectations British. Journal of Educational Technology. doi:10.1111/bjet.12497

  38. Shah, M., Sid Nair, C., & Bennett, L. (2013). Factors influencing student choice to study at private higher education institutions. Quality Assurance in Education, 21(4), 402–416. doi:10.1108/QAE-04-2012-0019

  39. Shenoi, R., Rubalcava, D., Naik-Mathuria, B., Sloas, H. A., Delemos, D., Xu, L., & Mendez, D. (2016). Interactive spaced online education in pediatric trauma. SAGE Open, 6(2), 1–8. doi:10.1177/2158244016653167.

  40. Sung, Y.-T., Chang, K.-E., & Liu, T.-C. (2016). The effects of integrating mobile devices with teaching and learning on students’ learning performance: A meta-analysis and research synthesis. Computers & Education, 94, 252–275.doi: 10.1016/j.compedu.2015.11.008

  41. Wanner, T., & Palmer, E. (2015). Personalising learning: Exploring student and teacher perceptions about flexible learning and assessment in a flipped university course. Computers & Education, 88, 354–369 doi:10.1016/j.compedu.2015.07.008

  42. Weitze, L., & Söbke, H. (2016). Quizzing to become an engineer-a commercial quiz app in higher education. In Proceeding: New Perspectives in Science Education, Pixel. (pp. 225–230).

  43. Werbach K., & Hunter D. (2015). The gamification toolkit: Dynamics, mechanics, and components for the win. Philadelphia: Wharton Digital Press.

  44. Woo J. C. (2014). Digital game-based learning supports student motivation, cognitive success, and performance outcomes. Journal of Educational Technology & Society, 17(3), 291–307.

Download references

Acknowledgements

All authors would like to thank Professor Mike Keppell for his unceasing support and encouragement. The authors also would like to express their gratitude to the journal’s editors and reviewers for their invaluable feedback. Last but not least, the authors thank all students who participated in this research.

Disclaimer

This research received ethical clearance from Swinburne’s Human Research Ethics Committee (SUHREC). The initial development of the app prototype was supported by a 2015 Learning Futures Seed Project grant awarded to Dr. Grainne Oates. Any potential conflicts of interest were minimal and resolved by having participant recruitment and data collection and analysis for this study conducted by researcher and learning technologist who were not involved in teaching and assessment in units described in this study. For the quantitative segment of this study, only aggregate statistical data was accessed and used, as per the approved institutional ethics protocol.

Author information

Affiliations

  1. Learning Transformations Unit, Swinburne University of Technology, Box 218, Mail H63, John Street, Hawthorn, VIC, 3122, Australia
    • Ekaterina Pechenkina
  2. La Trobe Learning and Teaching, La Trobe University, Melbourne, Australia
    • Daniel Laurence
  3. Swinburne Business School, Swinburne University of Technology, Melbourne, Australia
    • Grainne Oates
  4. School of Science, Swinburne University of Technology, Melbourne, Australia
    • Daniel Eldridge
  5. Swinburne Law School Swinburne University of Technology, Melbourne, Australia
    • Dan Hunter
Authors
  1. Ekaterina Pechenkina
    View author publications
    You can also search for this author in
  2. Daniel Laurence
    View author publications
    You can also search for this author in
  3. Grainne Oates
    View author publications
    You can also search for this author in
  4. Daniel Eldridge
    View author publications
    You can also search for this author in
  5. Dan Hunter
    View author publications
    You can also search for this author in

Contributions

EP designed the research project and developed the first draft of this paper while DL performed the statistical analyses of data and contributed to various critical aspects of the writing process and study design. Together, EP and DL were in charge of participant recruitment and data collection. GO and DE were teaching instructors in the units which piloted the app and both have contributed to the sections of this paper describing the app’s development and operationalisation processes. DH provided overall advice on the study’s design and data collection methods. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Ekaterina Pechenkina.

Ethics declarations

About the Authors

Ekaterina Pechenkina is Research Fellow based at the Learning Transformations Unit, Swinburne University of Technology. Ekaterina holds a PhD in cultural anthropology from the University of Melbourne (2014) and several other degrees. She was an International Research and Exchange Board fellow based at the California State University Bakersfield (2003–2004) and since 2016 is a member of Australian and New Zealand mobile learning group anzMLearn. Ekaterina is primarily interested in understanding the relationships between technology and education from critical standpoints. She has published widely on various education topics.

Daniel Laurence is a Senior Educational Designer with La Trobe Learning and Teaching, La Trobe University Learning. His primary research interest is in the effective application of game principles and technologies in education.

Grainne Oates is a Senior Lecturer in Accounting at Swinburne University of Technology. She specialises in teaching introductory and management accounting at undergraduate and post graduate levels.

Daniel Eldridge is a chemistry academic at Swinburne University of Technology. He teaches heavily into chemistry units and researches student engagement and sustainable study habits.

Professor Dan Hunter is the founding dean of Swinburne Law School. He is an international expert in internet law, intellectual property and cognitive science models of law. He holds a PhD from Cambridge on the nature of legal reasoning, as well as computer science and law degrees from Monash University and a Master of Laws by research from the University of Melbourne.

Ethics approval and consent to participate

This research received ethical clearance from Swinburne’s Human Research Ethics Committee (SUHREC). At the first instance of using the app, students were informed that their anonymous aggregate usage data would be collected for research purposes and might be published. While students could opt-out from this process, there were no opt-outs or complaints received.

Competing interests

Authors declare no competing interests in this research, however they would like to acknowledge that the initial development of the app prototype was supported by a 2015 Learning Futures Seed Project grant awarded to Dr. Grainne Oates. Any potential conflicts of interest resulting from Dr. Oates receiving this funding were minimal and resolved by having participant recruitment and data collection and analysis for this study conducted by the lead researcher (first author) and learning technologist (second author) who were not involved in teaching and assessment in units described in this study or had any personal stake in the app’s success. Further, the first author was in charge of designing this research project and developing the first draft of this paper; the second author performed the statistical analyses of data and contributed to various critical aspects of the writing process and study design; the third and the fourth authors were instructors in the units which piloted the app and have accessed the app analytics data and aggregate completion and performance rates from their respective units. Finally, the last author provided advice on the study’s design and data collection methods.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Pechenkina, E., Laurence, D., Oates, G. et al. Using a gamified mobile app to increase student engagement, retention and academic achievement. Int J Educ Technol High Educ 14, 31 (2017). https://doi.org/10.1186/s41239-017-0069-7

Download citation

Keywords

  • Gamified mobile app
  • Testing effect
  • Spacing effect
  • Mobile app design
  • Student engagement
  • Student retention
  • Student achievement