Two Designs of Leaderboards in Gamification-based Formative Evaluation in E-Learning Environment, and their Effect on Academic Achievement, Answer Accuracy, Test Anxiety Reduction and Engagement in Learning, in Teachers’ students.

Rabea, Anhar

doi:10.21608/jsre.2022.147072.1484

Two Designs of Leaderboards in Gamification-based Formative Evaluation in E-Learning Environment, and their Effect on Academic Achievement, Answer Accuracy, Test Anxiety Reduction and Engagement in Learning, in Teachers’ students.

Document Type : Original Article

Author

Anhar Rabea

Faculty of Women

10.21608/jsre.2022.147072.1484

Abstract

The research aims to develop two designs of Leaderboards (onymous vs anonymous) in Gamification-based formative evaluation, in E-learning environment and their effect on academic achievement, answer accuracy, test anxiety reduction and engagement in learning in teachers’ students. The study’s sample were divided into two experimental groups. The study’s results revealed that there is an equality gain in the final academic achievement as well as an increase in the final academic achievement posttest than in the final academic achievement pretest. The results also showed that both of the two designs of the leaderboards have achieved a big effect size on the final academic achievement posttest in both groups and that there was a strong inversely proportional relationship between the final academic achievement posttest and the formative evaluation tests regardless of the type of the leaderboards design. Moreover, the results indicated that the female students of the 1st group outperformed those in the 2nd experimental one in relation to the answer accuracy as measured by the formative evaluation tests and that the 1st group reached the 1st level of high-test anxiety while the 2nd group reached the 2nd level of high-test anxiety as measured by the test anxiety measure posttest. In addition, the female students in the 1st group performed better than those in the 2nd experimental one on the engagement as a whole in relation to the emotional dimension, but students in both groups have equally performed on the cognitive and behavioral dimensions on the same engagement.

Keywords

Main Subjects

Educational technology

References

Abu Dawood, S. M. (2019). Students’ attitudes toward educational gamification in online learning environments. DOCTOR OF PHILOSOPHY. UNIVERSITY OF NORTH TEXAS.

Agustia, M., Aprilia, C., Sari, J., Hikmah, D., & Risnita, R. (2021). Using Quizizz in Learning Assesment with Science Literacy Oriented in Science Learning. International Journal of Engineering, Science and Information Technology, 1(1), 86-90.

Alsawaier, R. S. (2018). The effect of gamification on motivation and engagement. The International Journal of Information and Learning Technology. 35(1), 56-79.‏

Bachen, C. M., & Raphael, C. (2011). Social flow and learning in digital games: A conceptual model and research agenda. In Serious games and edutainment applications (pp. 61-84). Springer, London.‏

Bai, S., Hew, K. F., Sailer, M., & Jia, C. (2021). From top to bottom: How positions on different types of leaderboard may affect fully online student learning performance, intrinsic motivation, and course engagement. Computers & Education, 173, 1-15.‏

Bal, S. (2018). Using Quizizz.Com To Enhance Pre intermediate Students' Vocabulary Knowledge. International Journal of Language Academy, 6(3), 295-303.

Bellotti, F., Berta, R., De Gloria, A., Lavagnino, E., Dagnino, M. F., Antonaci, A., et al. (2013). A gamified short course for promoting entrepreneurship among ICT engineering students. In 2013 IEEE 13th International Conference on Advanced Learning Technologies.

Burcaş, S., & Creţu, R. Z. (2021). Multidimensional perfectionism and test anxiety: A meta-analytic review of two decades of research. Educational Psychology Review, 33(1), 249-273.‏

Brühlmann, F., Mekler, E., & Opwis, K. (2013). Gamification from the perspective of self-determination theory and flow. University of Basel.‏

Brull, S., & Finlayson, S. (2016). Importance of gamification in increasing learning. The Journal of Continuing Education in Nursing, 47(8), 372–375.

Cahyani, A. D. (2016). Gamification approach to enhance students engagement in studying language course. In MATEC Web of Conferences (Vol. 58, p. 1-6). EDP Sciences.

Çakıroglu, U., Basbuyuk, B., Guler, M., Atabay, M.& Memis¸, B. Y. (2017). Gamifying an ICT course: Influences on engagement and academic performance. Computers in Human Behavior, 69, 98–107.

Cantador, I., & Conde, J. M. (2010). Effects of competition in education: A case study in an e-learning environment.‏ IADIS International Conference e-Learning, 11-18.

Charles, D., Charles, T., McNeill, M., Bustard, D., & Black, M. (2011). Game-based feedback for educational multi-user virtual environments. British Journal of Educational Technology, 42(4), 638e654.

Cheong, C., Filippou, J., & Cheong, F. (2014). Towards the gamification of learning: Investigating student perceptions of game elements. Journal of Information Systems Education, 25(3), 233-244.‏

Cherry, K. (2022).Test Anxiety: Definition, Symptoms, Traits, Causes, and Treatment. Retrieved from: Test Anxiety: Definition, Symptoms, Traits, Causes, and Treatment (verywellmind.com).

Crawford, C. (2011). The Art of Computer Game Design. Copyright Chris Crawford, 2011 (originally published 1984).

De Byl, P., & Hooper, J. (2013). Key attributes of engagement in a gamified learning environment. In ASCILITE-Australian Society for Computers in Learning in Tertiary Education Annual Conference (pp. 221-230). Australasian Society for Computers in Learning in Tertiary Education.‏

Deci, E. L., Koestner, R., & Ryan, R. M. (1999). A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation. Psychological Bulletin, 125, 627-688.

Deci, E. L., Koestner, R., & Ryan, R. M. (2001). Extrinsic rewards and intrinsic motivation in education: reconsidered once again. Review of Educational Research, 71, 1-27.

De Lope, R. P., Arcos, J. R. L., Medina-Medina, N., Paderewski, P., & Gutierrez-Vela, F. L. (2017). Design methodology for educational games based on graphical notations: Designing Urano. Entertainment Computing, 18, 1–14.

Desrochers, M. N., Pusateri Jr, M. J., & Fink, H. C. (2007). Game assessment: Fun as well as effective. Assessment & Evaluation in Higher Education, 32(5), 527-539.

Dewi, Hartini. (2019). Application of Problem Based Learning Method to Improve Completeness of Learning Physics Aided by Quizizz Evaluation in Semester Credit System Schools. Journal of Educational Partners, 3(10), 1298 - 1313.

Domínguez, A., Saenz-de-Navarrete, J., de-Marcos, L., Fernandez-Sanz, L., Pag es, C., & Martínez-Herr aiz, J. J. (2013). Gamifying learning experiences: practical implications and outcomes. Computers & Education, 63, 380-392.

DordiNejad, F. G., Hakimi, H., Ashouri, M., Dehghani, M., Zeinali, Z., Daghighi, M. S., & Bahrami, N. (2011). On the relationship between test anxiety and academic performance. Procedia-Social and Behavioral Sciences, 15, 3774-3778.‏

Driscoll, R. (2007). Westside test anxiety scale validation. Online Submission.

Eikelboom MA, J. J. (2016). Engagement, gamification, and workplace satisfaction: A convergent study of user indicators.‏

Elmahdi, I., Al-Hattami, A., & Fawzi, H. (2018). Using technology for formative assessment to improve students' learning. Turkish Online Journal of Educational Technology TOJET, 17(2), 182-188.

Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004). School engagement: Potential of the concept, state of the evidence. Review of educational research, 74(1), 59-109.

Friedrich, J., Becker, M., Kramer, F., Wirth, M., & Schneider, M. (2020). Incentive design and gamification for knowledge management. Journal of Business Research, 106, 341-352.‏

Garcia, S. M., & Tor, A. (2007). Rankings, standards, and competition: Task vs. scale comparisons. Organizational Behavior and Human Decision Processes, 102(1), 95–108.

Goksün, € D. O., & Gürsoy, G. (2019). Comparing success and engagement in gamified learning experiences via Kahoot and Quizizz. Computers & Education, 135, 15–29.

Gonzalez, AG. (2019). Real-Time Assessment Tool Implementation: Practical Experience With Kahoot!, Plickers And Quizizz. Master's Thesis, University of La Laguna, La Laguna.

Hamari, J., Koivisto, J.& Sarsa, H. (2014). Does gamification work? A literature review of empirical studies on gamification. Proceedings of the 47th Hawaii internat.

Hamari, J. (2017). Do badges increase user activity? A field experiment on the effects of gamification. Computers in Human Behavior, 71, 469–478.

Hanus, M. D., & Fox, J. (2015). Assessing the effects of gamification in the classroom: A longitudinal study on intrinsic motivation, social comparison, satisfaction, effort, and academic performance. Computers & education, 80, 152-161.‏

Hitchens, M., & Tulloch, R. (2018). A gamification design for the classroom. Interactive Technology and Smart Education. 15(1), 28-45.

Huang, B., & Hew, K. F. (2018). Implementing a theory-driven gamification model in higher education flipped courses: Effects on out-of-class activity completion and quality of artifacts. Computers & Education, 125, 254–272.

Huang, B., Hew, K. F., & Lo, C. K. (2018). Investigating the effects of gamification-enhanced flipped learning on undergraduate students’ behavioral and cognitive engagement. Interactive Learning Environments, 1–21.

Jurgelaitis, M., Ceponien, L., Ceponis, J.& Drungilas, V. (2019). Implementing gamification in a university-level UML modeling course: A case study. Computer Applications in Engineering Education, 27(2), 332–343.

Karaman, S. (2011). Examining the effects of flexible online exams on students’ engagement in e-learning. Educational Research and Reviews, 6(3), 259-264.

Kennette, L. N., & Beechler, M. P. (2019). Gamifying The Classroom. Transformative Dialogues: Teaching and Learning Journal, 12(2), 1-8.

Kennette, L. N., College, D., Beechler, M. P., & College, A. (2019). Gamifying The Classroom : Tips from the Trenches, 12(2), 1–9.

Khasanah, K., & Lestari, A. (2021). The Effect of Quizizz and Learning Independence on Mathematics Learning Outcomes. Tadris: Jurnal Keguruan dan Ilmu Tarbiyah, 6(1), 63-74.‏

Kim, B. (2015). Designing gamification in the right way. Library Technology Reports, 51(2), 29-35.

Koivisto, J., & Hamari, J. (2014). Demographic differences in perceived benefits from gamification. Computers in Human Behavior, 35, 179–188.

Kyewski, E., & Kramer, N. C. (2018). To gamify or not to gamify? An experimental field study of the influence of badges on motivation, activity, and performance in an online learning course. Computers & Education, 118, 25–37.

Landers, R. N. (2014). Developing a theory of gamified learning: Linking serious games and gamification of learning. Simulation & Gaming, 45(6), 752–768. https://doi. org/10.1177/1046878114563660.

Landers, R. N., & Landers, A. K. (2014). An empirical test of the theory of gamified learning: The effect of leaderboards on time-on-task and academic performance. Simulation & Gaming, 45(6), 769-785.‏

Landers, R. N., Bauer, K. N., & Callan, R. C. (2017). Gamification of task performance with leaderboards: A goal setting experiment. Computers in Human Behavior, 71, 508-515.‏

Lee, J. J., & Hammer, J. (2011). Gamification in education: What, how, why bother?. Academic exchange quarterly, 15(2), 146.‏

Lo, C. K.& Hew, K. F. (2018). A comparison of flipped learning with gamification, traditional learning, and online independent study: The effects on students’ mathematics achievement and cognitive engagement. Interactive Learning Environments, 1–18.

Mahmud, Z., Weber, P. J., & Moening, J. P. (2017, June). Gamification of engineering courses. In 2017 ASEE Annual Conference & Exposition.‏

Martin, J., & Torres, A. (2016). What is student engagement and why is it important. Retrieved May, 4, 2018.‏

Mazarakis, A., & Bräuer, P. (2020). Gamification of an open access quiz with badges and progress bars: An experimental study with scientists. In GamiFIN, 62-71.‏

Mulyati, S., & Evendi, H. (2020). Pembelajaran matematika melalui media game quizizz untuk meningkatkan hasil belajar matematika SMP. GAUSS: Jurnal Pendidikan Matematika, 3(1), 64-73.

Nah, F. F. H., Zeng, Q., Telaprolu, V. R., Ayyappa, A. P., & Eschenbrenner, B. (2014, June). Gamification of education: a review of literature. In International conference on hci in business (pp. 401-409). Springer, Cham.‏

Nie, Y., Lau, S., & Liau, A. K. (2011). Role of academic self-efficacy in moderating the relation between task importance and test anxiety. Learning and Individual Differences, 21(6), 736-741.‏

Osterweil, S. (2014) four freedoms of play. Accessed on June 29, 2017. Available at http://iridescentlearning.org/2014/08/the-four-freedoms-of-play-and-common-core_standardized-testing/

Oxford Analytica (2016). Gamification and the Future of Education. Oxford Analytica: London, United Kingdom

Parsons, J., & Taylor, L. (2011). Improving student engagement. Current issues in education, 14(1).‏

Pesare, E., Roselli, T., Corriero, N., & Rossano, V. (2016). Game-based learning and gamification to promote engagement and motivation in medical learning contexts. Smart Learning Environments, 3(1), 1-21.‏

Philpott, A. (2020). Examining EFL students’ motivation and attitudes toward a gamified course using leaderboards and quests at a Japanese university (Doctoral dissertation, University of Southern Queensland).‏

Pitoyo, M.D., Sumardi, & Asib, A. (2019). Gamification based assessment: A Test Anxiety Reduction through Game Elements in Quizizz Platform. International Online Journal of Education and Teaching (IOJET), 6(3), 456-471.

Pitoyo, M. D., & Asib, A. (2020). Gamification-Based Assessment: The Washback Effect of Quizizz on Students' Learning in Higher Education. International Journal of Language Education, 4(1), 1-10.‏

Purba, Leony Sanga Lamsari. (2019). Increasing Student Learning Concentration through Utilization of Quizizz Learning Evaluation in Physics Chemistry Subject I. Educational Dynamics Journal, 12(1), 29-39.

Rahim, A. S. A., Ziden, A. A., & Yap, B. K. (2020). Gamified Online Quizzes: Pharmacy Student Perceptions of Learning in an Undergraduate Medicinal Chemistry Course. Malaysian Journal of Pharmacy (MJP), 6(1), 6-12.‏

Rama, B. (2017). Disambiguation of named entities using a novel gamified framework (Master's thesis, NTNU).

Reiners, T., & Wood, L. C. (2015). Gami cation in Education and Business. Springer Science.‏

Richter, G., Raban, D. R., & Rafaeli, S. (2015). Studying gamification: The effect of rewards and incentives on motivation. In Gamification in education and business (pp. 21-46). Springer, Cham.‏

Rivers, L. (2016). The impact of gamification on employee engagement in advertising agencies in South Africa (Doctoral dissertation, University of Pretoria).‏

Sanchez, D. R., Langer, M., & Kaur, R. (2020). Gamification in the classroom: Examining the impact of gamified quizzes on student learning. Computers & Education, 144, 1-16.

Santos-Guevara, B. N., & Rincon-Flores, E. G. (2020). Gamification: Its Pedagogical Innovations Benefit Internship Seekers. In Proceeding of the 6th International Conference on Education, 6(2), 17-25.

Sarason, I. G. (1984). Stress, anxiety, and cognitive interference: reactions to tests. Journal of Personality and Social Psychology, 46(4), 929–938.

Smits, J., & Charlier, N. (2011, October). Game-based assessment and the effect on test anxiety: A case study. In European Conference on Games Based Learning (p. 562). Academic Conferences International Limited.‏

Soman, D., & Huang, W. H. Y. (2013). A practitioner’s guide to gamification of education. Toronto: University of Toronto.‏

Spielberger, C. (2010). Test anxiety inventory. The Corsini encyclopedia of psychology, 1-1.‏

Strmecki, D., Bernik, A., & Radosevic, D. (2015). Gamification in E-Learning: Introducing Gamified Design Elements into E-Learning Systems. J. Comput. Sci., 11(12), 1108-1117.

Suarez, M. J., & Quimbo, M. A. T. (2016). Test Anxiety and Selected Personal Factors as Determinants of Academic Performance of Undergraduate Online Learners. Malaysian Journal of Distance Education, 18(1).‏

Suo, Y. M., & Suo Y. J., & Zalika, A. (2018). Implementing Quizizz As Game Based Learning In The Arabic Classroom. European Journal of Social Science Education and Research, 12(1), 208-212.

Swarniti, N. W. (2021). Efektivitas Penggunaan Aplikasi Quizizz Dalam Proses Pembelajaran Bahasa Inggris Bagi Mahasiswa. In Seminar Nasional Teknologi Pembelajaran, 1(1), 133-144.‏

Tsay, C. H., Kofinas, A., & Luo, J. (2018). Enhancing student learning experience with technology-mediated gamification: An empirical study. Computers & Education, 121, 1–17.

Turner, C. E. (2009). Examining washback in second language education contexts: A high stakes provincial exam and the teacher factor in classroom practice in Quebec secondary schools. International Journal of Pedagogies and Learning, 5(1), 103- 123.

Urh, M., Vukovic, G., & Jereb, E. (2015). The model for introduction of gamification into e-learning in higher education. Procedia-Social and Behavioral Sciences, 197, 388-39.‏

Wheeler, M. A., & Roediger, H. L. (1992). Disparate effects of repeated testing: Reconciling Ballard's (1913) and Bartlett's (1932) results. Psychological Science, 3(4), 240–246.

Wing, E. A., Marsh, E. J., & Cabeza, R. (2013). Neural correlates of retrieval-based memory enhancement: An fMRI study of the testing effect. Neuropsychologia, 51(12), 2360–2370.

Wongso, O., Rosmansyah, Y., & Bandung, Y. (2014, August). Gamification framework model, based on social engagement in e-learning 2.0. In 2014 2nd international conference on technology, informatics, management, engineering & environment (pp. 10-14). IEEE.‏

Yunus, A., Callista, C., & Hua, T. K. (2021). Exploring a Gamified Learning Tool in the ESL Classroom: The Case of Quizizz. Journal of Education and e-Learning Research, 8(1), 103-108.‏

Zainuddin, Z., Shujahat, M., Haruna, H., & Chu, S. K. W. (2020). The role of gamified e-quizzes on student learning and engagement: An interactive gamification solution for a formative assessment system. Computers & Education, 145, 1-15.‏