Designing Augmented Books Based on the Combination of Visual Cues and Eeducational Gamifications in the Interactive Video for Developing Visual Culture Skills and learning immersion among Hard of Hearing Students

Document Type : Original Article

Author

faculty of Education Mansoura University

Abstract

The aim of the research was to design augmented books based on the combination of visual cues and educational Gamifications in the interactive video for developing visual culture skills and learning immersion among hard of hearing students. A list of standards for designing augmented books based on the combination of visual cues and educational Gamifications in the interactive video was identified. Augmented books based on the combination of visual cues and educational Gamifications in the interactive video was designed in the light of these standards using ADDIE General Design Model. The research sample consisted of (28) male and female students, who were divided into three experimental groups. The analytical descriptive approach and the experimental approach were relied upon. The research tools included the visual culture skills test, the learning immersion scale, and the achievement test. The experiment was applied and the data were collected and analyzed through the application of appropriate statistical methods using SPSS. The results revealed that there were statistically significant differences between the three groups on the post- administration of each of the research tools (visual culture skills test, learning immersion scale, and achievement test) in favor of the third experimental group. The previous result is attributed to the fact that the merging method was based on taking advantage of the characteristics and advantages of both the visual cues and the Gamifications included in the interactive video in the augmented book.

Keywords

Main Subjects

References

Abramovich, S., Schunn, C., & Higashi, R. (2013). Are badges useful in education?: It depends upon the type of badge and expertise of learner. Educational Technology Research and Development, 61(2), 217-232.
Awwaf ‏, T., & Zaidan, A. (2020). The effects of the interaction between the type of Visual Cue and its display style via digital mobile content on the development of immediate and delayed cognitive achievement among middle school students in the English language curriculum. Journal of Educational and Psychological Sciences, 4(16), 22-51.
Bacca, J., Baldiris, S., Fabregat, R., & Graf, S. (2014). Augmented reality trends in education: a systematic review of research and applications.
Billinghurst, M., & Duenser, A. (2012). Augmented reality in the classroom. Computer, 45(7), 56-63.‏
Bjork, S., & Holopainen, J. (2004). Patterns in game design (game development series). Charles River Media, 423.
Boucheix, J. M., & Lowe, R. K. (2010). An eye tracking comparison of external pointing cues and internal continuous cues in learning with complex animations. Learning and instruction, 20(2), 123-135.
Brashears, T., Akers, C., & Smith, J. (2005). The effects of multimedia cues on student cognition in an electronically delivered high school unit of instruction. Journal of Southern Agricultural Education Research, 55(1), 5-18.
Catenazzi, N., & Sommaruga, L. (2013). Mobile Learning and Augmented Reality: New Learning Opportunities. Social Media: Challenges and Opportunities for Education in Modern Society, 1(1), 9-13.‏
Charles, D., Charles, T., McNeill, M., Bustard, D., & Black, M. (2011). Game‐based feedback for educational multi‐user virtual environments. British Journal of Educational Technology, 42(4), 638-654.
Chen, C. H., Lee, I. J., & Lin, L. Y. (2016). Augmented reality-based video-modeling storybook of nonverbal facial cues for children with autism spectrum disorder to improve their perceptions and judgments of facial expressions and emotions. Computers in Human Behavior, 55, 477-485.‏
Chen, C. M., & Tsai, Y. N. (2012). Interactive augmented reality system for enhancing library instruction in elementary schools. Computers & Education, 59(2), 638-652.
Cheng, M. T., She, H. C., & Annetta, L. A. (2015). Game immersion experience: its hierarchical structure and impact on game‐based science learning. Journal of Computer Assisted Learning, 31(3), 232-253.‏
Chiu, T. K., Hsieh, T. C., Lee, M. C., Chang, J. W., & Wang, T. I. (2012). Using Controllable Partial Sub1titles and Interactive Features in Educational Videos. International Journal of Information and Education Technology, 2(4), 364.
Clinton, V., Morsanyi, K., Alibali, M. W., & Nathan, M. J. (2016). Learning about probability from text and tables: Do color coding and labeling through an interactive‐user interface help?. Applied Cognitive Psychology, 30(3), 440-453.
 Dalle, J., Hadi, S., Mutalib, A. A., & Sumantri, C. (2018). Signaling principles in interactive learning media through expert's walkthrough. Turkish Online Journal of Distance Education (TOJDE), 19(04), 147-162.
Deterding, S., Sicart, M., Nacke, L., O'Hara, K., & Dixon, D. (2011, May). Gamification. Using game-design elements in non-gaming contexts. In CHI'11 extended abstracts on human factors in computing systems, 2425-2428, ACM.‏
DomíNguez, A., Saenz-De-Navarrete, J., De-Marcos, L., FernáNdez-Sanz, L., PagéS, C., & MartíNez-HerráIz, J. J. (2013). Gamifying learning experiences: Practical implications and outcomes. Computers & education, 63, 380-392.‏
Dong, C., & Si, Z. (2018). The research and application of augmented reality in 3D interactive books for children. In Applied Sciences in Graphic Communication and Packaging (pp. 293-299). Springer, Singapore.‏
Dubinsky, E., & McDonald, M. A. (2001). APOS: A constructivist theory of learning in undergraduate mathematics education research. In The teaching and learning of mathematics at university level, 275-282, Springer Netherlands.‏
Esteves, M., Pereira, A., Veiga, N., Vasco, R & Veiga, A. (2018): The Use of New Learning Technologies in Higher Education Classroom: A Case Study, IJEP, 8(2), 115-127.
Evmenova, A. S., Graff, H. J., & Behrmann, M. M. (2017). Providing access to academic content for high-school students with significant intellectual disability through interactive videos. Focus on Autism and Other Developmental Disabilities, 32(1), 18-30.
Filatro, A., & Cavalcanti, C. C. (2016, November). Structural and content gamification design for tutor education. In E-Learn: World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education, 1152-1157, Association for the Advancement of Computing in Education (AACE).
Furlong, M. J., & Christenson, S. L. (2008). Engaging students at school and with learning: A relevant construct for all students. Psychology in the Schools.
Gafni, R., Achituv, D. B., Eidelman, S., & Chatsky, T. (2018). The effects of gamification elements in e-learning platforms. Online Journal of Applied Knowledge Management (OJAKM), 6(2), 37-53.‏
Gedera, D. S., & Zalipour, A. (2018). Use of interactive video for teaching and learning. In ASCILITE 2018 (pp. 362-367). Australasian Society for Computers in Learning in Tertiary Education.
Glaser, M., & Schwan, S. (2020). Combining verbal and visual cueing: Fostering learning pictorial content by coordinating verbal explanations with different types of visual cueing. Instructional Science, 1-24.
Gonzàle, F., Villarejo, L., Miralbell, O & Gomis, J. (2012, 24-26 Sept). How to use mobile technology and augmented reality to enhance collaborative learning on cultural and natural heritage? An e-learning experience. New Trends on Global Education Conference 2012 (GEC 2012), North Cyprus, 495-500.
Goshevski, D., Veljanoska, J., & Hatziapostolou, T. (2017, September). A Review of Gamification Platforms for Higher Education. In Proceedings of the 8th Balkan Conference in Informatics (p. 28). ACM.
Gudinavičius, A., & Markelevičiūtė, G. (2020). Using Augmented Reality in Book Publishing from a Small Language Market Perspective. Publishing Research Quarterly, 36(1), 43-54.
Gunuc, S & Kuzu, A ( 2014) Factors Influencing Student Engagement and the Role of Technology in Student Engagement in Higher Education: Campus-Class-Technology Theory, Turkish Online Journal of Qualitative Inquiry, October, 5(4), 86-113.
Ha, T., Lee, Y., & Woo, W. (2009). Trends ad prospects of research on interactive digilog books. Journal of Korea Multimedia Association, 13(3), 89-98.
Hamari, J., Koivisto, J., & Sarsa, H. (2014, January). Does gamification work?--a literature review of empirical studies on gamification. In 2014 47th Hawaii international conference on system sciences (pp. 3025-3034).
Hanus, M. D., & Fox, J. (2015). Assessing the effects of gamification in the classroom: A longitudinal study on intrinsic motivation, social comparison, satisfaction, effort, and academic performance. Computers & education, 80, 152-161.
Hashim, H., Tasir, Z., & Mohamad, S. K. (2013). E-Learning Environment for Hearing Impaired Students. Turkish Online Journal of Educational Technology-TOJET, 12(4), 67-70.
He, Z., Wu, L., & Li, X. (2018). When art meets tech: The role of augmented reality in enhancing museum experiences and purchase intentions. Tourism Management, 68(2018), 127-139.
Hendrikse, M. M., Llorach, G., Grimm, G., & Hohmann, V. (2018). Influence of visual cues on head and eye movements during listening tasks in multi-talker audiovisual environments with animated characters. Speech Communication, 101, 70-84.‏
Hrishikesh, N & J Nair, J. (2016, 21-24 Sept). Interactive learning system for the hearing impaired and the vocally challenged.  International Conference on Advances in Computing, Communications and Informatics (ICACCI).
Huang, W. H. Y., & Soman, D. (2013). Gamification of education. Research Report Series: Behavioural Economics in Action, Rotman School of Management, University of Toronto.
Hui, L. T., Hoe, L. S., Ismail, H., Azman, A., & Keat, T. K. (2016). Playability and social experiences: An acceptance study of interactive video puzzle technology in preschool setting. Journal of Theoretical and Applied Information Technology, 83(3), 465.
Hwang, G. J., Wu, P. H., Chen, C. C., & Tu, N. T. (2016). Effects of an augmented reality-based educational game on students' learning achievements and attitudes in real-world observations. Interactive Learning Environments, 24(8), 1895-1906.
Kapp, K. M. (2012). The gamification of learning and instruction: game-based methods and strategies for training and education. John Wiley & Sons.‏
Kazanidis, I., Palaigeorgiou, G., Papadopoulou, Α., &  Tsinakos, A. (2018). Augmented Interactive Video: Enhancing Video Interactivity for the School Classroom. Journal of Engineering Science and Technology, 11 (2), 174 – 181.
Kelpšienė, M. (2020). The Usage of Books Containing Augmented Reality Technology in Preschool Education. Pedagogika, 138(2), 150-174.
Kiryakova, G., Angelova, N., & Yordanova, L. (2014). Gamification in education. Proceedings of 9th International Balkan Education and Science Conference.
Kleftodimos, A., & Evangelidis, G. (2016). An Interactive Video-based Learning Environment that Supports Learning Analytics for Teaching'Image Editing'. In SE@ VBL@ LAK, 26-33.‏
Kuh, G. D., Cruce, T. M., Shoup, R., Kinzie, J., & Gonyea, R. M. (2008). Unmasking the effects of student engagement on first-year college grades and persistence. The journal of higher education, 79(5), 540-563.
Lee, K. (2012). Augmented reality in education and training. TechTrends, 56(2), 13-21.‏
Lee, M., & Hong, H. (2016). Transferring Knowledge to Experience: Immersive Learning Project for Indiana School for the Deaf. JoME, 1(7), 1-69.
Lei, H., Cui, Y., & Zhou, W. (2018). Relationships between student engagement and academic achievement: A meta-analysis. Social Behavior and Personality: an international journal, 46(3), 517-528.‏
Lim, C., & Park, T. (2011). Exploring the educational use of an augmented reality books. In Proceedings of the Annual Convention of the Association for Educational Communications and Technology (pp. 172-182).
Lin, C. Y., Chai, H. C., Wang, J. Y., Chen, C. J., Liu, Y. H., Chen, C. W., ... & Huang, Y. M. (2016). Augmented reality in educational activities for children with disabilities. Displays, 42, 51-54.‏
Lin, L., Atkinson, R. K., Savenye, W. C., & Nelson, B. C. (2016). Effects of visual cues and self-explanation prompts: empirical evidence in a multimedia environment. Interactive Learning Environments, 24(4), 799-813.‏
Liu, Y., Alexandrova, T., & Nakajima, T. (2011, December). Gamifying intelligent environments. In Proceedings of the 2011 international ACM workshop on Ubiquitous Meta user interfaces, 7-12, ACM.‏
Lou, D. (2019). Two fast prototypes of web-based augmented reality enhancement for books. Library Hi Tech News.
Matallaoui, A., Hanner, N., & Zarnekow, R. (2017). Introduction to gamification: Foundation and underlying theories. In Gamification , 3-18, Springer, Cham.
McIntos, N. O. (2018). The Impact of Gamification on Seventh-Graders’ Academic Achievement in Mathematics. Online Theses and Dissertations, ProQuest, No. 10974660.
Moccozet, L., & Benkada, C. (2017). Enriched Interactive Videos for Teaching and Learning. 8th International workshop on Interactive Environments and Emerging Technologies for eLearning (IEETeL2017): London.
Murray, M. (2017). Four Benefits of Interactive Video for Learning. Training Industry Magazine, Experiential Learning. 48-53.
Onita, M., Petan, S., & Vasiu, R. (2016). Review of Interactive Video-Romanian Project Proposal. International Education Studies, 9(3), 24-40.
Palakkal, V., & Chinnaiyan, M. (2010). Development of an educational interactive video-DVD on dairy health management practices. International Journal of Education and Development using ICT, 6(1), 30-39.
Papadopoulou, A., & Palaigeorgiou, G. (2016). Interactive Video, Tablets and Self-Paced Learning in the Classroom: Preservice Teachers Perceptions. International Association for Development of the Information Society. Mannheim, Germany, 195-202.
Parton, B. S., Hancock, R., & Dawson, J. (2010, September). Augmented reality for deaf students: Can mobile devices make it possible? In IFIP Human-Computer Interaction Symposium, 309-312, Springer, Berlin, Heidelberg.
Riza, L. S., Firdaus, D. S., Junaeti, E., Hidayat, T., Abdullah, A. G., Nandiyanto, A. B., & Abdullah, C. U. (2018). A concept and implementation of instructional interactive multimedia for deaf students based on inquiry-based learning model. Journal of Engineering Science and Technology, 13(7), 2016-2035.
Schoeffmann, K., Hudelist, M. A., & Huber, J. (2015). Video interaction tools: A survey of recent work. ACM Computing Surveys (CSUR), 48(1), 1-34.
Silva, G. R., Donat, J. C., Rigoli, M. M., de Oliveira, F. R., & Kristensen, C. H. (2016). A questionnaire for measuring presence in virtual environments: factor analysis of the presence questionnaire and adaptation into Brazilian Portuguese. Virtual Reality, 20(4), 237-242.
Skaržauskienė, A., & Kalinauskas, M. (2014, October). Fostering collective creativity through gamification. In The proceedings of the ISPIM Americas Innovation Forum (October 2014): Montreal, Canada on 5-8 October 2014.‏
Stigler, J., Geller, E., & Givvin, K. (2015). Zaption: A platform to support teaching, and learning about teaching, with video. Journal of e Learning and Knowledge Society, 11(2), 13-25.
Surendeleg, G., Murwa, V., Yun, H. K., & Kim, Y. S. (2014). The role of gamification in education a literature review. Contemporary Engineering Sciences, 7(2932), 1609-1616.
Terrano, M. (2018). Promoting Growth Mindset in Education as a Means to Increase Academic Achievement, Student Motivation and Engagement, and Perseverance and Resilience in the Face of Academically Rigorous Curriculum (Doctoral dissertation), California State University San Marcos.
Tiernan, P. (2014). Examining the use of interactive video to enhance just in time training in the workplace. Industrial and Commercial Training, 46 (3), 155-164.
Torres, F., Tovar, L. A. N., & Del Rio, M. S. (2017). A learning evaluation for an immersive virtual laboratory for technical training applied into a welding workshop. EURASIA J. Math. Sci. Technol. Educ, 13(2), 521-532.
Van Krevelen, D. W. F., & Poelman, R. (2010). A survey of augmented reality technologies, applications and limitations.  International journal of virtual reality, 9(2), 1-20.‏
Viana, P., & Pinto, J. P. (2017). A collaborative approach for semantic time-based video annotation using gamification. Human-centric Computing and Information Sciences, 7(1), 13.‏
Wang, S., & Chen, H. L. (2016). Video That Matters: Enhancing Student Engagement Through Interactive Video-Centric Program in Online Courses. thannual, 136-141.‏
Witmer, B. G., Jerome, C. J., & Singer, M. J. (2005). The factor structure of the presence questionnaire. Presence: Teleoperators & Virtual Environments, 14(3), 298-312.
Witt, M., Scheiner, C. W., & Robra-Bissantz, S. (2011, October). Gamification of online idea competitions: insights from an explorative case. In GI-Jahrestagung, 392.
Wu, H. K., Lee, S. W. Y., Chang, H. Y., & Liang, J. C. (2013). Current status, opportunities and challenges of augmented reality in education. Computers & education, 62, 41-49.
Yilmaz, R. M., Kucuk, S., & Goktas, Y. (2017). Are augmented reality picture books magic or real for preschool children aged five to six?. British Journal of Educational Technology, 48(3), 824-841.‏
Yuh, T. C., Lin, F. C. (2012). Integrating thematic strategy and modularity concept into interactive video-based learning system. Information Technology Journal, 11(8), 1103-1108.
‏‏‏‏ Zhang, A., & Cristol, D. (Eds.). (2019). Handbook of mobile teaching and learning. Springer.‏
Zainuddin, N. M. M., Zaman, H. B., & Ahmad, A. (2010, May). A participatory design in developing prototype an augmented reality book for deaf students. In 2010 Second International Conference on Computer Research and Development, 400-404. IEEE.‏
Zhang, D., Zhou, L., Briggs, R. O., & Nunamaker Jr, J. F. (2006). Instructional video in e learning: Assessing the impact of interactive video on learning effectiveness. Information & management, 43(1), 15-27.
Zichermann, G., & Cunningham, C. (2011). Gamification by design: Implementing game mechanics in web and mobile apps. O'Reilly Media, Inc.

Files

Share

How to cite

Statistics