The Impact of a Training Program Based on Hybrid Human- Artificial Intelligence (HHAI) Approach in Learning Assessment to Develop some Scientific Knowledge Management Skills, Digital Citizenship, and Attitudes Towards it among In -Service Science Teachers

Document Type : Original Article

Author

Faculty of Education, Benha university, Egypt

Abstract

The current research aimed to measure the impact of a training program based on Hybrid Human- Artificial Intelligence (HHAI) approach in learning assessment to develop some scientific knowledge management skills, digital citizenship, and attitudes towards it among in-service science teachers. The study used a one-group experimental design, pre- and post-measurement. The study group included (36) science teachers. The research used three scales: the scientific knowledge management scale, the digital citizenship scale, and attitudes towards employing artificial intelligence in evaluating science learning scale. The results found that there were statistically significant differences at the level (α = 0.05) between the average scores of science teachers in the scientific knowledge management scale, in the digital citizenship scale, and in attitudes towards employing artificial intelligence in evaluating science learning scale, for the benefit of the post-application, the results were discussed, recommendations and proposals were presented.

Keywords

Main Subjects


‏ Li, T., Reigh, E., He, P., & Adah Miller, E. (2023). Can we and should we use artificial intelligence for formative assessment in science? Journal of Research in Science Teaching.‏ 13(8), 1-5.https://doi.org/10.3991/ijet.v13i08
‏Adair, A., Dickler, R., & Gobert, J. (2020). Supporting teachers supporting students: evidence-based TIPS in a dashboard to guide inquiry scaffolding. Proceedings of the International Conference of the Learning Sciences, 1769-1770
Akata, Z., Balliet, D., de Rijke, M., Dignum, F., Dignum, V., Eiben (2020). A research agenda for hybrid intelligence: augmenting human intellect with collaborative, adaptive, responsible, and explainable artificial intelligence. Computer, 53, 18–28. doi: 10.1109/MC.2020.2996587
Al Darayseh, A. (2023). Acceptance of artificial intelligence in teaching science: Science teachers' perspective. Computers and Education: Artificial Intelligence, 4, 2-9
Alavi, M., & Kane, G. C. (2008). Social networks and information technology: Evolution and new frontiers. In I. Becerra Fernandez & D. Leidner (Eds.), Knowledge management: An evolutionary review, Advances in management information systems, 12, 63–85
AlKanaan, H. (2022). Awareness Regarding the Implication of Artificial Intelligence in Science Education among Pre-Service Science Teachers. International Journal of Instruction, 15(3), 895-912.‏
Alonso, L., Sallantin, J., Ferneda, E., & Luzeaux, D. (2011). Scientific Knowledge Management Anchored on Socio-environmental Systems.  Journal for a Global Sustainable Information Society, 9(2), 610-623
Arrazola, J., Ortega, C., & Zavala, J. (2015). Management of scientific knowledge through an intelligent system. Production and Operation Management Society, 1-8. https://www.pomsmeetings.org/ConfPapers/060/060-1375.pdf
Baker, R. (2016). Stupid tutoring systems, intelligent humans. International Journal of Artificial Intelligence in Education, 26, 600- 614.‏ doi: 10.1007/s40593-016-0105-0
Baker, T., & Smith, L. (2019). Exploring the future of artificial intelligence in schools and colleges. Nesta Foundation. https://www.nesta.org.uk/report/education-rebooted/
Baran, B., & Cagiltay, K. (2006). Knowledge management and online communities of practice in teacher education. Online Submission, 5(3), 1-8
Bernius, S. (2010). The impact of open access on the management of scientific knowledge. Online Information Review, 34(4), 583-603.‏
Bredeweg, B. & Kragten, M. (2022). Requirements and challenges for hybrid intelligence: A case-study in education. Frontiers in Artificial Intelligence, 5, 891630.‏
Capuno, R., Suson, R., Suladay, D., Arnaiz, V., Villarin, I., & Jungoy, E. (2022). Digital Citizenship in Education and Its Implication. World Journal on Educational Technology: Current Issues, 14(2), 426-437.‏
Chang, J., Park, J., & Na, J. (2020). The features of norms formed in mobile-based science problem-solving processes of pre-service teachers-from the perspective of digital citizenship. Journal of Korean Elementary Science Education, 39(1), 40-53.‏
Chen, L., Chen, P., & Lin, Z. (2020). Artificial intelligence in education: A review. Ieee Access, 8, 75264-75278.‏
Choi, M., Cristol, D., & Gimbert, B. (2018). Teachers as digital citizens: The influence of individual backgrounds, internet use and psychological characteristics on teachers’ levels of digital citizenship. Computers & Education, 121, 143-161.‏
Chou, C. Y., Huang, B. H., & Lin, C. J. (2011). Complementary machine intelligence and human intelligence in virtual teaching assistant for tutoring program tracing. Computers & Education, 57(4), 2303-2312.‏
Çiftci, S., & Aladag, S. (2018). An Investigation of Pre-Service Primary School Teachers' Attitudes towards Digital Technology and Digital Citizenship Levels in Terms of Some Variables. International Education Studies, 11(1), 111-118.‏
de Rezende, J. L., & de Souza, J. M. (2007, April). Using knowledge management techniques to improve the learning process through the exchange of knowledge chains. In 2007 11th International Conference on Computer Supported Cooperative Work in Design (681-686). IEEE.‏
de Souza, J. M., Cardoso, L. F., Sulaiman, A., & Oliveira, J. Bill of Experiments: A Tool for Scientific Knowledge Management.‏ https://2h.ae/JrOw
Dellermann, D., Calma, A., Lipusch, N., Weber, T., Weigel, S., & Ebel, P. (2021). The future of human-AI collaboration: a taxonomy of design knowledge for hybrid intelligence systems. arXiv preprint arXiv:2105.03354.‏
Durmus Çemçem, G., Korkmaz, Ö., & Cakir, R. (2023). Investigation of Pre-Service Teachers' Levels of Digital Citizenship, Digital Wisdom, and Digital Fluency. International Journal of Technology in Education, 6(3), 364-384.
Edwards, B. I., & Cheok, A. D. (2018). Why Not Robot Teachers: Artificial Intelligence for Addressing Teacher Shortage. Applied Artificial Intelligence, 32(4), 345–360.
Fell, E. (2022). Digital citizenship and artificial intelligence: Information and disinformation.‏ European Journal of Communication, 37(5) 563–568
Gerard, L., Kidron, A., & Linn, M. C. (2019). Guiding collaborative revision of science explanations. Inter Journal of Computer-Supported Collaborative Learning, 14, 1–34.
Heisig, P. (2009). Harmonisation of knowledge management–comparing 160 KM frameworks around the globe. Journal of knowledge management, 13(4), 4-31.
Holstein, K., Aleven, V., & Rummel, N. (2020). A conceptual framework for human–AI hybrid adaptivity in education. Artificial Intelligence in Education, 12163, 240–254. doi: 10.1007/978-3-030-52237-7_20
Holstein, K., McLaren, B. M., & Aleven, V. (2019). Designing for complementarity: teacher and student needs for orchestration support in AI-enhanced classrooms. Artificial Intelligence in Education, 11625, 157–171. doi: 10.1007/978-3-030-23204-7_14
Hopcan, S., Türkmen, G., & Polat, E. (2023). Exploring the artificial intelligence anxiety and machine learning attitudes of teacher candidates. Education and Information Technologies, 3(17), 1-21.‏
Huang, Z., & Yuan, L. (2024). Enhancing learning and exploratory search with concept semantics in online healthcare knowledge management systems: An interactive knowledge visualization approach. Expert Systems with Applications, 237, 121558.
International Conference on e-Learning and Knowledge Management Technology ICLKMT on December 13-14, 2023, in Cairo, Egypt. https://2u.pw/MwyvYr3
International Conference on Knowledge Management ICKM on January 21-22, 2024 in London, United Kingdom. https://2u.pw/Ptnb8cz
International Conference on Knowledge Management in Education and Research ICKMER on December 25-26, 2023, in Paris, France. https://2u.pw/7l7PuFP
Jaime, A., Gardoni, M., Mosca, J., & Vinck, D. (2005). BASIC Lab: a software tool for supporting the production of knowledge in research organizations through the management of scientific concepts. Journal of Knowledge Management, 9(6), 53-66.‏
Jain, N., & Singh, N. Text Mining Ability (2023). Pedagogical Decision Making and Knowledge Sharing Attitude as Indicators of Knowledge Management Skill of Prospective Teachers.‏ 125-132. https://ceur-ws.org/Vol-2145/p22.pdf
Jin, L. (2019). Investigation on potential application of artificial intelligence in preschool children’s education. Journal of Physics: Conference Series, 1288, Article 012072. https://doi.org/10.1088/1742-6596/1288/1/012072
Jing, T., & Nakamori, Y. (2005). Knowledge Management in Scientific Laboratories: A Survey-based Study of a Research Institute, Japan Advanced Institute of Science and Technology, 1-9.
Karumbaiah, S., Liu, P., Maksimova, A., De Vylder, L., Rummel, N., & Aleven, V. (2023). Multimodal Analytics for Collaborative Teacher Reflection of Human-AI Hybrid Teaching: Design Opportunities and Constraints. In European Conference on Technology Enhanced Learning (580-585). Cham: Springer Nature Switzerland.
Kelley, K., & Preacher, K. J. (2012). On effect size. Psychological methods, 17(2), 137.‏
Kennard, D. K., Rauscher, H. M., Flebbe, P. A., Schmoldt, D. L., Hubbard, W. G., Jordin, J. B., & Milnor, W. (2005). Using hyperdocuments to manage scientific knowledge: the prototype Encyclopedia of Southern Appalachian Forest Ecosystems. Forest Ecology and Management, 207(1-2), 201-213.‏
Khanlari, A, (2014). Teachers’ Perceptions of Using Robotics in Primary/Elementary Schools in Newfoundland and Labrador. Unpublished Master dissertation submitted to Memorial University of Newfoundland
Kim, M., & Choi, D. (2018). Development of youth digital citizenship scale and implication for educational setting. Journal of Educational Technology & Society, 21(1), 155-171.‏
Kim, N., & Kim, M. (2022). Teacher’s perceptions of using an artificial intelligence-based educational tool for scientific writing. Frontiers in Education, 7, 142-150. https://doi.org/ 10.3389/feduc.2022.755914
Kocoglu, E., Oguz-Hacat, S. & Gocer, V. (2023). The relationship between digital literacy and digital citizenship levels of STEM teacher candidates: The mediating role of digital teaching material development self-efficacy. Journal of Education in Science, Environment and Health (JESEH), 9(3), 194-205. https://doi.org/ 10.55549/jeseh.1331283
Kragten, M., Jaspar, E. J. O. A., & Bredeweg, B. (2022, July). Learning Domain Knowledge and Systems Thinking using Qualitative Representations in Secondary Education (grade 10-12). In International Conference on Artificial Intelligence (IJCAI’22)-35th International Workshop on Qualitative Reasoning.‏
Kulakovskii, N., Lebedeva, A., Skvortsov, V., Chistyakov, M., Gordashnik, K. Z., & Kolodnitskii, N. (2009). The integrated model of the Superhard Materials knowledge domain. Journal of Superhard Materials, 31, 354-355.‏
 Kuleto, V., Ilić, M. P., Bucea-Manea-Țoniş, R., Ciocodeică, D. F., Mihălcescu, H., & Mindrescu, V. (2022). The Attitudes of K–12 Schools’ Teachers in Serbia towards the Potential of Artificial Intelligence. Sustainability, 14(14), 8636-8645.‏
Kung, F. Y. H., Kwok, N., & Brown, D. J. (2018). Are attention check questions a threat to scale validity? Applied Psychology: An International Review, 67(2), 264–283. https://doi.org/10.1111/apps.12108
Lee, J., You, S. K., & Lee, Y. O. (2021). The effect of Middle School Science Instruction Applying Digital Citizenship Learning Model on Digital Citizenship and Empathy. Journal of Digital Convergence, 19(12), 91-102.‏
Lindsey, L. (2015). Preparing teacher candidates for 21st century classrooms: A study of digital citizenship. Arizona State University.‏ https://2h.ae/VlYz
Martins, V. W. B., Rampasso, I. S., Anholon, R., Quelhas, O. L. G., & Leal Filho, W. (2019). Knowledge management in the context of sustainability: Literature review and opportunities for future research. Journal of cleaner production, 229, 489-500.‏
Molenaar, I. (2022). The concept of hybrid human-AI regulation: Exemplifying how to support young learners’ self-regulated learning. Computers and Education: Artificial Intelligence, 3, 100070- 100081.‏
Murphy, R. F. (2019). Artificial intelligent applications to support k-12 teachers and teaching a review of promising applications, challenges and risks. https://www.rand.org/pubs/perspectives/PE315.html
Nonaka, I., & Toyama, R. (2003). The knowledge-creating theory revisited: knowledge creation as a synthesizing process. Knowledge management research & practice, 1(1), 2-10.‏
Nonaka, I., & Von Krogh, G. (2009). Perspective—Tacit knowledge and knowledge conversion: Controversy and advancement in organizational knowledge creation theory. Organization science, 20(3), 635-652.‏
Örtegren, A., & Velander, J. (2023). Artificial intelligence in Nordic K-12 education: implications of materials and resources for digital citizenship formation. In NERA Conference 2023, Oslo, Norway, March 15-17, 2023.‏
Öztürk, G. (2021). Digital citizenship and its teaching: A literature review. Journal of Educational Technology & Online Learning, 4(1), 31-45.
Paiva, R., & Bittencourt, I. I. (2020, June). Helping teachers help their students: A human-ai hybrid approach. In International conference on artificial intelligence in education (pp. 448-459). Cham: Springer International Publishing.‏
Panjaburee, P., Hwang, G. J., Intarakamhang, U., Srisawasdi, N., & Poompimol, S. (2022). Trends and Development of Artificial Intelligence in Game-based Learning from 2011 to 2022. Proceedings of the 30th International Conference on Computers in Education. Asia-Pacific Society for Computers in Education, 1-11‏ ‏
Prasetiyo, W. H., Naidu, N. B. M., Tan, B. P., & Sumardjoko, B. (2021). Digital Citizenship Trend in Educational Sphere: A Systematic Review. International Journal of Evaluation and Research in Education, 10(4), 1192-1201.‏
Prasetiyo, W. H., Sumardjoko, B., Muhibbin, A., Naidu, N. B. M., & Achmad, M. İ. (2023). Promoting digital citizenship among student-teachers: The role of project-based learning in improving appropriate online behaviors. Participatory Educational Research, 10(1), 389-407.‏
Raman, M., Ryan, T., & Olfman, L. (2005). Designing knowledge management systems for teaching and learning with wiki technology. Journal of information systems education, 16(3), 311.
Razuck, B., da Silva, A., Rodrigues, M., Cavalcante, V., Acar, D., Perrotta, P. R., & Wasserman, V. (2023). The implementation process of knowledge management at the Institute of Radiation Protection and Dosimetry: actions and perspectives. Brazilian Journal of Radiation Sciences, 11(3), 1-17.‏
Ribble, M. (2016). The Nine Elements of Digital Citizenship. Digital Citizenship in Schools, 3777, 15-44.‏ Schepman, A., & Rodway, P. (2020). Initial validation of the general attitudes towards Artificial Intelligence Scale. Computers in human behavior reports, 1, 100014-100021.
Ribble, M. 2015. Digital Citizenship in Schools: Nine Elements All Students Should Know (5th Ed.). Arlington, Virginia. ‏
Shi, L. (2023). Exploring the Emerging Roles of Artificial Intelligence in Teaching Practices and Its Relationships with Teachers , Doctoral dissertation, University of Georgia.‏ https://2h.ae/ZuCS
Sindermann, C., Sha, P., Zhou, M., Wernicke, J., Schmitt, H. S., Li, M., & Montag, C. (2021). Assessing the attitude towards artificial intelligence: Introduction of a short measure in German, Chinese, and English language. KI-Künstliche intelligenz, 35, 109-118.‏
Stevenson-Perez, H. C. (2009 April 2). Knowledge management portal for rapid learning and assessment of science. U.S. Patent Application No. 11/904,120. https://patents.google.com/patent/US20090089238
Stollenwerk, M. D. F. L. (2001). Knowledge Management: concepts and models. Organizational and Competitive Intelligence. Brasília, DF (Brazil) http://ndl.ethernet.edu.et/bitstream/123456789/33496/1/136.Ettore%20Bolisani.pdf#page=36
Swiecki, Z., Khosravi, H., Chen, G., Martinez-Maldonado, R., Lodge, J. M., Milligan, S., ... & Gašević, D. (2022). Assessment in the age of artificial intelligence. Computers and Education: Artificial Intelligence, 3, 100075-100082.‏
The International Artificial Intelligence in Education Society, 2023. https://iaied.org/
United Nations Educational, Scientific and Cultural Organization [UNESCO]. (2019). The challenge and opportunities of artificial intelligence in education. Paris, The United Nations Educational, Scientific and Cultural Organization.
‏Wilson, G. (2007). Knowledge, innovation and re-inventing technical assistance for development. Progress in Development Studies, 7(3), 183-199.
Yadrovskaia, M., Porksheyan, M., Petrova, A., Dudukalova, D., & Bulygin, Y. (2023). About the attitude towards artificial intelligence technologies. In E3S Web of Conferences, 376‏
Yuen, A. H., & Ma, W. W. (2004, December). Knowledge sharing and teacher acceptance of web-based learning system. In Beyond the comfort zone: Proceedings of the 21st ASCILITE Conference, 975-983).‏
Zhai, X., C Haudek, K., Shi, L., H Nehm, R., & Urban‐Lurain, M. (2020). From substitution to redefinition: A framework of machine learning‐based science assessment. Journal of Research in Science Teaching, 57(9), 1430-1459.
Zhao, L., Chen, L., Liu, Q., Zhang, M., & Copland, H. (2019). Artificial intelligence-based platform for online teaching management systems. Journal of Intelligent and Fuzzy Systems, 37(1), 45–51
Translation of Arabic References:
Ibrahim, N., & Suleiman, F. (2022). A proposed training program based on twenty-first century competencies and Egypt’s Education Vision 2030 to develop knowledge management skills and self-efficacy beliefs among student science teachers at the College of Education. Educational Journal of the Faculty of Education in Sohag, 100 (100), 51-133
Abu Ali, Z., & Qutaishat, H. (2019). The degree to which science teachers practice knowledge management processes in Jordanian schools from their point of view. Educational Journal of the Faculty of Education in Sohag, 66 (66), 221-244
Ahmed, S. (2021). The effectiveness of using cognitive trips via the web in teaching science to develop bioethical concepts, cognitive curiosity, and digital citizenship values among third-year middle school students. Journal of Scientific Research in Education, 22(3), 565-600
Ahmed, S., & Younis, I. (2020). A program prepared according to applications of artificial intelligence to develop twenty-first century skills and awareness of future roles among students at the College of Education. Journal of Scientific Research in Education, 21(13), 470-501
Ahmed, E. (2022). A training program based on artificial intelligence to develop self-learning skills and the trend towards participatory learning among chemistry teachers. Journal of the Faculty of Education in Assiut, 38 (3), 106-155
  Jad Al-Mawla, I. (2022). Using strategic learning to develop knowledge management skills, decision-making, and academic achievement in the integrated sciences course among student teachers at the College of Education. Journal of the College of Education in Benha, 33 (132), 109-190
Al-Hadidi, S., & Ibrahim, A. (2023). Building smart content in a learning environment based on artificial intelligence to develop laboratory panorama development skills and technological confidence among students of the science subjects at the College of Education. Journal of the College of Education in Beni Suef, 20 (116), 117-250
  Hamza, L., & Fanfon, D. (2019). Training requirements for middle school science teachers in managing knowledge processes in accordance with comprehensive quality standards from their point of view, Journal of Arts, Literature, Humanities and Social Sciences, 46, 234-243.
Al-Rikabi, A. (2023). The level of employing artificial intelligence applications when teaching physics for the secondary stage from the point of view of male and female teachers and their educational supervisors. Al-Saeed Journal of Humanities and Applied Sciences, 6 (3), 96-114
Al-Sharari, S. (2020). The extent to which science teachers practice knowledge management processes from their point of view in managing Qurayyat education. International Journal of Educational and Psychological Studies, 7(1), 71-188
Fadel, I.. (2023). A proposed electronic unit in the physics course to develop the concepts of artificial intelligence and anticipate the technological future among secondary school students. Egyptian Journal of Scientific Education, 26 (2), 88-133.
Mazen, H.. (2016). Revising science curricula and scientific education programs and engineering them electronically in light of the challenges of post-modernism and digital citizenship. The Eighteenth Scientific Conference: Science Curricula between Egyptian and International, Cairo, Sheikh Saleh Kamel Center - Al-Azhar University, 77 - 93
Mazen, H. (2019). Virtual society and artificial intelligence as an interactive information product for 21st century science teaching and learning via the dynamic web. The Twenty-first Scientific Conference: Scientific Education and Quality of Life, Cairo, Ain Shams University - Faculty of Education - Egyptian Society for Scientific Education, 93- 127
Mahmoud, I. (2023). A proposed training program based on the theory of successful intelligence to develop some scientific knowledge management skills among science teachers in the middle school. Journal of Reading and Cognition, 23(256), 15-50