The Effect of Interaction in Electronic Tests Between The Order of The Questions (Graded / Randomly) and Display style (One Question on The Screen / The Whole Test on The Screen) on Achievement, Skill Performance, and Direction towards it, to Graduate Students in Qassim University

Document Type : Original Article

Author

Educational Technology - Faculty of Specific Education - Port Said University - Egypt - Consultant, Deanship of e-learning and distance education, Qassim University - Saudi Arabia - Chairman of the Egyptian Society for Computer Education

Abstract

Abstract:
The research aimed to develop the trend towards electronic tests according to a proposed model for building a question bank and electronic tests for graduate students, by identifying the impact of the order of questions (graded / randomly) and their pattern (one question or the whole test, on the screen). The research sample consisted of (16) PhD students in the Department of Educational Technology in the second semester 1441/1442 AH at the College of Education at the Qaseem University, decision of applications of technological innovations in the educational environment, and students were distributed in four experimental groups. The research tools were: a personal interview for students, an achievement test that aims to measure the cognitive aspect of the targeted skills, an electronic skill performance note card to track student performance in the shadow of the Corona pandemic, and a trend scale to identify students ’attitudes toward electronic tests. The results showed that there is a statistically significant difference at the level (0.05) between the average levels of students ’grades in the two experimental groups with regard to the direction in favor of arranging the graded questions. It also revealed that there are statistically significant differences at the level (0.05) between the averages of the grade levels of the students of the experimental groups, in the direction towards the electronic tests; For the benefit of the groups in which questions arise gradually. With regard to skill performance, the researcher assured that the results of the educational content were fully achieved, as the results were all positive, and showed that there were no statistically significant differences at the level (0.05), which confirmed the integrity of the educational content provided to students. The researcher recommends gradually arranging the questions in the electronic tests, as well as on the topics of content. Show all questions on one page. Questions are arranged randomly when students are in the same testing room. Questions display each question on a separate page, when students are together in the same classroom. And the option to undo the answer to a question and change the answer.

Keywords

Main Subjects


Andrew Hannan. (2007). Interviews in Education Research, Faculty of Education, University of Plymouth, United Kingdom. Available At: http://cecs6200.pbworks.com/w/file/fetch/69409200/UsingInterviewsinEducationResearch.pdf
Dane Linn. (2002). Using Electronic Assessment to Measure Student Performance, Education Policy Studies Division, National Governors Association (NGA) center for best practices, Suite 267, Washington, p1.
David, L. (2007). Behaviorism in Learning Theories, January 31, 2007, Retrieved from https://www.learning-theories.com/behaviorism.html.
David, L. (2015, (A)). Cognitivism in Learning Theories, June 19, 2015, Retrieved from https://www.learning-theories.com/cognitivism.html.
David, L. (2015, (B)). Constructivism in Learning Theories, June 20, 2015, Retrieved from https://www.learning-theories.com/constructivism.html.
David, L. (2017). Discovery Learning (Bruner) in Learning Theories, February 2, 2017, https://www.learning-theories.com/discovery-learning-bruner.html
Elgazzar, A.E. (2014) Developing E-Learning Environments for Field Practitioners and Developmental Researchers: A Third Revision of an ISD Model to Meet E-Learning and Distance Learning Innovations. Open Journal of Social Sciences, 2, 29-37. http://dx.doi.org/10.4236/jss.2014.22005
Elgazzar, A.E. (2014) Developing E-Learning Environments for Field Practitioners and Developmental Researchers: A Third Revision of an ISD Model to Meet E-Learning and Distance Learning Innovations. Open Journal of Social Sciences, 2, 29-37. http://dx.doi.org/10.4236/jss.2014.22005
Gullickson, A.R., & Howard, B.B. (2009). The Personnel Evaluation Standards: How to assess systems for evaluating educators (2nd ed.). Thousand Oaks, CA: Corwin Press.
Heinrich, Eva & Milne, John & Moore, Maurice. (2009). An Investigation into E-Tool Use for Formative Assignment Assessment - Status and Recommendations. Educational Technology & Society. 12. 176-192.
Joan L. Herman; Shari Golan. (1991). Effects of Standardized Testing on Teachers and Learning-Another Look, National Center for Research on Evaluation, Standards, and Student Testing (CRESST),UCLA Graduate School of Education. Available At:
https://cresst.org/wp-content/uploads/TECH334.pdf
Jönsson, A.; Mattheos, N.; Svingby, G; & Attström, R. (2007). Dynamic Assessment and the Interactive Examination, Educational Technology & Society, 10 (4), 17-27.
Klinger, D.A., McDivitt, P.R.,Howard, B.B., Munoz, M.A., Rogers, W.T., & Wylie, E.C. (2015). The Classroom Assessment Standards for PreK-12 Teachers. Kindle Direct Press.
L’hadi Bouzidi1 and Alain Jaillet. (2009). Can Online Peer Assessment be Trusted?, Educational Technology & Society, Vol. 12, Issue (4), 257-268. Available At: https://www.ds.unipi.gr/et&s/journals/12_4/22.pdf
Laumer, Sven; von Stetten, Alexander; and Eckhardt, Andreas (2009) E-Assessment, Business & Information Systems Engineering: Vol. 1: Iss. 3, 263-265. Available at: https://aisel.aisnet.org/bise/vol1/iss3/9
Moulton, Margaret R. and Holmes, Vicki L. (2003). The Research Paper: A Historical Perspective, Teaching English in the Two Year College 30(4).
Nicol, D. J., & Macfarlane-Dick, D. (2006). Formative assessment and self-regulated learning: A model and seven principles of good feedback practice, Studies in Higher Education, Vol 31,Issue (2), 199–218. Available At: http://www.psy.gla.ac.uk/~steve/rap/docs/nicol.feedback.pdf
Orsmond, P., Merry, S., and Reiling, K. (2005). Biology students’ utilization of tutor’s formative feedback: A qualitative interview study, Assessment & Evaluation in Higher Education, 30(4), 369–386. Available At: http://pdfserve.informaworld.com/354562__713724166.pdf
Yarbrough, D.B., Shula, L.M., Hopson, R.K., & Caruthers, F.A. (2010). The Program Evaluation Standards: A guide for evaluators and evaluation users (3rd. ed). Thousand Oaks, CA: Corwin Press.
Yu-Hui Tao, Yu-Lung Wu, & Hsin-Yi Chang. (2008). A Practical Computer Adaptive Testing Model for Small-Scale Scenarios. Journal of Educational Technology & Society, 11(3), 259-274. Retrieved May 1, 2020, from www.jstor.org/stable/jeductechsoci.11.3.259