Conference paper 2022

The Technology of the Learning Outcomes Test Development

Lecture Notes in Mechanical Engineering
Conference · pp. 687-696
Abstract

The paper presents the technology for developing a test of learning outcomes applied to engineering students. Considering the evidence, which reflected the practice of learning outcomes testing and tests development, the need to study the problem was revealed. There was a lack of scientifically based recommendations that allow designing valid and reliable assessment tools for the learning outcomes diagnostics under competency-based education. The finding of the current research was formed as a technology of the test development. The substantiated technology included four phases: organization and preparation, design and expertize reflection and diagnostics, and final technological phase. Each phase involved certain stages. The proposed diagnostic procedures made it possible to design valid tests that met the quality criteria in examining the level of learning outcomes for engineering students. When the test developer adheres strictly to the reasonable testing phases, they obtain an algorithm for creating a valid test item, which could be accumulated in a test database and then used to design tests. Following the technology stages, an educator/examiner/test developer could design, justify and evaluate the test item according to a scientific basis rather than their intuition. That enables objective and reliable results of student’s achievements testing. © 2022, The Author(s), under exclusive license to Springer Nature Switzerland AG.

Keywords

Author Keywords

Evaluation Assessment validity learning outcomes Test Engineering students Test items

Index Keywords

Learning systems Learning outcome Engineering education Students Evaluation validity Assessment Assessment tool Engineering student Testing Test Reliable assessment Test development Test item
Author Affiliations
Dmytro Motornyi Tavria State Agrotechnological University, Melitopol, Zaporizhia Oblast, Ukraine
Institute of Vocational Education of the National Academy of Educational Sciences of Ukraine, Kyiv, Ukraine
Funding & Acknowledgements
No funding information
References 10 References
1 Baird, Jo Anne, Assessment and learning: fields apart?, Assessment in Education: Principles, Policy and Practice, 24, 3, pp. 317-350, (2017)
2 Assessment of Student Achievement, (2018)
3 Spiel, Christiane, Challenges for Evaluation in Higher Education: Entrance Examinations and Beyond: The Sample Case of Medical Education, Methodology of Educational Measurement and Assessment, pp. 59-71, (2018)
4 Walstad, William B., The disaggregation of value-added test scores to assess learning outcomes in economics courses, Journal of Economic Education, 47, 2, pp. 121-131, (2016)
5 Sosnytska, Natalia, Examining the creative potential of engineering students, Modern Development Paths of Agricultural Production: Trends and Innovations, pp. 299-306, (2019)
6 Zlatkin-Troitschanskaia, Olga, Student learning in German higher education: Innovative measurement approaches and research results, Student Learning in German Higher Education: Innovative Measurement Approaches and Research Results, pp. 1-429, (2020)
7 Ercikan, Kadriye, Validation of Score Meaning for the Next Generation of Assessments: The Use of Response Processes, Validation of Score Meaning for the Next Generation of Assessments: The Use of Response Processes, pp. 1-156, (2017)
8 Butler, Andrew C., Repeated testing produces superior transfer of learning relative to repeated studying, Journal of Experimental Psychology: Learning Memory and Cognition, 36, 5, pp. 1118-1133, (2010)
9 International Journal of Active Learning, (2018)
10 Theory and Application of Digital Control, (2014)
Quick Actions
Full Text via DOI
Citation Metrics
7
Times Cited (Scopus)

References 10
Document Identifiers