Conference paper 2023

Central tendency effects using multi-facet Rasch measurement (MFRM) among raters in assessing teaching training

AIP Conference Proceedings
Conference · Vol. 2582 · Issue 1 · Art. 020023
Abstract

Teaching training assessment is a performance assessment that is difficult to measure and can be exposed to threats regarding the validity and reliability. The purpose of this study is to investigate the central tendency effect among raters towards group level and individual level in assessment. The central tendency occurs when the raters tend to overuse the middle categories of a rating scale when evaluating student performance. The instrument of this study is a teaching training assessment rubric that is assessed based on five assessment criteria which are planning, personality, implementation, portfolio, and reflection. The study is done quantitatively and data were collected from 170 teachers candidate that undergoing teaching practicum in peninsular Malaysia and 194 raters who had gave rate towards teachers candidate. Raters consists of two groups, the lecturers from UTHM and the teachers from Vocational College. Raters were sampled by using the purposive sampling technique. Data were analyzed using FACET program version 3.82.2. The central tendency effect is examined using several group-level indicators of central tendency that focus on the assessment of ratees which are the scale category, rater infit and outfit MNSQ and rating scale categories thresholds. Overall, the findings of the study analysis show that central tendency does not exist at the group-level but does exist at the individual-level. Therefore, this study gives a significant impact on the validity and reliability of performance appraisals to obtain valid and quality assessments. © 2023 Author(s).

Keywords

Author Keywords

student performance central tendency effects Multi-Facet Rasch Measurement (MFRM) Teaching training

Index Keywords

Author Affiliations
Faculty of Technical and Vocational Education, Universiti Tun Hussein Onn Malaysia, Batu Pahat, Johor, Malaysia
Funding & Acknowledgements
No funding information
References 10 References
1 Faculty of Education, (2017)
2 Teacher as A Researcher Kuala Lumpur, (2007)
3 Amin, Nor Fadila, The implementation of the internship as a coursework in teaching and learning vocational education, Journal of Technical Education and Training, 12, 1 Special Issue, pp. 82-90, (2020)
4 Lecturer S Supervision of Teacher Teaching Teacher Training During Teaching Practice, (2007)
5 Tasks and Criteria in Performance Assessment Proceedings of the 28th Language Testing Research Colloquium, (2009)
6 Introduction to Many Facet Rasch Measurement, (2011)
7 Engelhard, George, Invariant measurement: Using rasch models in the social, behavioral, and health sciences, Invariant Measurement: Using Rasch Models in the Social, Behavioral, and Health Sciences, pp. 1-288, (2013)
8 Pedagogy Strategy and Techniques Teaching Effectively, (2007)
9 Educational Measurement, (2006)
10 Winsteps Rasch Measurement Computer Program, (2004)
Quick Actions
Full Text via DOI
Citation Metrics
0
Times Cited (Scopus)

References 10
Document Identifiers