Article Gold Open Access 2019

Large-scale studies of holistic professional competence in vocational education and training (VET). The case of Norway

International Journal for Research in Vocational Education and Training
Journal · Vol. 6 · Issue 2 · pp. 132-152
Abstract

Context: In this paper, we review and discuss the piloting in Norway of a German methodology for competence diagnostics in vocational education and training: the Competence Development and Assessment in TVET (COMET) project. Our overarching theme is determining to what extent such large-scale assessment systems are valid for international comparisons in this sector. Method: We present the theoretical underpinnings of the COMET model and position our discussion within the broader context of the concept of “professional competence” (berufliche Kompetenz) and methodological guidelines for its measurement. Terminology from psychometrics on “measurement equivalence” is described and serves as a template for identifying challenges in using the Norwegian data for comparative purposes. Our pilot included students and apprentices in health care, industrial mechanics and electricians and was designed as a three-year follow-up study from the second year of upper secondary school through two years of apprenticeship. Each year, a test on professional competence and a context survey were administered. Similar studies have been conducted in Germany, China and South Africa. Results: In line with the results from these countries, the Norwegian participants had low scores, particularly the electricians. However, the diagnostic instrument was sensitive to the development of professional competence, and progress on the assessment was influenced by the quality of the learning support in the companies, as reported by apprentices in the context survey. Conclusions: The COMET platform may be a viable prototype for the development of diagnostic tools, which may support the monitoring of quality factors at different levels and inspire local improvement projects in schools, companies and training offices. Such an objective would be in line with the latest summaries of the COMET project, in which its contribution to a model for international large-scale assessment is toned down and replaced by a stronger emphasis on its potential for measuring competence development, evaluating contextual factors and generating data for didactic innovations. © 2019 European Research Network Vocational Education and Training. All rights reserved.

Keywords

Author Keywords

VET vocational education and training Large-scale assessment Professional competence International measurement comparability

Index Keywords

Author Affiliations
Department of Vocational Teacher Education, OsloMet – StorbyUniversitetet, Oslo, Oslo, Norway
Funding & Acknowledgements
No funding information
References 10 References
1 Baartman, Liesbeth K.J., Evaluating assessment quality in competence-based education: A qualitative comparison of two frameworks, Educational Research Review, 2, 2, pp. 114-129, (2007)
2 Pisa Vet A Feasibility Study, (2006)
3 Feasibility Study Vet Lsa A Comparative Analysis of Occupational Profiles and Vet Programmes in Eight European Countries Internation Al Report, (2009)
4 Baumert, Jürgen, INTERNATIONAL COMPARISONS: STRENGTHS AND WEAKNESSES AND HOW TO OVERCOME THE WEAKNESSES, VET Boost: Towards a Theory of Professional Competencies: Essays in Honor of Frank Achtenhagen, pp. 25-37, (2009)
5 Integrating Analyses in Mixed Methods Research, (2018)
6 Beckett, David George, Holistic competence: Putting judgements first, Asia Pacific Education Review, 9, 1, pp. 21-30, (2008)
7 Benner, Patricia E., From novice to expert., The American journal of nursing, 82, 3, pp. 402-407, (1982)
8 Mensch Maschine Interaktion, (2001)
9 Enhancing Youth Employability What Why and how Guide to Core Work Skills, (2013)
10 Achieving Scientific Literacy from Purposes to Practices, (1997)
Quick Actions
Full Text via DOI
Citation Metrics
10
Times Cited (Scopus)

References 10
Document Identifiers