Article Gold Open Access 2025

Development and Validation of Adaptable Rubrics for Programming Assessments: Measuring Computational Competencies

Journal of Engineering Education Transformations
Journal · Vol. 39 · Issue 2 · pp. 142-153
Abstract

Advanced technological innovations and problem-solving across various domains demand proficient programming skills. Thus, developing and measuring computational competencies are critical in this modern digital era. Despite their significance, assessing these competencies is challenging, especially when catering to personalized learning needs. Several assessment methods are available, yet there is a lack of fast, adaptable and validated evaluation tools. This study addresses this gap by developing and validating adaptable rubrics for assessing computational competencies and fostering improved learning outcomes in the computer programming domain. The preliminary rubric was developed per the JAVA programming curricula, educational frameworks, and experts' opinions. A sample of 300 students studying the JAVA programming language were assessed via a multiple-response objective assessment based on the initial rubric. The rubric-based evaluation results were subjected to rigorous statistical analyses, including exploratory and confirmatory factor analyses, correlation, and regression analyses. The findings yielded a four-factor validated adapted rubric structure emphasizing the required computational competencies in the programming domain. Further, moderate associations between rubric scores and Java academic evaluations were revealed, highlighting the predictive validity of rubric-based objective assessments. This research work contributes to the refinement of rubric and assessment practices in programming education, offering insights into the role of adaptable rubrics in promoting student learning and suggesting pedagogical approaches. The findings of this study hold practical implications for educators, curriculum designers, and policymakers. The targeted interventions, adapting rubric-based assessment criteria, improving pedagogical strategies, and enriching curriculum design ensure that the learning experiences of programming learners are tailored to their individual needs and aspirations. © 2025, Rajarambapu Institute Of Technology. All rights reserved.

Keywords

Author Keywords

Adaptable Rubrics Computational Competencies Factor Analysis Programming Assessments

Index Keywords

Author Affiliations
Amity University, Noida, UP, India
Jaypee Institute of Information Technology, Noida, UP, India
University of Salford, Salford, Greater Manchester, United Kingdom
Funding & Acknowledgements
No funding information
References 10 References
1 Adler, Rachel F., Assessing computational thinking across a STEM curriculum for pre-service teachers, Education and Information Technologies, 28, 7, pp. 8051-8073, (2023)
2 Agbo, Friday Joseph, A systematic review of computational thinking approach for programming education in higher education institutions, ACM International Conference Proceeding Series, (2019)
3 da Cruz Alves, Nathalia, A large-scale evaluation of a rubric for the automatic assessment of algorithms and programming concepts, SIGCSE 2020 - Proceedings of the 51st ACM Technical Symposium on Computer Science Education, pp. 556-562, (2020)
4 International Journal of Computer Applications, (2013)
5 Ana, A., Assessment of student competence using electronic rubric, Journal of Engineering Science and Technology, 15, 6, pp. 3559-3570, (2020)
6 Ardito, Gerald P., Learning Computational Thinking Together: Effects of Gender Differences in Collaborative Middle School Robotics Program, TechTrends, 64, 3, pp. 373-387, (2020)
7 Chen, Aleda M.H., Development and validation of the self-care counseling rubric (SCCR) to assess student self-care counseling skills, Currents in Pharmacy Teaching and Learning, 11, 8, pp. 774-781, (2019)
8 Das, Bidyut, Multiple-choice question generation with auto-generated distractors for computer-assisted educational assessment, Multimedia Tools and Applications, 80, 21-23, pp. 31907-31925, (2021)
9 DeLuca, Christopher, Assessment literacy development: Identifying gaps in teacher Candidates' learning, Assessment in Education: Principles, Policy and Practice, 17, 4, pp. 419-438, (2010)
10 Denny, Paul C., On the fairness of multiple-variant multiple-choice examinations, SIGCSE 2019 - Proceedings of the 50th ACM Technical Symposium on Computer Science Education, pp. 462-468, (2019)
Quick Actions
Full Text via DOI
Citation Metrics
0
Times Cited (Scopus)

References 10
Document Identifiers