Article Gold Open Access 2025

Leveraging Algorithm Instruction with AI Chatbots: A Detailed Exploration of Their Impact on Students’ Computational Thinking

International Journal of Information and Education Technology
Journal · Vol. 15 · Issue 5 · pp. 891-901
Abstract

This research aims to understand the effect of algorithm instruction with artificial intelligence-based chatbots on students’ Computational Thinking (CT) skills. A quasi-experimental approach was employed, involving two groups: an experimental group where some students used conversational Artificial Intelligence (AI) bots as learning assistants and a control group where students used no such technology. The proposed research tools were the pre and post-tests and the questionnaires, which targeted users’ rating of the chatbot’s usefulness, user interface, and its influence on learning motivation. Analysis of the collected data was done using independent t-tests to compare the results between groups as well as correlation analysis to find the connection between AI chatbot utilization and students’ computational thinking skills. This study shows a positive increase in the overall CT skills of the experimental group compared to the control group. Instead, a positive relationship was found between the degree of the use of the chatbots and the students’ computational thinking performance. Accordingly, this research points to the inclusion of AI-based chatbots into algorithm instruction as a valuable approach to raising computational thinking disposition, learning motivation, and learning outcome. Therefore, the application of the value of AI technology indicates the possibility of transforming the implementation and teaching of an algorithm in higher education. © 2025 by the authors.

Keywords

Author Keywords

Computational thinking Algorithm Artificial Intelligence (AI)-based instruction chatbot

Index Keywords

Author Affiliations
Department of Electrical Engineering, Universitas Negeri Padang, Padang, West Sumatra, Indonesia
Department of Family Welfare Science, Universitas Negeri Padang, Padang, West Sumatra, Indonesia
Department of Electronics Engineering, Universitas Negeri Padang, Padang, West Sumatra, Indonesia
Universiti Tun Hussein Onn Malaysia, Batu Pahat, Johor, Malaysia
Funding & Acknowledgements
No funding information
References 10 References
1 Groothuijsen, Suzanne E.A., AI chatbots in programming education: Students’ use in a scientific computing course and consequences for learning, Computers and Education: Artificial Intelligence, 7, (2024)
2 Chen, Bodong, Integrating generative AI in knowledge building, Computers and Education: Artificial Intelligence, 5, (2023)
3 Parviz, Muhammed, AI in education: Comparative perspectives from STEM and Non-STEM instructors, Computers and Education Open, 6, (2024)
4 Tayan, Omar, Considerations for adapting higher education technology courses for AI large language models: A critical review of the impact of ChatGPT, Machine Learning with Applications, 15, (2024)
5 Computers in Human Behavior Artificial Humans, (2024)
6 Bucaioni, Alessio, Programming with ChatGPT: How far can we go?, Machine Learning with Applications, 15, (2024)
7 Chang, Yushang, Effects of design thinking on artificial intelligence learning and creativity, Educational Studies, 50, 5, pp. 763-780, (2024)
8 Walter, Yoshija, Embracing the future of Artificial Intelligence in the classroom: the relevance of AI literacy, prompt engineering, and critical thinking in modern education, International Journal of Educational Technology in Higher Education, 21, 1, (2024)
9 Lu, Jijian, Supporting Teachers' Professional Development With Generative AI: The Effects on Higher Order Thinking and Self-Efficacy, IEEE Transactions on Learning Technologies, 17, pp. 1279-1289, (2024)
10 Bolick, Alexis Danielle, Exploring Artificial Intelligence Tools and Their Potential Impact to Instructional Design Workflows and Organizational Systems, TechTrends, 68, 1, pp. 91-100, (2024)
Quick Actions
Full Text via DOI
Citation Metrics
0
Times Cited (Scopus)

References 10
Document Identifiers