Article Gold Open Access 2025

Physics-Based Tool Usage Simulations in VR

Multimodal Technologies and Interaction
Journal · Vol. 9 · Issue 4 · Art. 29
Abstract

The need for scalable, immersive training systems is universal and recently has been included in fields that rely on complex, hands-on processes, such as surgery operations, assembly operations, construction processes training, etc. This paper examines the potential to support immersive training via digital tool manipulation in the domain of traditional handicrafts. The proposed methodology employs Finite Element Method simulations to compute material transformations and apply them to interactive virtual environments. The challenge is to accurately simulate human–tool interactions, which are critical to the acquisition of manual skills. Using Simulia Abaqus (v.2023HF2), crafting simulations are authored, executed, and exported as animation sequences. These are further refined in Blender (v3.6) and integrated into Unity to create reusable training components called Action Animators. Two software applications—Craft Studio (v1.0) and Apprentice Studio (v1.0)—are designed and implemented to enable instructors to create training lessons and students to practice and get evaluated in virtual environments. The methodology has wide-ranging applications beyond crafts, offering a solution for immersive training in skill-based activities. The validation and evaluation of the proposed approach suggest that it can significantly improve training effectiveness, scalability, and accessibility across various industries. © 2025 by the authors.

Keywords

Author Keywords

Vocational training Virtual reality finite element method physics-based simulations process simulation

Index Keywords

Author Affiliations
Institute of Computer Science, Heraklion, Crete, Greece
Histoire des Technosciences en Société, Conservatoire National des Arts et Metiers, Paris, Ile-de-France, France
CNRS Centre National de la Recherche Scientifique, Paris, Ile-de-France, France
Khora Virtual Reality, Copenhagen, Denmark
Centre Européen de Recherches et de Formation aux Arts Verriers (CERFAV), Vannes-le-Châtel, France
Institute of Computer Science, Heraklion, Crete, Greece, University of Crete, Rethymnon, Crete, Greece
Funding & Acknowledgements
Grant: 101094349
This work was implemented under the project Craeft, which received funding from the European Union\u2019s Horizon Europe research and innovation program under grant agreement No. 101094349.
References 10 References
1 Psotka, Joseph E., Immersive training systems: Virtual reality and education and training, Instructional Science, 23, 5-6, pp. 405-431, (1995)
2 Unnikrishnan, R., A systematic review of immersive virtual reality for industrial skills training, Behaviour and Information Technology, 40, 12, pp. 1310-1339, (2021)
3 Wang, Peng, A critical review of the use of virtual reality in construction engineering education and training, International Journal of Environmental Research and Public Health, 15, 6, (2018)
4 Luo, Heng, Virtual reality in K-12 and higher education: A systematic review of the literature from 2000 to 2019, Journal of Computer Assisted Learning, 37, 3, pp. 887-901, (2021)
5 Radu, Iulian Wande, Augmented reality in education: A meta-review and cross-media analysis, Personal and Ubiquitous Computing, 18, 6, pp. 1533-1543, (2014)
6 Eraut, Michael R., Knowledge Creation and Knowledge Use in Professional Contexts, Studies in Higher Education, 10, 2, pp. 117-133, (1985)
7 Mimetic Learning at Work Learning in the Circumstances of Practice, (2014)
8 State Indian Livelihood Rep, (2020)
9 Guidelines for the Establishment of National Living Human Treasures Systems
10 Convention for the Safeguarding of the Intangible Cultural Heritage, (2003)
Quick Actions
Full Text via DOI
Citation Metrics
5
Times Cited (Scopus)

References 10
Document Identifiers