Predicting aviation training performance with multimodal affective inferences

Abstract

Affect influences learning and training through various cognitive, psychomotor and motivational processes. This research aims to examine the role of affect in aviation training. Participants’ (N = 19) affect and performance were examined in simulated aviation training while they performed ten tasks. Affective states were inferred from electrodermal activity, facial expression and NASA Taskload Index. Performance accuracy was graded with the rubrics provided by pilot instructors in CAE Inc. We found that arousal (inferred from electrodermal activity) positively predicted performance in the level 2 (easy) task (F(1, 17) = 7.408, p < 0.05, std β = 0.55). Mental workload (as measured from self-report) negatively predicted performance in the level 3 (medium difficulty) (F(1, 15) = 4.598, p < 0.05, std β = −0.54) and level 4 (difficult) tasks (F(1, 15) = 12.85, p < 0.01, std β = −0.73), controlling for affect valence and arousal. This research is a preliminary step to a reconsideration of affect in theoretical frameworks in aviation. It demonstrates a comprehensive assessment of affect in aviation training, which could provide guidelines for instructional interventions to improve the overall training experience and pilot performance. © 2021 Brian Towers (BRITOW) and John Wiley & Sons Ltd

Keywords

Author Keywords

Not provided

Index Keywords

Author Affiliations

Department of Educational and Counselling Psychology, Université McGill, Montreal, QC, Canada

Funding & Acknowledgements

Concordia University, CU

Funding text 1: We acknowledge our team members? contribution in data collection, participant recruitment and in providing feedback and suggestions to this research. Our team members are: Dr Imene Jraidi, Dr Maher Chaouachi, Alejandra Ruiz Segura, Leo Holton, Kirsten Nynych, Shan Li, Lingyun Huang, Jenny Zheng and Dr Amanda Jarrell. We also acknowledge all collaborators in the InLook Project (CAE Inc.; Marinvent Inc.; GlobVision Inc., the Design Lab, Concordia University; National Research Council; the Faubert Lab, University of Montreal) which this study is part of. Special thanks are addressed to Alain Bourgon and Hugh Grenier (CAE Inc.) for proposing and configuring the X-plane environment and tasks, David Bowness (CAE Inc.) and Dr Yong Zeng (Concordia University) for their project management and leadership. This study is jointly funded by Natural Sciences and Engineering Research Council of Canada (514052-17), Consortium for Aerospace Research and Innovation in Canada (CARIC) and Quebec (CRIAQ) (OPR-1618).; Funding text 2: We acknowledge our team members\u2019 contribution in data collection, participant recruitment and in providing feedback and suggestions to this research. Our team members are: Dr Imene Jraidi, Dr Maher Chaouachi, Alejandra Ruiz Segura, Leo Holton, Kirsten Nynych, Shan Li, Lingyun Huang, Jenny Zheng and Dr Amanda Jarrell. We also acknowledge all collaborators in the InLook Project (CAE Inc.; Marinvent Inc.; GlobVision Inc., the Design Lab, Concordia University; National Research Council; the Faubert Lab, University of Montreal) which this study is part of. Special thanks are addressed to Alain Bourgon and Hugh Grenier (CAE Inc.) for proposing and configuring the X\u2010plane environment and tasks, David Bowness (CAE Inc.) and Dr Yong Zeng (Concordia University) for their project management and leadership. This study is jointly funded by Natural Sciences and Engineering Research Council of Canada (514052\u201017), Consortium for Aerospace Research and Innovation in Canada (CARIC) and Quebec (CRIAQ) (OPR\u20101618).

National Research Council, NRC

Funding text 1: We acknowledge our team members? contribution in data collection, participant recruitment and in providing feedback and suggestions to this research. Our team members are: Dr Imene Jraidi, Dr Maher Chaouachi, Alejandra Ruiz Segura, Leo Holton, Kirsten Nynych, Shan Li, Lingyun Huang, Jenny Zheng and Dr Amanda Jarrell. We also acknowledge all collaborators in the InLook Project (CAE Inc.; Marinvent Inc.; GlobVision Inc., the Design Lab, Concordia University; National Research Council; the Faubert Lab, University of Montreal) which this study is part of. Special thanks are addressed to Alain Bourgon and Hugh Grenier (CAE Inc.) for proposing and configuring the X-plane environment and tasks, David Bowness (CAE Inc.) and Dr Yong Zeng (Concordia University) for their project management and leadership. This study is jointly funded by Natural Sciences and Engineering Research Council of Canada (514052-17), Consortium for Aerospace Research and Innovation in Canada (CARIC) and Quebec (CRIAQ) (OPR-1618).; Funding text 2: We acknowledge our team members\u2019 contribution in data collection, participant recruitment and in providing feedback and suggestions to this research. Our team members are: Dr Imene Jraidi, Dr Maher Chaouachi, Alejandra Ruiz Segura, Leo Holton, Kirsten Nynych, Shan Li, Lingyun Huang, Jenny Zheng and Dr Amanda Jarrell. We also acknowledge all collaborators in the InLook Project (CAE Inc.; Marinvent Inc.; GlobVision Inc., the Design Lab, Concordia University; National Research Council; the Faubert Lab, University of Montreal) which this study is part of. Special thanks are addressed to Alain Bourgon and Hugh Grenier (CAE Inc.) for proposing and configuring the X\u2010plane environment and tasks, David Bowness (CAE Inc.) and Dr Yong Zeng (Concordia University) for their project management and leadership. This study is jointly funded by Natural Sciences and Engineering Research Council of Canada (514052\u201017), Consortium for Aerospace Research and Innovation in Canada (CARIC) and Quebec (CRIAQ) (OPR\u20101618).

Natural Sciences and Engineering Research Council of Canada, NSERC

Grant: 514052‐17

Funding text 1: We acknowledge our team members? contribution in data collection, participant recruitment and in providing feedback and suggestions to this research. Our team members are: Dr Imene Jraidi, Dr Maher Chaouachi, Alejandra Ruiz Segura, Leo Holton, Kirsten Nynych, Shan Li, Lingyun Huang, Jenny Zheng and Dr Amanda Jarrell. We also acknowledge all collaborators in the InLook Project (CAE Inc.; Marinvent Inc.; GlobVision Inc., the Design Lab, Concordia University; National Research Council; the Faubert Lab, University of Montreal) which this study is part of. Special thanks are addressed to Alain Bourgon and Hugh Grenier (CAE Inc.) for proposing and configuring the X-plane environment and tasks, David Bowness (CAE Inc.) and Dr Yong Zeng (Concordia University) for their project management and leadership. This study is jointly funded by Natural Sciences and Engineering Research Council of Canada (514052-17), Consortium for Aerospace Research and Innovation in Canada (CARIC) and Quebec (CRIAQ) (OPR-1618).; Funding text 2: We acknowledge our team members\u2019 contribution in data collection, participant recruitment and in providing feedback and suggestions to this research. Our team members are: Dr Imene Jraidi, Dr Maher Chaouachi, Alejandra Ruiz Segura, Leo Holton, Kirsten Nynych, Shan Li, Lingyun Huang, Jenny Zheng and Dr Amanda Jarrell. We also acknowledge all collaborators in the InLook Project (CAE Inc.; Marinvent Inc.; GlobVision Inc., the Design Lab, Concordia University; National Research Council; the Faubert Lab, University of Montreal) which this study is part of. Special thanks are addressed to Alain Bourgon and Hugh Grenier (CAE Inc.) for proposing and configuring the X\u2010plane environment and tasks, David Bowness (CAE Inc.) and Dr Yong Zeng (Concordia University) for their project management and leadership. This study is jointly funded by Natural Sciences and Engineering Research Council of Canada (514052\u201017), Consortium for Aerospace Research and Innovation in Canada (CARIC) and Quebec (CRIAQ) (OPR\u20101618).

Consortium de Recherche et d’innovation en Aérospatiale au Québec, CRIAQ

Grant: OPR‐1618

Funding text 1: We acknowledge our team members? contribution in data collection, participant recruitment and in providing feedback and suggestions to this research. Our team members are: Dr Imene Jraidi, Dr Maher Chaouachi, Alejandra Ruiz Segura, Leo Holton, Kirsten Nynych, Shan Li, Lingyun Huang, Jenny Zheng and Dr Amanda Jarrell. We also acknowledge all collaborators in the InLook Project (CAE Inc.; Marinvent Inc.; GlobVision Inc., the Design Lab, Concordia University; National Research Council; the Faubert Lab, University of Montreal) which this study is part of. Special thanks are addressed to Alain Bourgon and Hugh Grenier (CAE Inc.) for proposing and configuring the X-plane environment and tasks, David Bowness (CAE Inc.) and Dr Yong Zeng (Concordia University) for their project management and leadership. This study is jointly funded by Natural Sciences and Engineering Research Council of Canada (514052-17), Consortium for Aerospace Research and Innovation in Canada (CARIC) and Quebec (CRIAQ) (OPR-1618).; Funding text 2: We acknowledge our team members\u2019 contribution in data collection, participant recruitment and in providing feedback and suggestions to this research. Our team members are: Dr Imene Jraidi, Dr Maher Chaouachi, Alejandra Ruiz Segura, Leo Holton, Kirsten Nynych, Shan Li, Lingyun Huang, Jenny Zheng and Dr Amanda Jarrell. We also acknowledge all collaborators in the InLook Project (CAE Inc.; Marinvent Inc.; GlobVision Inc., the Design Lab, Concordia University; National Research Council; the Faubert Lab, University of Montreal) which this study is part of. Special thanks are addressed to Alain Bourgon and Hugh Grenier (CAE Inc.) for proposing and configuring the X\u2010plane environment and tasks, David Bowness (CAE Inc.) and Dr Yong Zeng (Concordia University) for their project management and leadership. This study is jointly funded by Natural Sciences and Engineering Research Council of Canada (514052\u201017), Consortium for Aerospace Research and Innovation in Canada (CARIC) and Quebec (CRIAQ) (OPR\u20101618).

References 10 References

1 Bakhtiar, Aishah, Regulation and socio-emotional interactions in a positive and a negative group climate, Metacognition and Learning, 13, 1, pp. 57-90, (2018)

2 Boucsein, Wolfram, Electrodermal activity: Second edition, Electrodermal Activity: Second Edition, 9781461411260, pp. 1-618, (2012)

3 Psychophysiology, (2013)

4 Bremer, Rainer, VET in the European aircraft and space industry, Journal of European Industrial Training, 32, 2-3, pp. 187-200, (2008)

5 Canadian Aircrew Forces Selection Testing Candidate Guide, (2015)

6 Cohn, Jeffrey F., Foundations of human computing: Facial expression and emotion, ICMI'06: 8th International Conference on Multimodal Interfaces, Conference Proceeding, pp. 233-238, (2006)

7 Journal of Educational Media, (2004)

8 D’Mello, Sidney K., Dynamics of affective states during complex learning, Learning and Instruction, 22, 2, pp. 145-157, (2012)

9 Proceedings of Measuring Behavior, (2005)

10 Dettmers, Swantje, Students' emotions during homework in mathematics: Testing a theoretical model of antecedents and achievement outcomes, Contemporary Educational Psychology, 36, 1, pp. 25-35, (2011)

Predicting aviation training performance with multimodal affective inferences

How to Cite