Article Gold Open Access 2025

Identifying Research Priorities in Digital Education for Health Care: Umbrella Review and Modified Delphi Method Study

Journal of Medical Internet Research
Journal · Vol. 27 · Art. e66157
Abstract

Background: In recent years, the use of digital technology in the education of health care professionals has surged, partly driven by the COVID-19 pandemic. However, there is still a need for focused research to establish evidence of its effectiveness. Objective: This study aimed to define the gaps in the evidence for the efficacy of digital education and to identify priority areas where future research has the potential to contribute to our understanding and use of digital education. Methods: We used a 2-stage approach to identify research priorities. First, an umbrella review of the recent literature (published between 2020 and 2023) was performed to identify and build on existing work. Second, expert consensus on the priority research questions was obtained using a modified Delphi method. Results: A total of 8857 potentially relevant papers were identified. Using the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) methodology, we included 217 papers for full review. All papers were either systematic reviews or meta-analyses. A total of 151 research recommendations were extracted from the 217 papers. These were analyzed, recategorized, and consolidated to create a final list of 63 questions. From these, a modified Delphi process with 42 experts was used to produce the top-five rated research priorities: (1) How do we measure the learning transfer from digital education into the clinical setting? (2) How can we optimize the use of artificial intelligence, machine learning, and deep learning to facilitate education and training? (3) What are the methodological requirements for high-quality rigorous studies assessing the outcomes of digital health education? (4) How does the design of digital education interventions (eg, format and modality) in health professionals’ education and training curriculum affect learning outcomes? and (5) How should learning outcomes in the field of health professions’ digital education be defined and standardized? Conclusions: This review provides a prioritized list of research gaps in digital education in health care, which will be of use to researchers, educators, education providers, and funding agencies. Additional proposals are discussed regarding the next steps needed to advance this agenda, aiming to promote meaningful and practical research on the use of digital technologies and drive excellence in health care education. ©Alison Potter, Chris Munsch, Elaine Watson, Emily Hopkins, Sofia Kitromili, Iain Cameron O'Neill, Judy Larbie, Essi Niittymaki, Catriona Ramsay, Joshua Burke, Neil Ralph.

Keywords

Author Keywords

Artificial intelligence umbrella review Digital Education AI Delphi health professions education research priorities

Index Keywords

human procedures Humans Article artificial intelligence curriculum coronavirus disease 2019 education COVID-19 Machine learning transfer of learning health practitioner medical profession health care personnel Health Personnel Deep learning Delphi study Delphi Technique Health education Surgery digital technology research distance learning Education, Distance consensus digital health health care research priority umbrella review
Author Affiliations
Technology Enhanced Learning, NHS England South (Wessex), Southampton, Southampton, United Kingdom
Technology Enhanced Learning, NHS England, Wakefield, West Yorkshire, United Kingdom
Technology Enhanced Learning, NHS England and Improvement, Oxford, United Kingdom
Library and Knowledge Services Development Manager, Manchester, Manchester, United Kingdom
Technology Enhanced Learning, NHS England & Improvement, Newcastle, United Kingdom
Manchester Foundation Trust, Manchester, Manchester, United Kingdom
Funding & Acknowledgements
No funding information
References 10 References
1 Vaicondam, Yamunah, Research Landscape of Digital Learning Over the Past 20 Years: A Bibliometric and Visualisation Analysis, International journal of online and biomedical engineering, 18, 8, pp. 4-22, (2022)
2 Sweileh, Waleed M., Global Research Activity on E-Learning in Health Sciences Education: a Bibliometric Analysis, Medical Science Educator, 31, 2, pp. 765-775, (2021)
3 Working for Health and Growth Investing in the Health Workforce, (2016)
4 United Nations General Assembly, (2015)
5 Nhs Long Term Workforce Plan, (2023)
6 Topol Review Preparing the Healthcare Workforce to Deliver the Digital Future, (2019)
7 Jia, Kan, Research Landscape of Artificial Intelligence and e-Learning: A Bibliometric Research, Frontiers in Psychology, 13, (2022)
8 Zhang, Pei, Global trends and future directions in online learning for medical students during and after the COVID-19 pandemic: A bibliometric and visualization analysis, Medicine (United States), 102, 50, (2023)
9 Martins, José Luís Bandeira, A bibliometric analysis and visualization of e-learning adoption using VOSviewer, Universal Access in the Information Society, 23, 3, pp. 1177-1191, (2024)
10 Fauzi, Muhammad Ashraf, E-learning in higher education institutions during COVID-19 pandemic: current and future trends through bibliometric analysis, Heliyon, 8, 5, (2022)
Quick Actions
Full Text via DOI
Citation Metrics
3
Times Cited (Scopus)

References 10
Document Identifiers