Article 2016

Residents’ narrative feedback on teaching performance of clinical teachers: Analysis of the content and phrasing of suggestions for improvement

Postgraduate Medical Journal
Journal · Vol. 92 · Issue 1085 · pp. 145-151
Abstract

Objectives High-quality teaching performance is important to ensure patient safety and encourage residents’ learning. This study aims to explore the content and phrasing of suggestions for improvement that residents provide to support excellent teaching performance of their supervisors. Methods From February 2010 to November 2011, 577 residents were invited to evaluate 501 teachers from both surgical and medical residency training programmes from 20 hospitals. Feedback was collected through a validated formative feedback system named System for Evaluation of Teaching Qualities. Two researchers independently coded the suggestions for improvement with literature-based coding schemes on (1) content and (2) linguistic characteristics. Besides these qualitative outcomes, descriptive statistics were calculated using SPSS. Results In total, 422 residents (73%) evaluated 488 teachers (97%), yielding 4184 evaluations. Of all teachers, 385 (79%) received suggestions for improvement focusing on teaching skills (TS), 390 (80%) on teaching attitude (TA) and 151 (31%) on personal characteristics. For 13%-47% of the suggestions for improvement, residents added (1) the location or situation where the observed TS or TA had taken place, (2) concrete examples of what teachers could do to improve or (3) (expected) effects of what the change in TS or TA would mean for residents. Conclusions Residents provide mainly relevant suggestions for improvement that mirror important aspects of teaching performance. However, these comments often lack specific phrasing limiting their value for performance improvement. Therefore, residents are recommended to increase the specificity of the suggestions for improvement. The paper provides directions to phrase narrative feedback. © 2016, BMJ Publishing Group. All rights reserved.

Keywords

Author Keywords

Not provided

Index Keywords

Feedback Teaching adult female human male medical education Humans Internship and Residency Article general practitioner physician medical school Physicians program evaluation Performance feedback system teacher health personnel attitude Attitude of Health Personnel resident internal medicine patient safety Statistics Faculty, Medical Netherlands health program standards attitude assessment
Author Affiliations
Professional Performance Research Group, Amsterdam UMC - University of Amsterdam, Amsterdam, Noord-Holland, Netherlands
Department of Health Sciences, Vrije Universiteit Amsterdam, Amsterdam, Noord-Holland, Netherlands
Professional Performance Research Group, Amsterdam UMC - University of Amsterdam, Amsterdam, Noord-Holland, Netherlands, Professional Performance Research Group, Universiteit van Amsterdam, Amsterdam, Noord-Holland, Netherlands
Funding & Acknowledgements
No funding information
References 10 References
1 Farnan, Jeanne Marie, A systematic review: The effect of clinical supervision on patient and residency education outcomes, Academic Medicine, 87, 4, pp. 428-442, (2012)
2 van der Leeuw, Renée M., A systematic review of the effects of residency training on patient outcomes, BMC Medicine, 10, (2012)
3 Lockyer, Jocelyn Margot, Feedback data sources that inform physician self-assessment, Medical Teacher, 33, 2, pp. e113-e120, (2011)
4 Sargeant, Joan M., Features of assessment learners use to make informed self-assessments of clinical performance, Medical Education, 45, 6, pp. 636-647, (2011)
5 Hattie, John Allan C., The power of feedback, Review of Educational Research, 77, 1, pp. 81-112, (2007)
6 Littlefield, John H., Improving resident performance assessment data: Numeric precision and narrative specificity, Academic Medicine, 80, 5, pp. 489-495, (2005)
7 Smither, James W., Are the characteristics of narrative comments related to improvement in multirater feedback ratings over time?, Journal of Applied Psychology, 89, 3, pp. 575-581, (2004)
8 Shute, Valerie J., Focus on formative feedback, Review of Educational Research, 78, 1, pp. 153-189, (2008)
9 Brutus, Stéphane, Words versus numbers: A theoretical exploration of giving and receiving narrative comments in performance appraisal, Human Resource Management Review, 20, 2, pp. 144-157, (2010)
10 Overeem, Karlijn, Three methods of multi-source feedback compared: A plea for narrative comments and coworkers' perspectives, Medical Teacher, 32, 2, pp. 141-147, (2010)
Quick Actions
Full Text via DOI
Citation Metrics
18
Times Cited (Scopus)

References 10
Document Identifiers