Journal article
Redesign of the System for Evaluation of Teaching Qualities in Anesthesiology Residency Training (SETQ Smart)
- Lombarts, Kiki M. J. M. H. From the Professional Performance Research Group, Center for Evidence-Based Education, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands (K.M.J.M.H.L.); Department of Anaesthesia and Intensive Care Medicine, Craigavon Area Hospital, Portadown, United Kingdom (A.F.); Department of Anesthesiology, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherland
- Ferguson, Andrew From the Professional Performance Research Group, Center for Evidence-Based Education, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands (K.M.J.M.H.L.); Department of Anaesthesia and Intensive Care Medicine, Craigavon Area Hospital, Portadown, United Kingdom (A.F.); Department of Anesthesiology, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherland
- Hollmann, Markus W. From the Professional Performance Research Group, Center for Evidence-Based Education, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands (K.M.J.M.H.L.); Department of Anaesthesia and Intensive Care Medicine, Craigavon Area Hospital, Portadown, United Kingdom (A.F.); Department of Anesthesiology, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherland
- Malling, Bente From the Professional Performance Research Group, Center for Evidence-Based Education, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands (K.M.J.M.H.L.); Department of Anaesthesia and Intensive Care Medicine, Craigavon Area Hospital, Portadown, United Kingdom (A.F.); Department of Anesthesiology, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherland
- Arah, Onyebuchi A. From the Professional Performance Research Group, Center for Evidence-Based Education, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands (K.M.J.M.H.L.); Department of Anaesthesia and Intensive Care Medicine, Craigavon Area Hospital, Portadown, United Kingdom (A.F.); Department of Anesthesiology, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherland
- Berger, M. M. Paracelsus Medical University, Salzburg, Austria
- van Gessel, E. European Union of Medical Specialists, Brussels, Switzerland
- Hoff, R. University Medical Center, Utrecht, The Netherlands
- Houweling, P. Diakonessen Hospital, Utrecht, The Netherlands
- Loer, S. Free University, Amsterdam, The Netherlands
- Padosch, S. A. Universitätsklinikum Köln, Köln, Germany
- Schramm, M. J. Universitätsklinikum Köln, Köln, Germany
- Schlack, W. S. Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands
- Steiner, L. A. University Hospital of Basel, Basel, Switzerland
- Stolker, R. J. Erasmus Medical Center, Rotterdam, The Netherlands
- Berger, M. M. Paracelsus Medical University, Salzburg, Austria
- van Gessel, E. European Union of Medical Specialists, Brussels, Switzerland
- Hoff, R. University Medical Center, Utrecht, The Netherlands
- Houweling, P. Diakonessen Hospital, Utrecht, The Netherlands
- Loer, S. Free University, Amsterdam, The Netherlands
- Padosch, S. A. Universitätsklinikum Köln, Köln, Germany
- Schramm, M. J. Universitätsklinikum Köln, Köln, Germany
- Schlack, W. S. Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands
- Steiner, L. A. University Hospital of Basel, Basel, Switzerland
- Stolker, R. J. Erasmus Medical Center, Rotterdam, The Netherlands
Published in:
- Anesthesiology. - Ovid Technologies (Wolters Kluwer Health). - 2016, vol. 125, no. 5, p. 1056-1065
English
Abstract
Background
Given the increasing international recognition of clinical teaching as a competency and regulation of residency training, evaluation of anesthesiology faculty teaching is needed. The System for Evaluating Teaching Qualities (SETQ) Smart questionnaires were developed for assessing teaching performance of faculty in residency training programs in different countries. This study investigated (1) the structure, (2) the psychometric qualities of the new tools, and (3) the number of residents’ evaluations needed per anesthesiology faculty to use the instruments reliably.
Methods
Two SETQ Smart questionnaires—for faculty self-evaluation and for resident evaluation of faculty—were developed. A multicenter survey was conducted among 399 anesthesiology faculty and 430 residents in six countries. Statistical analyses included exploratory factor analysis, reliability analysis using Cronbach α, item-total scale correlations, interscale correlations, comparison of composite scales to global ratings, and generalizability analysis to assess residents’ evaluations needed per faculty.
Results
In total, 240 residents completed 1,622 evaluations of 247 faculty. The SETQ Smart questionnaires revealed six teaching qualities consisting of 25 items. Cronbach α’s were very high (greater than 0.95) for the overall SETQ Smart questionnaires and high (greater than 0.80) for the separate teaching qualities. Interscale correlations were all within the acceptable range of moderate correlation. Overall, questionnaire and scale scores correlated moderately to highly with the global ratings. For reliable feedback to individual faculty, three to five resident evaluations are needed.
Conclusions
The first internationally piloted questionnaires for evaluating individual anesthesiology faculty teaching performance can be reliably, validly, and feasibly used for formative purposes in residency training.
- Language
-
- English
- Open access status
- closed
- Identifiers
-
- DOI 10.1097/aln.0000000000001341
- ISSN 0003-3022
- Persistent URL
- https://sonar.ch/global/documents/231945
Statistics
Document views: 25
File downloads: