Criterion-based (proficiency) training to improve surgical performance

Marvin P. Fried, Rachel J. Kaye, Marc J. Gibber, Alexis H. Jackman, Boris P. Paskhover, Babak Sadoughi, Bradley A. Schiff, Rebecca E. Fraioli, Joseph B. Jacobs

Research output: Contribution to journalArticle

11 Citations (Scopus)

Abstract

Objective: To investigate whether training otorhinolaryngology residents to criterion performance levels (proficiency) on the Endoscopic Sinus Surgery Simulator produces individuals whose performance in the operating room is at least equal to those who are trained by performing a fixed number of surgical procedures. Design: Prospective cohort. Setting: Two academic medical centers in New YorkCity. Participants: Otorhinolaryngology junior residents composed of 8 experimental subjects and 6 control subjects and 6 attending surgeons. Intervention: Experimental subjects achieved benchmark proficiency criteria on the Endoscopic Sinus Surgery Simulator; control subjects repeated the surgical procedure twice. Main Outcome Measures: Residents completed validated objective tests to assess baseline abilities. All subjects were videotaped performing an initial standardized surgical procedure. Residents were videotaped performing a final surgery. Videotapes were assessed for metrics by an expert panel. Results: Attendings outperformed the residents in most parameters on the initial procedure. Experimental and attending groups outperformed controls in some parameters on the final procedure. There was no difference between resident groups in initial performance, but the experimental subjects outperformed the control subjects in navigation in the final procedure. Most important, there was no difference in final performance between subgroups of the experimental group on the basis of the number of trials needed to attain proficiency. Conclusions: Simulator training can improve resident technical skills so that each individual attains a proficiency level, despite the existence of an intrinsic range of abilities. This proficiency level translates to at least equal, if not superior, operative performance compared with that of current conventional trainingwith finite repetition of live surgical procedures.

Original languageEnglish (US)
Pages (from-to)1024-1029
Number of pages6
JournalArchives of Otolaryngology - Head and Neck Surgery
Volume138
Issue number11
DOIs
StatePublished - Nov 2012

Fingerprint

Otolaryngology
Benchmarking
Videotape Recording
Operating Rooms
Outcome Assessment (Health Care)
Control Groups
Surgeons

ASJC Scopus subject areas

  • Otorhinolaryngology
  • Surgery

Cite this

Criterion-based (proficiency) training to improve surgical performance. / Fried, Marvin P.; Kaye, Rachel J.; Gibber, Marc J.; Jackman, Alexis H.; Paskhover, Boris P.; Sadoughi, Babak; Schiff, Bradley A.; Fraioli, Rebecca E.; Jacobs, Joseph B.

In: Archives of Otolaryngology - Head and Neck Surgery, Vol. 138, No. 11, 11.2012, p. 1024-1029.

Research output: Contribution to journalArticle

Fried, Marvin P. ; Kaye, Rachel J. ; Gibber, Marc J. ; Jackman, Alexis H. ; Paskhover, Boris P. ; Sadoughi, Babak ; Schiff, Bradley A. ; Fraioli, Rebecca E. ; Jacobs, Joseph B. / Criterion-based (proficiency) training to improve surgical performance. In: Archives of Otolaryngology - Head and Neck Surgery. 2012 ; Vol. 138, No. 11. pp. 1024-1029.
@article{41d4e5bad5194f9386fc6206457e0a04,
title = "Criterion-based (proficiency) training to improve surgical performance",
abstract = "Objective: To investigate whether training otorhinolaryngology residents to criterion performance levels (proficiency) on the Endoscopic Sinus Surgery Simulator produces individuals whose performance in the operating room is at least equal to those who are trained by performing a fixed number of surgical procedures. Design: Prospective cohort. Setting: Two academic medical centers in New YorkCity. Participants: Otorhinolaryngology junior residents composed of 8 experimental subjects and 6 control subjects and 6 attending surgeons. Intervention: Experimental subjects achieved benchmark proficiency criteria on the Endoscopic Sinus Surgery Simulator; control subjects repeated the surgical procedure twice. Main Outcome Measures: Residents completed validated objective tests to assess baseline abilities. All subjects were videotaped performing an initial standardized surgical procedure. Residents were videotaped performing a final surgery. Videotapes were assessed for metrics by an expert panel. Results: Attendings outperformed the residents in most parameters on the initial procedure. Experimental and attending groups outperformed controls in some parameters on the final procedure. There was no difference between resident groups in initial performance, but the experimental subjects outperformed the control subjects in navigation in the final procedure. Most important, there was no difference in final performance between subgroups of the experimental group on the basis of the number of trials needed to attain proficiency. Conclusions: Simulator training can improve resident technical skills so that each individual attains a proficiency level, despite the existence of an intrinsic range of abilities. This proficiency level translates to at least equal, if not superior, operative performance compared with that of current conventional trainingwith finite repetition of live surgical procedures.",
author = "Fried, {Marvin P.} and Kaye, {Rachel J.} and Gibber, {Marc J.} and Jackman, {Alexis H.} and Paskhover, {Boris P.} and Babak Sadoughi and Schiff, {Bradley A.} and Fraioli, {Rebecca E.} and Jacobs, {Joseph B.}",
year = "2012",
month = "11",
doi = "10.1001/2013.jamaoto.337",
language = "English (US)",
volume = "138",
pages = "1024--1029",
journal = "Archives of Otolaryngology",
issn = "2168-6181",
publisher = "American Medical Association",
number = "11",

}

TY - JOUR

T1 - Criterion-based (proficiency) training to improve surgical performance

AU - Fried, Marvin P.

AU - Kaye, Rachel J.

AU - Gibber, Marc J.

AU - Jackman, Alexis H.

AU - Paskhover, Boris P.

AU - Sadoughi, Babak

AU - Schiff, Bradley A.

AU - Fraioli, Rebecca E.

AU - Jacobs, Joseph B.

PY - 2012/11

Y1 - 2012/11

N2 - Objective: To investigate whether training otorhinolaryngology residents to criterion performance levels (proficiency) on the Endoscopic Sinus Surgery Simulator produces individuals whose performance in the operating room is at least equal to those who are trained by performing a fixed number of surgical procedures. Design: Prospective cohort. Setting: Two academic medical centers in New YorkCity. Participants: Otorhinolaryngology junior residents composed of 8 experimental subjects and 6 control subjects and 6 attending surgeons. Intervention: Experimental subjects achieved benchmark proficiency criteria on the Endoscopic Sinus Surgery Simulator; control subjects repeated the surgical procedure twice. Main Outcome Measures: Residents completed validated objective tests to assess baseline abilities. All subjects were videotaped performing an initial standardized surgical procedure. Residents were videotaped performing a final surgery. Videotapes were assessed for metrics by an expert panel. Results: Attendings outperformed the residents in most parameters on the initial procedure. Experimental and attending groups outperformed controls in some parameters on the final procedure. There was no difference between resident groups in initial performance, but the experimental subjects outperformed the control subjects in navigation in the final procedure. Most important, there was no difference in final performance between subgroups of the experimental group on the basis of the number of trials needed to attain proficiency. Conclusions: Simulator training can improve resident technical skills so that each individual attains a proficiency level, despite the existence of an intrinsic range of abilities. This proficiency level translates to at least equal, if not superior, operative performance compared with that of current conventional trainingwith finite repetition of live surgical procedures.

AB - Objective: To investigate whether training otorhinolaryngology residents to criterion performance levels (proficiency) on the Endoscopic Sinus Surgery Simulator produces individuals whose performance in the operating room is at least equal to those who are trained by performing a fixed number of surgical procedures. Design: Prospective cohort. Setting: Two academic medical centers in New YorkCity. Participants: Otorhinolaryngology junior residents composed of 8 experimental subjects and 6 control subjects and 6 attending surgeons. Intervention: Experimental subjects achieved benchmark proficiency criteria on the Endoscopic Sinus Surgery Simulator; control subjects repeated the surgical procedure twice. Main Outcome Measures: Residents completed validated objective tests to assess baseline abilities. All subjects were videotaped performing an initial standardized surgical procedure. Residents were videotaped performing a final surgery. Videotapes were assessed for metrics by an expert panel. Results: Attendings outperformed the residents in most parameters on the initial procedure. Experimental and attending groups outperformed controls in some parameters on the final procedure. There was no difference between resident groups in initial performance, but the experimental subjects outperformed the control subjects in navigation in the final procedure. Most important, there was no difference in final performance between subgroups of the experimental group on the basis of the number of trials needed to attain proficiency. Conclusions: Simulator training can improve resident technical skills so that each individual attains a proficiency level, despite the existence of an intrinsic range of abilities. This proficiency level translates to at least equal, if not superior, operative performance compared with that of current conventional trainingwith finite repetition of live surgical procedures.

UR - http://www.scopus.com/inward/record.url?scp=84869766236&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84869766236&partnerID=8YFLogxK

U2 - 10.1001/2013.jamaoto.337

DO - 10.1001/2013.jamaoto.337

M3 - Article

VL - 138

SP - 1024

EP - 1029

JO - Archives of Otolaryngology

JF - Archives of Otolaryngology

SN - 2168-6181

IS - 11

ER -