From virtual reality to the operating room: The endoscopic sinus surgery simulator experiment

Marvin P. Fried, Babak Sadoughi, Marc J. Gibber, Joseph B. Jacobs, Richard A. Lebowitz, Douglas A. Ross, John P. Bent, Sanjay R. Parikh, Clarence T. Sasaki, Steven D. Schaefer

Research output: Contribution to journalArticle

77 Citations (Scopus)

Abstract

Objective: Establish the feasibility of a predictive validity study in sinus surgery simulation training and demonstrate the effectiveness of the Endoscopic Sinus Surgery Simulator (ES3) as a training device. Study Design: Prospective, multi-institutional controlled trial. Setting: Four tertiary academic centers with accredited otolaryngology-head and neck surgery residency programs. Subjects: Twelve ES3-trained novice residents were compared with 13 control novice residents. Methods: Subjects were assessed on the performance of basic sinus surgery tasks. Their first in vivo procedure was video recorded and submitted to a blinded panel of independent experts after the panel established a minimum inter-rater reliability of 80 percent. The recordings were reviewed by using a standardized computer-assisted method and customized metrics. Results were analyzed with the Mann-Whitney U test. Internal rater consistency was verified with Pearson moment correlation. Results: Completion time was significantly shorter in the experimental group (injection P = 0.003, dissection P < 0.001), which, according to the rater panel, also demonstrated higher confidence (P = 0.009), demonstrated skill during instrument manipulation (P = 0.011), and made fewer technical mistakes during the injection task (P = 0.048) compared with the control group. The raters' post hoc internal consistency was deemed adequate (r > 0.5 between serial measurements). Conclusion: The validity of the ES3 as an effective surgical trainer was verified in multiple instances, including those not depending on subjective rater evaluations. The ES3 is one of the few virtual reality simulators with a comprehensive validation record. Advanced simulation technologies need more rapid implementation in otolaryngology training, as they present noteworthy potential for high-quality surgical education while meeting the necessity of patient safety.

Original languageEnglish (US)
Pages (from-to)202-207
Number of pages6
JournalOtolaryngology - Head and Neck Surgery
Volume142
Issue number2
DOIs
StatePublished - Feb 2010

Fingerprint

Operating Rooms
Otolaryngology
Patient Safety
Internship and Residency
Nonparametric Statistics
Dissection
Neck
Head
Prospective Studies
Technology
Education
Equipment and Supplies
Injections

ASJC Scopus subject areas

  • Otorhinolaryngology
  • Surgery

Cite this

From virtual reality to the operating room : The endoscopic sinus surgery simulator experiment. / Fried, Marvin P.; Sadoughi, Babak; Gibber, Marc J.; Jacobs, Joseph B.; Lebowitz, Richard A.; Ross, Douglas A.; Bent, John P.; Parikh, Sanjay R.; Sasaki, Clarence T.; Schaefer, Steven D.

In: Otolaryngology - Head and Neck Surgery, Vol. 142, No. 2, 02.2010, p. 202-207.

Research output: Contribution to journalArticle

Fried, Marvin P. ; Sadoughi, Babak ; Gibber, Marc J. ; Jacobs, Joseph B. ; Lebowitz, Richard A. ; Ross, Douglas A. ; Bent, John P. ; Parikh, Sanjay R. ; Sasaki, Clarence T. ; Schaefer, Steven D. / From virtual reality to the operating room : The endoscopic sinus surgery simulator experiment. In: Otolaryngology - Head and Neck Surgery. 2010 ; Vol. 142, No. 2. pp. 202-207.
@article{da0ecc33002b4f56b2b76e73c833b4d4,
title = "From virtual reality to the operating room: The endoscopic sinus surgery simulator experiment",
abstract = "Objective: Establish the feasibility of a predictive validity study in sinus surgery simulation training and demonstrate the effectiveness of the Endoscopic Sinus Surgery Simulator (ES3) as a training device. Study Design: Prospective, multi-institutional controlled trial. Setting: Four tertiary academic centers with accredited otolaryngology-head and neck surgery residency programs. Subjects: Twelve ES3-trained novice residents were compared with 13 control novice residents. Methods: Subjects were assessed on the performance of basic sinus surgery tasks. Their first in vivo procedure was video recorded and submitted to a blinded panel of independent experts after the panel established a minimum inter-rater reliability of 80 percent. The recordings were reviewed by using a standardized computer-assisted method and customized metrics. Results were analyzed with the Mann-Whitney U test. Internal rater consistency was verified with Pearson moment correlation. Results: Completion time was significantly shorter in the experimental group (injection P = 0.003, dissection P < 0.001), which, according to the rater panel, also demonstrated higher confidence (P = 0.009), demonstrated skill during instrument manipulation (P = 0.011), and made fewer technical mistakes during the injection task (P = 0.048) compared with the control group. The raters' post hoc internal consistency was deemed adequate (r > 0.5 between serial measurements). Conclusion: The validity of the ES3 as an effective surgical trainer was verified in multiple instances, including those not depending on subjective rater evaluations. The ES3 is one of the few virtual reality simulators with a comprehensive validation record. Advanced simulation technologies need more rapid implementation in otolaryngology training, as they present noteworthy potential for high-quality surgical education while meeting the necessity of patient safety.",
author = "Fried, {Marvin P.} and Babak Sadoughi and Gibber, {Marc J.} and Jacobs, {Joseph B.} and Lebowitz, {Richard A.} and Ross, {Douglas A.} and Bent, {John P.} and Parikh, {Sanjay R.} and Sasaki, {Clarence T.} and Schaefer, {Steven D.}",
year = "2010",
month = "2",
doi = "10.1016/j.otohns.2009.11.023",
language = "English (US)",
volume = "142",
pages = "202--207",
journal = "Otolaryngology - Head and Neck Surgery (United States)",
issn = "0194-5998",
publisher = "Mosby Inc.",
number = "2",

}

TY - JOUR

T1 - From virtual reality to the operating room

T2 - The endoscopic sinus surgery simulator experiment

AU - Fried, Marvin P.

AU - Sadoughi, Babak

AU - Gibber, Marc J.

AU - Jacobs, Joseph B.

AU - Lebowitz, Richard A.

AU - Ross, Douglas A.

AU - Bent, John P.

AU - Parikh, Sanjay R.

AU - Sasaki, Clarence T.

AU - Schaefer, Steven D.

PY - 2010/2

Y1 - 2010/2

N2 - Objective: Establish the feasibility of a predictive validity study in sinus surgery simulation training and demonstrate the effectiveness of the Endoscopic Sinus Surgery Simulator (ES3) as a training device. Study Design: Prospective, multi-institutional controlled trial. Setting: Four tertiary academic centers with accredited otolaryngology-head and neck surgery residency programs. Subjects: Twelve ES3-trained novice residents were compared with 13 control novice residents. Methods: Subjects were assessed on the performance of basic sinus surgery tasks. Their first in vivo procedure was video recorded and submitted to a blinded panel of independent experts after the panel established a minimum inter-rater reliability of 80 percent. The recordings were reviewed by using a standardized computer-assisted method and customized metrics. Results were analyzed with the Mann-Whitney U test. Internal rater consistency was verified with Pearson moment correlation. Results: Completion time was significantly shorter in the experimental group (injection P = 0.003, dissection P < 0.001), which, according to the rater panel, also demonstrated higher confidence (P = 0.009), demonstrated skill during instrument manipulation (P = 0.011), and made fewer technical mistakes during the injection task (P = 0.048) compared with the control group. The raters' post hoc internal consistency was deemed adequate (r > 0.5 between serial measurements). Conclusion: The validity of the ES3 as an effective surgical trainer was verified in multiple instances, including those not depending on subjective rater evaluations. The ES3 is one of the few virtual reality simulators with a comprehensive validation record. Advanced simulation technologies need more rapid implementation in otolaryngology training, as they present noteworthy potential for high-quality surgical education while meeting the necessity of patient safety.

AB - Objective: Establish the feasibility of a predictive validity study in sinus surgery simulation training and demonstrate the effectiveness of the Endoscopic Sinus Surgery Simulator (ES3) as a training device. Study Design: Prospective, multi-institutional controlled trial. Setting: Four tertiary academic centers with accredited otolaryngology-head and neck surgery residency programs. Subjects: Twelve ES3-trained novice residents were compared with 13 control novice residents. Methods: Subjects were assessed on the performance of basic sinus surgery tasks. Their first in vivo procedure was video recorded and submitted to a blinded panel of independent experts after the panel established a minimum inter-rater reliability of 80 percent. The recordings were reviewed by using a standardized computer-assisted method and customized metrics. Results were analyzed with the Mann-Whitney U test. Internal rater consistency was verified with Pearson moment correlation. Results: Completion time was significantly shorter in the experimental group (injection P = 0.003, dissection P < 0.001), which, according to the rater panel, also demonstrated higher confidence (P = 0.009), demonstrated skill during instrument manipulation (P = 0.011), and made fewer technical mistakes during the injection task (P = 0.048) compared with the control group. The raters' post hoc internal consistency was deemed adequate (r > 0.5 between serial measurements). Conclusion: The validity of the ES3 as an effective surgical trainer was verified in multiple instances, including those not depending on subjective rater evaluations. The ES3 is one of the few virtual reality simulators with a comprehensive validation record. Advanced simulation technologies need more rapid implementation in otolaryngology training, as they present noteworthy potential for high-quality surgical education while meeting the necessity of patient safety.

UR - http://www.scopus.com/inward/record.url?scp=73949139199&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=73949139199&partnerID=8YFLogxK

U2 - 10.1016/j.otohns.2009.11.023

DO - 10.1016/j.otohns.2009.11.023

M3 - Article

C2 - 20115975

AN - SCOPUS:73949139199

VL - 142

SP - 202

EP - 207

JO - Otolaryngology - Head and Neck Surgery (United States)

JF - Otolaryngology - Head and Neck Surgery (United States)

SN - 0194-5998

IS - 2

ER -