Assessment of construct validity of the endoscopic sinus surgery simulator

Harman Arora, Jose Uribe, Walter Ralph, Michael Zeltsan, Hernando Cuellar, Anthony Gallagher, Marvin P. Fried

Research output: Contribution to journalArticle

65 Citations (Scopus)

Abstract

Objective: To study the relationship between performance on an endoscopic sinus surgery simulator (ES3) and fundamental perceptual, visuospatial, and psychomotor abilities. Design: Validation study. Setting: Tertiary care medical center. Participants: Thirty-four medical students and 4 otolaryngology residents voluntarily enrolled. Interventions: Subjects performed tasks on the ES3, minimally invasive surgical trainer virtual reality (MIST-VR), pictorial surface orientation (PicSOr), and 3 visuospatial tests (cube comparison, card rotation, and map planning). Main Outcome Measures: The MIST-VR was scored for time, task error, economy of hand movement, economy of diathermy, and total score. Scores were generated for the PicSOr task and visuospatial tests. Scores were correlated with time, accuracy, and total subscore on navigation, injection, and dissection tasks, as well as hazard score and total trial score on the ES3. Results: The PicSOr score was statistically significantly correlated with the hazard score on the ES3 (r=0.50, P<.001). Cube comparison (r=0.43, P<01) and card rotation (r=0.45, P<.01) scores correlated significantly with the ES3 trial score, as did the MIST-VR total score and the ES3 trial score (r=0.57, P<.001). In a multiple regression model, the PicSOr, cube comparison, and MIST-VR total scores were statistically significant predictors of ES3 performance (r=0.63, P<.01). Conclusions: Scores on the ES3 correlate strongly with scores on previously validated measures of perceptual, visuospatial, and psychomotor performance. The ES3 provides a reliable assessment of factors that are important to the acquisition of minimally invasive surgical skills, demonstrating construct validity.

Original languageEnglish (US)
Pages (from-to)217-221
Number of pages5
JournalArchives of Otolaryngology - Head and Neck Surgery
Volume131
Issue number3
DOIs
StatePublished - Mar 2005

Fingerprint

Psychomotor Performance
Diathermy
Aptitude
Validation Studies
Otolaryngology
Medical Students
Tertiary Care Centers
Dissection
Hand
Outcome Assessment (Health Care)
Injections

ASJC Scopus subject areas

  • Otorhinolaryngology

Cite this

Assessment of construct validity of the endoscopic sinus surgery simulator. / Arora, Harman; Uribe, Jose; Ralph, Walter; Zeltsan, Michael; Cuellar, Hernando; Gallagher, Anthony; Fried, Marvin P.

In: Archives of Otolaryngology - Head and Neck Surgery, Vol. 131, No. 3, 03.2005, p. 217-221.

Research output: Contribution to journalArticle

Arora, Harman ; Uribe, Jose ; Ralph, Walter ; Zeltsan, Michael ; Cuellar, Hernando ; Gallagher, Anthony ; Fried, Marvin P. / Assessment of construct validity of the endoscopic sinus surgery simulator. In: Archives of Otolaryngology - Head and Neck Surgery. 2005 ; Vol. 131, No. 3. pp. 217-221.
@article{d96d27cd770a4fe4b41d4877307d2655,
title = "Assessment of construct validity of the endoscopic sinus surgery simulator",
abstract = "Objective: To study the relationship between performance on an endoscopic sinus surgery simulator (ES3) and fundamental perceptual, visuospatial, and psychomotor abilities. Design: Validation study. Setting: Tertiary care medical center. Participants: Thirty-four medical students and 4 otolaryngology residents voluntarily enrolled. Interventions: Subjects performed tasks on the ES3, minimally invasive surgical trainer virtual reality (MIST-VR), pictorial surface orientation (PicSOr), and 3 visuospatial tests (cube comparison, card rotation, and map planning). Main Outcome Measures: The MIST-VR was scored for time, task error, economy of hand movement, economy of diathermy, and total score. Scores were generated for the PicSOr task and visuospatial tests. Scores were correlated with time, accuracy, and total subscore on navigation, injection, and dissection tasks, as well as hazard score and total trial score on the ES3. Results: The PicSOr score was statistically significantly correlated with the hazard score on the ES3 (r=0.50, P<.001). Cube comparison (r=0.43, P<01) and card rotation (r=0.45, P<.01) scores correlated significantly with the ES3 trial score, as did the MIST-VR total score and the ES3 trial score (r=0.57, P<.001). In a multiple regression model, the PicSOr, cube comparison, and MIST-VR total scores were statistically significant predictors of ES3 performance (r=0.63, P<.01). Conclusions: Scores on the ES3 correlate strongly with scores on previously validated measures of perceptual, visuospatial, and psychomotor performance. The ES3 provides a reliable assessment of factors that are important to the acquisition of minimally invasive surgical skills, demonstrating construct validity.",
author = "Harman Arora and Jose Uribe and Walter Ralph and Michael Zeltsan and Hernando Cuellar and Anthony Gallagher and Fried, {Marvin P.}",
year = "2005",
month = "3",
doi = "10.1001/archotol.131.3.217",
language = "English (US)",
volume = "131",
pages = "217--221",
journal = "Archives of Otolaryngology",
issn = "2168-6181",
publisher = "American Medical Association",
number = "3",

}

TY - JOUR

T1 - Assessment of construct validity of the endoscopic sinus surgery simulator

AU - Arora, Harman

AU - Uribe, Jose

AU - Ralph, Walter

AU - Zeltsan, Michael

AU - Cuellar, Hernando

AU - Gallagher, Anthony

AU - Fried, Marvin P.

PY - 2005/3

Y1 - 2005/3

N2 - Objective: To study the relationship between performance on an endoscopic sinus surgery simulator (ES3) and fundamental perceptual, visuospatial, and psychomotor abilities. Design: Validation study. Setting: Tertiary care medical center. Participants: Thirty-four medical students and 4 otolaryngology residents voluntarily enrolled. Interventions: Subjects performed tasks on the ES3, minimally invasive surgical trainer virtual reality (MIST-VR), pictorial surface orientation (PicSOr), and 3 visuospatial tests (cube comparison, card rotation, and map planning). Main Outcome Measures: The MIST-VR was scored for time, task error, economy of hand movement, economy of diathermy, and total score. Scores were generated for the PicSOr task and visuospatial tests. Scores were correlated with time, accuracy, and total subscore on navigation, injection, and dissection tasks, as well as hazard score and total trial score on the ES3. Results: The PicSOr score was statistically significantly correlated with the hazard score on the ES3 (r=0.50, P<.001). Cube comparison (r=0.43, P<01) and card rotation (r=0.45, P<.01) scores correlated significantly with the ES3 trial score, as did the MIST-VR total score and the ES3 trial score (r=0.57, P<.001). In a multiple regression model, the PicSOr, cube comparison, and MIST-VR total scores were statistically significant predictors of ES3 performance (r=0.63, P<.01). Conclusions: Scores on the ES3 correlate strongly with scores on previously validated measures of perceptual, visuospatial, and psychomotor performance. The ES3 provides a reliable assessment of factors that are important to the acquisition of minimally invasive surgical skills, demonstrating construct validity.

AB - Objective: To study the relationship between performance on an endoscopic sinus surgery simulator (ES3) and fundamental perceptual, visuospatial, and psychomotor abilities. Design: Validation study. Setting: Tertiary care medical center. Participants: Thirty-four medical students and 4 otolaryngology residents voluntarily enrolled. Interventions: Subjects performed tasks on the ES3, minimally invasive surgical trainer virtual reality (MIST-VR), pictorial surface orientation (PicSOr), and 3 visuospatial tests (cube comparison, card rotation, and map planning). Main Outcome Measures: The MIST-VR was scored for time, task error, economy of hand movement, economy of diathermy, and total score. Scores were generated for the PicSOr task and visuospatial tests. Scores were correlated with time, accuracy, and total subscore on navigation, injection, and dissection tasks, as well as hazard score and total trial score on the ES3. Results: The PicSOr score was statistically significantly correlated with the hazard score on the ES3 (r=0.50, P<.001). Cube comparison (r=0.43, P<01) and card rotation (r=0.45, P<.01) scores correlated significantly with the ES3 trial score, as did the MIST-VR total score and the ES3 trial score (r=0.57, P<.001). In a multiple regression model, the PicSOr, cube comparison, and MIST-VR total scores were statistically significant predictors of ES3 performance (r=0.63, P<.01). Conclusions: Scores on the ES3 correlate strongly with scores on previously validated measures of perceptual, visuospatial, and psychomotor performance. The ES3 provides a reliable assessment of factors that are important to the acquisition of minimally invasive surgical skills, demonstrating construct validity.

UR - http://www.scopus.com/inward/record.url?scp=14844299333&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=14844299333&partnerID=8YFLogxK

U2 - 10.1001/archotol.131.3.217

DO - 10.1001/archotol.131.3.217

M3 - Article

C2 - 15781761

AN - SCOPUS:14844299333

VL - 131

SP - 217

EP - 221

JO - Archives of Otolaryngology

JF - Archives of Otolaryngology

SN - 2168-6181

IS - 3

ER -