A simple framework for assessing technical skills in a resident observed structured clinical examination (OSCE): Vaginal laceration repair

Abigail Ford Winkel, Veronica T. Lerner, Sondra R. Zabar, Demian Szyld

Research output: Contribution to journalReview article

4 Citations (Scopus)

Abstract

Objectives: Educators of trainees in procedure-based specialties need focused assessment tools that are valid, objective, and assess technical skills in a realistic context. A framework for hybrid assessment using standardized patient scenarios and bench skills testing might facilitate evaluation of competency. Methods: Seven PGY-1 obstetrics and gynecology residents participated in a hybrid assessment that used observed structured clinical examination (OSCE) by a standardized patient who had sustained a vaginal laceration during vaginal delivery. The residents elicited a history and counseled the patient, and then completed a laceration repair on a pelvic model. The residents were rated on their performance in the scenario, which included issues of cultural competency, rapport-building, patient counseling. The technical skills were videotaped and rated using a modified global assessment form by 2 faculty members on a 3-point scale from "not done" to "partly done" to "well-done." Residents also completed a subjective assessment of the station. Results: Mean technical performance of the residents on the technical skills was 55% "well-done," with a range of 20%-90%. The assessment identified 3 residents as below the mean, and 1 resident with areas of deficiency. Subjective assessment by the residents was that juggling the technical, cognitive, and affective components of the examination was challenging. Conclusions: Technical skills can be included in a case-based assessment using scenarios that address a range of cognitive and affective skills required of physicians. Results may help training programs assess individuals' abilities as well as identify program needs for curricular improvement. This framework might be useful in setting standards for competency and identifying poor performers.

Original languageEnglish (US)
Pages (from-to)10-14
Number of pages5
JournalJournal of Surgical Education
Volume70
Issue number1
DOIs
StatePublished - Jan 1 2013
Externally publishedYes

Fingerprint

Gynecological Examination
Lacerations
resident
examination
Cultural Competency
Aptitude
Needs Assessment
scenario
Gynecology
Obstetrics
Counseling
History
Physicians
Education
gynecology
obstetrics
trainee
performance
training program
counseling

Keywords

  • assessment
  • episiotomy
  • observed structured clinical examination
  • residency
  • technical skills
  • vaginal laceration repair

ASJC Scopus subject areas

  • Surgery
  • Education

Cite this

A simple framework for assessing technical skills in a resident observed structured clinical examination (OSCE) : Vaginal laceration repair. / Winkel, Abigail Ford; Lerner, Veronica T.; Zabar, Sondra R.; Szyld, Demian.

In: Journal of Surgical Education, Vol. 70, No. 1, 01.01.2013, p. 10-14.

Research output: Contribution to journalReview article

@article{6c5506ef5f604c16925ec92e3ff17344,
title = "A simple framework for assessing technical skills in a resident observed structured clinical examination (OSCE): Vaginal laceration repair",
abstract = "Objectives: Educators of trainees in procedure-based specialties need focused assessment tools that are valid, objective, and assess technical skills in a realistic context. A framework for hybrid assessment using standardized patient scenarios and bench skills testing might facilitate evaluation of competency. Methods: Seven PGY-1 obstetrics and gynecology residents participated in a hybrid assessment that used observed structured clinical examination (OSCE) by a standardized patient who had sustained a vaginal laceration during vaginal delivery. The residents elicited a history and counseled the patient, and then completed a laceration repair on a pelvic model. The residents were rated on their performance in the scenario, which included issues of cultural competency, rapport-building, patient counseling. The technical skills were videotaped and rated using a modified global assessment form by 2 faculty members on a 3-point scale from {"}not done{"} to {"}partly done{"} to {"}well-done.{"} Residents also completed a subjective assessment of the station. Results: Mean technical performance of the residents on the technical skills was 55{\%} {"}well-done,{"} with a range of 20{\%}-90{\%}. The assessment identified 3 residents as below the mean, and 1 resident with areas of deficiency. Subjective assessment by the residents was that juggling the technical, cognitive, and affective components of the examination was challenging. Conclusions: Technical skills can be included in a case-based assessment using scenarios that address a range of cognitive and affective skills required of physicians. Results may help training programs assess individuals' abilities as well as identify program needs for curricular improvement. This framework might be useful in setting standards for competency and identifying poor performers.",
keywords = "assessment, episiotomy, observed structured clinical examination, residency, technical skills, vaginal laceration repair",
author = "Winkel, {Abigail Ford} and Lerner, {Veronica T.} and Zabar, {Sondra R.} and Demian Szyld",
year = "2013",
month = "1",
day = "1",
doi = "10.1016/j.jsurg.2012.08.005",
language = "English (US)",
volume = "70",
pages = "10--14",
journal = "Journal of Surgical Education",
issn = "1931-7204",
publisher = "Elsevier Inc.",
number = "1",

}

TY - JOUR

T1 - A simple framework for assessing technical skills in a resident observed structured clinical examination (OSCE)

T2 - Vaginal laceration repair

AU - Winkel, Abigail Ford

AU - Lerner, Veronica T.

AU - Zabar, Sondra R.

AU - Szyld, Demian

PY - 2013/1/1

Y1 - 2013/1/1

N2 - Objectives: Educators of trainees in procedure-based specialties need focused assessment tools that are valid, objective, and assess technical skills in a realistic context. A framework for hybrid assessment using standardized patient scenarios and bench skills testing might facilitate evaluation of competency. Methods: Seven PGY-1 obstetrics and gynecology residents participated in a hybrid assessment that used observed structured clinical examination (OSCE) by a standardized patient who had sustained a vaginal laceration during vaginal delivery. The residents elicited a history and counseled the patient, and then completed a laceration repair on a pelvic model. The residents were rated on their performance in the scenario, which included issues of cultural competency, rapport-building, patient counseling. The technical skills were videotaped and rated using a modified global assessment form by 2 faculty members on a 3-point scale from "not done" to "partly done" to "well-done." Residents also completed a subjective assessment of the station. Results: Mean technical performance of the residents on the technical skills was 55% "well-done," with a range of 20%-90%. The assessment identified 3 residents as below the mean, and 1 resident with areas of deficiency. Subjective assessment by the residents was that juggling the technical, cognitive, and affective components of the examination was challenging. Conclusions: Technical skills can be included in a case-based assessment using scenarios that address a range of cognitive and affective skills required of physicians. Results may help training programs assess individuals' abilities as well as identify program needs for curricular improvement. This framework might be useful in setting standards for competency and identifying poor performers.

AB - Objectives: Educators of trainees in procedure-based specialties need focused assessment tools that are valid, objective, and assess technical skills in a realistic context. A framework for hybrid assessment using standardized patient scenarios and bench skills testing might facilitate evaluation of competency. Methods: Seven PGY-1 obstetrics and gynecology residents participated in a hybrid assessment that used observed structured clinical examination (OSCE) by a standardized patient who had sustained a vaginal laceration during vaginal delivery. The residents elicited a history and counseled the patient, and then completed a laceration repair on a pelvic model. The residents were rated on their performance in the scenario, which included issues of cultural competency, rapport-building, patient counseling. The technical skills were videotaped and rated using a modified global assessment form by 2 faculty members on a 3-point scale from "not done" to "partly done" to "well-done." Residents also completed a subjective assessment of the station. Results: Mean technical performance of the residents on the technical skills was 55% "well-done," with a range of 20%-90%. The assessment identified 3 residents as below the mean, and 1 resident with areas of deficiency. Subjective assessment by the residents was that juggling the technical, cognitive, and affective components of the examination was challenging. Conclusions: Technical skills can be included in a case-based assessment using scenarios that address a range of cognitive and affective skills required of physicians. Results may help training programs assess individuals' abilities as well as identify program needs for curricular improvement. This framework might be useful in setting standards for competency and identifying poor performers.

KW - assessment

KW - episiotomy

KW - observed structured clinical examination

KW - residency

KW - technical skills

KW - vaginal laceration repair

UR - http://www.scopus.com/inward/record.url?scp=84872807738&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84872807738&partnerID=8YFLogxK

U2 - 10.1016/j.jsurg.2012.08.005

DO - 10.1016/j.jsurg.2012.08.005

M3 - Review article

C2 - 23337664

AN - SCOPUS:84872807738

VL - 70

SP - 10

EP - 14

JO - Journal of Surgical Education

JF - Journal of Surgical Education

SN - 1931-7204

IS - 1

ER -