Teaching about substance abuse with objective structured clinical exams

Sharon J. Parish, Megha Ramaswamy, Melissa R. Stein, Elizabeth K. Kachur, Julia H. Arnsten

Research output: Contribution to journalArticle

39 Citations (Scopus)

Abstract

BACKGROUND: Although residents commonly manage substance abuse disorders, optimal approaches to teaching these specialized interviewing and intervention skills are unknown. OBJECTIVE: We developed a Substance Abuse Objective Structured Clinical Exam (OSCE) to teach addiction medicine competencies using immediate feedback. In this study we evaluated OSCE performance, examined associations between performance and self-assessed interest and competence in substance abuse, and assessed learning during the OSCE. DESIGN: Five-station OSCE, including different substance abuse disorders and readiness to change stages, administered during postgraduate year-3 ambulatory rotations for 2 years. PARTICIPANTS: One hundred and thirty-one internal and family medicine residents. MEASUREMENTS: Faculty and standardized patients (SPs) assessed residents' general communication, assessment, management, and global skills using 4-point scales. Residents completed a pre-OSCE survey of experience, interest and competence in substance abuse, and a post-OSCE survey evaluating its educational value. Learning during the OSCE was also assessed by measuring performance improvement from the first to the final OSCE station. RESULTS: Residents performed better (P<.001) in general communication (mean ± SD across stations=3.12 ± 0.35) than assessment (2.65 ± 0.32) or management (2.58 ± 0.44), and overall ratings were lowest in the contemplative alcohol abuse station (2.50 ± 0.83). Performance was not associated with residents' self-assessed interest or competence. Perceived educational value of the OSCE was high, and feedback improved subsequent performance. CONCLUSIONS: Although internal and family medicine residents require additional training in specialized substance abuse skills, immediate feedback provided during an OSCE helped teach needed skills for assessing and managing substance abuse disorders.

Original languageEnglish (US)
Pages (from-to)453-459
Number of pages7
JournalJournal of General Internal Medicine
Volume21
Issue number5
DOIs
StatePublished - 2006

Fingerprint

Substance-Related Disorders
Teaching
Mental Competency
Internal Medicine
Communication
Learning
Alcoholism
Medicine

Keywords

  • Alcoholism and addictive behaviors
  • Objective structured clinical exam (OSCE)
  • Residency evaluation
  • Standardized patients
  • Substance abuse

ASJC Scopus subject areas

  • Internal Medicine

Cite this

Teaching about substance abuse with objective structured clinical exams. / Parish, Sharon J.; Ramaswamy, Megha; Stein, Melissa R.; Kachur, Elizabeth K.; Arnsten, Julia H.

In: Journal of General Internal Medicine, Vol. 21, No. 5, 2006, p. 453-459.

Research output: Contribution to journalArticle

Parish, Sharon J. ; Ramaswamy, Megha ; Stein, Melissa R. ; Kachur, Elizabeth K. ; Arnsten, Julia H. / Teaching about substance abuse with objective structured clinical exams. In: Journal of General Internal Medicine. 2006 ; Vol. 21, No. 5. pp. 453-459.
@article{206fff9923b248dcba268822629bc469,
title = "Teaching about substance abuse with objective structured clinical exams",
abstract = "BACKGROUND: Although residents commonly manage substance abuse disorders, optimal approaches to teaching these specialized interviewing and intervention skills are unknown. OBJECTIVE: We developed a Substance Abuse Objective Structured Clinical Exam (OSCE) to teach addiction medicine competencies using immediate feedback. In this study we evaluated OSCE performance, examined associations between performance and self-assessed interest and competence in substance abuse, and assessed learning during the OSCE. DESIGN: Five-station OSCE, including different substance abuse disorders and readiness to change stages, administered during postgraduate year-3 ambulatory rotations for 2 years. PARTICIPANTS: One hundred and thirty-one internal and family medicine residents. MEASUREMENTS: Faculty and standardized patients (SPs) assessed residents' general communication, assessment, management, and global skills using 4-point scales. Residents completed a pre-OSCE survey of experience, interest and competence in substance abuse, and a post-OSCE survey evaluating its educational value. Learning during the OSCE was also assessed by measuring performance improvement from the first to the final OSCE station. RESULTS: Residents performed better (P<.001) in general communication (mean ± SD across stations=3.12 ± 0.35) than assessment (2.65 ± 0.32) or management (2.58 ± 0.44), and overall ratings were lowest in the contemplative alcohol abuse station (2.50 ± 0.83). Performance was not associated with residents' self-assessed interest or competence. Perceived educational value of the OSCE was high, and feedback improved subsequent performance. CONCLUSIONS: Although internal and family medicine residents require additional training in specialized substance abuse skills, immediate feedback provided during an OSCE helped teach needed skills for assessing and managing substance abuse disorders.",
keywords = "Alcoholism and addictive behaviors, Objective structured clinical exam (OSCE), Residency evaluation, Standardized patients, Substance abuse",
author = "Parish, {Sharon J.} and Megha Ramaswamy and Stein, {Melissa R.} and Kachur, {Elizabeth K.} and Arnsten, {Julia H.}",
year = "2006",
doi = "10.1111/j.1525-1497.2006.00426.x",
language = "English (US)",
volume = "21",
pages = "453--459",
journal = "Journal of General Internal Medicine",
issn = "0884-8734",
publisher = "Springer New York",
number = "5",

}

TY - JOUR

T1 - Teaching about substance abuse with objective structured clinical exams

AU - Parish, Sharon J.

AU - Ramaswamy, Megha

AU - Stein, Melissa R.

AU - Kachur, Elizabeth K.

AU - Arnsten, Julia H.

PY - 2006

Y1 - 2006

N2 - BACKGROUND: Although residents commonly manage substance abuse disorders, optimal approaches to teaching these specialized interviewing and intervention skills are unknown. OBJECTIVE: We developed a Substance Abuse Objective Structured Clinical Exam (OSCE) to teach addiction medicine competencies using immediate feedback. In this study we evaluated OSCE performance, examined associations between performance and self-assessed interest and competence in substance abuse, and assessed learning during the OSCE. DESIGN: Five-station OSCE, including different substance abuse disorders and readiness to change stages, administered during postgraduate year-3 ambulatory rotations for 2 years. PARTICIPANTS: One hundred and thirty-one internal and family medicine residents. MEASUREMENTS: Faculty and standardized patients (SPs) assessed residents' general communication, assessment, management, and global skills using 4-point scales. Residents completed a pre-OSCE survey of experience, interest and competence in substance abuse, and a post-OSCE survey evaluating its educational value. Learning during the OSCE was also assessed by measuring performance improvement from the first to the final OSCE station. RESULTS: Residents performed better (P<.001) in general communication (mean ± SD across stations=3.12 ± 0.35) than assessment (2.65 ± 0.32) or management (2.58 ± 0.44), and overall ratings were lowest in the contemplative alcohol abuse station (2.50 ± 0.83). Performance was not associated with residents' self-assessed interest or competence. Perceived educational value of the OSCE was high, and feedback improved subsequent performance. CONCLUSIONS: Although internal and family medicine residents require additional training in specialized substance abuse skills, immediate feedback provided during an OSCE helped teach needed skills for assessing and managing substance abuse disorders.

AB - BACKGROUND: Although residents commonly manage substance abuse disorders, optimal approaches to teaching these specialized interviewing and intervention skills are unknown. OBJECTIVE: We developed a Substance Abuse Objective Structured Clinical Exam (OSCE) to teach addiction medicine competencies using immediate feedback. In this study we evaluated OSCE performance, examined associations between performance and self-assessed interest and competence in substance abuse, and assessed learning during the OSCE. DESIGN: Five-station OSCE, including different substance abuse disorders and readiness to change stages, administered during postgraduate year-3 ambulatory rotations for 2 years. PARTICIPANTS: One hundred and thirty-one internal and family medicine residents. MEASUREMENTS: Faculty and standardized patients (SPs) assessed residents' general communication, assessment, management, and global skills using 4-point scales. Residents completed a pre-OSCE survey of experience, interest and competence in substance abuse, and a post-OSCE survey evaluating its educational value. Learning during the OSCE was also assessed by measuring performance improvement from the first to the final OSCE station. RESULTS: Residents performed better (P<.001) in general communication (mean ± SD across stations=3.12 ± 0.35) than assessment (2.65 ± 0.32) or management (2.58 ± 0.44), and overall ratings were lowest in the contemplative alcohol abuse station (2.50 ± 0.83). Performance was not associated with residents' self-assessed interest or competence. Perceived educational value of the OSCE was high, and feedback improved subsequent performance. CONCLUSIONS: Although internal and family medicine residents require additional training in specialized substance abuse skills, immediate feedback provided during an OSCE helped teach needed skills for assessing and managing substance abuse disorders.

KW - Alcoholism and addictive behaviors

KW - Objective structured clinical exam (OSCE)

KW - Residency evaluation

KW - Standardized patients

KW - Substance abuse

UR - http://www.scopus.com/inward/record.url?scp=33745676570&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33745676570&partnerID=8YFLogxK

U2 - 10.1111/j.1525-1497.2006.00426.x

DO - 10.1111/j.1525-1497.2006.00426.x

M3 - Article

C2 - 16704387

AN - SCOPUS:33745676570

VL - 21

SP - 453

EP - 459

JO - Journal of General Internal Medicine

JF - Journal of General Internal Medicine

SN - 0884-8734

IS - 5

ER -