TY - JOUR
T1 - Simulation-based ongoing professional practice evaluation in psychiatry
T2 - A novel tool for performance assessment
AU - Gorrindo, Tristan
AU - Goldfarb, Elizabeth
AU - Birnbaum, Robert J.
AU - Chevalier, Lydia
AU - Meller, Benjamin
AU - Alpert, Jonathan
AU - Herman, John
AU - Weiss, Anthony
PY - 2013/7
Y1 - 2013/7
N2 - Background: Ongoing professional practice evaluation (OPPE) activities consist of a quantitative, competencybased evaluation of clinical performance. Hospitals must design assessments that measure clinical competencies, are scalable, and minimize impact on the clinician's daily routines. A psychiatry department at a large academic medical center designed and implemented an interactive Web-based psychiatric simulation focusing on violence risk assessment as a tool for a departmentwide OPPE. Methods: Of 412 invited clinicians in a large psychiatry department, 410 completed an online simulation in April-May 2012. Participants received scheduled e-mail reminders with instructions describing how to access the simulation. Using the Computer Simulation Assessment Tool, participants viewed an introductory video and were then asked to conduct a risk assessment, acting as a clinician in the encounter by selecting actions from a series of drop-down menus. Each action was paired with a corresponding video segment of a clinical encounter with a standardized patient. Participants were scored on the basis of their actions within the simulation (Measure 1) and by their responses to the open-ended questions in which they were asked to integrate the information from the simulation in a summative manner (Measure 2). Results: Of the 410 clinicians, 381 (92.9%) passed Mea - sure 1, 359 (87.6%) passed Measure 2, and 5 (1.2%) failed both measures. Seventy-five (18.3%) participants were referred for focused professional practice evaluation (FPPE) after failing either Measure 1, Measure 2, or both. Conclusions: Overall, Web-based simulation and e-mail engagement tools were a scalable and efficient way to assess a large number of clinicians in OPPE and to identify those who required FPPE.
AB - Background: Ongoing professional practice evaluation (OPPE) activities consist of a quantitative, competencybased evaluation of clinical performance. Hospitals must design assessments that measure clinical competencies, are scalable, and minimize impact on the clinician's daily routines. A psychiatry department at a large academic medical center designed and implemented an interactive Web-based psychiatric simulation focusing on violence risk assessment as a tool for a departmentwide OPPE. Methods: Of 412 invited clinicians in a large psychiatry department, 410 completed an online simulation in April-May 2012. Participants received scheduled e-mail reminders with instructions describing how to access the simulation. Using the Computer Simulation Assessment Tool, participants viewed an introductory video and were then asked to conduct a risk assessment, acting as a clinician in the encounter by selecting actions from a series of drop-down menus. Each action was paired with a corresponding video segment of a clinical encounter with a standardized patient. Participants were scored on the basis of their actions within the simulation (Measure 1) and by their responses to the open-ended questions in which they were asked to integrate the information from the simulation in a summative manner (Measure 2). Results: Of the 410 clinicians, 381 (92.9%) passed Mea - sure 1, 359 (87.6%) passed Measure 2, and 5 (1.2%) failed both measures. Seventy-five (18.3%) participants were referred for focused professional practice evaluation (FPPE) after failing either Measure 1, Measure 2, or both. Conclusions: Overall, Web-based simulation and e-mail engagement tools were a scalable and efficient way to assess a large number of clinicians in OPPE and to identify those who required FPPE.
UR - http://www.scopus.com/inward/record.url?scp=84880564932&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84880564932&partnerID=8YFLogxK
U2 - 10.1016/s1553-7250(13)39045-x
DO - 10.1016/s1553-7250(13)39045-x
M3 - Article
C2 - 23888642
AN - SCOPUS:84880564932
SN - 1553-7250
VL - 39
SP - 319
EP - 323
JO - Joint Commission Journal on Quality and Patient Safety
JF - Joint Commission Journal on Quality and Patient Safety
IS - 7
ER -