Comparison between simulation-based training and lecture-based education in teaching situation awareness

A randomized controlled study

Alfredo Lee Chang, Andrew A. Dym, Carla Venegas-Borsellino, Maneesha D. Bangar, Massoud Kazzi, Dmitry Lisenenkov, Nida Qadir, Adam B. Keene, Lewis Eisen

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Rationale: Situation awareness has been defined as the perception of the elements in the environment within volumes of time and space, the comprehension of their meaning, and the projection of their status in the near future. Intensivists often make time-sensitive critical decisions, and loss of situation awareness can lead to errors. It has been shown that simulation-based training is superior to lecture-based training for some critical scenarios. Because the methods of training to improve situation awareness have not been well studied in the medical field, we compared the impact of simulation vs. lecture training using the Situation Awareness Global Assessment Technique (SAGAT) score. Objectives: To identify an effective method for teaching situation awareness. Methods: We randomly assigned 17 critical care fellows to simulation vs. lecture training. Training consisted of eight cases on airway management, including topics such as elevated intracranial pressure, difficult airway, arrhythmia, and shock. During the testing scenario, at random times between 4 and 6 minutes into the simulation, the scenario was frozen, and the screens were blanked. Respondents then completed the 28 questions on the SAGAT scale. Sample items were categorized as Perception, Projection, and Comprehension of the situation. Results were analyzed using SPSS Version 21. Results: Eight fellows from the simulation group and nine from the lecture group underwent simulation testing. Sixty-four SAGAT scores were recorded for the simulation group and 48 scores were recorded for the lecture group. The mean simulation vs. lecture group SAGAT score was 64.3610.1 (SD) vs. 59.7610.8 (SD) (P = 0.02). There was also a difference in the median Perception ability between the simulation vs. lecture groups (61.1 vs. 55.5, P = 0.01). There was no difference in the median Projection and Comprehension scores between the two groups (50.0 vs. 50.0, P = 0.92, and 83.3 vs. 83.3, P = 0.27). Conclusions: We found a significant, albeit modest, difference between simulation training and lecture training on the total SAGAT score of situation awareness mainly because of the improvement in perception ability. Simulation may be a superior method of teaching situation awareness.

Original languageEnglish (US)
Pages (from-to)529-535
Number of pages7
JournalAnnals of the American Thoracic Society
Volume14
Issue number4
DOIs
StatePublished - Apr 1 2017

Fingerprint

Teaching
Education
Aptitude
Simulation Training
Airway Management
Intracranial Hypertension
Critical Care
Cardiac Arrhythmias
Shock

Keywords

  • Airway management
  • Intensive care
  • Lecture-based training
  • Simulation-based training
  • Situation awareness

ASJC Scopus subject areas

  • Medicine(all)
  • Pulmonary and Respiratory Medicine

Cite this

Comparison between simulation-based training and lecture-based education in teaching situation awareness : A randomized controlled study. / Chang, Alfredo Lee; Dym, Andrew A.; Venegas-Borsellino, Carla; Bangar, Maneesha D.; Kazzi, Massoud; Lisenenkov, Dmitry; Qadir, Nida; Keene, Adam B.; Eisen, Lewis.

In: Annals of the American Thoracic Society, Vol. 14, No. 4, 01.04.2017, p. 529-535.

Research output: Contribution to journalArticle

Chang, Alfredo Lee ; Dym, Andrew A. ; Venegas-Borsellino, Carla ; Bangar, Maneesha D. ; Kazzi, Massoud ; Lisenenkov, Dmitry ; Qadir, Nida ; Keene, Adam B. ; Eisen, Lewis. / Comparison between simulation-based training and lecture-based education in teaching situation awareness : A randomized controlled study. In: Annals of the American Thoracic Society. 2017 ; Vol. 14, No. 4. pp. 529-535.
@article{8486f7ec31024ce8b843c1a4fceb4151,
title = "Comparison between simulation-based training and lecture-based education in teaching situation awareness: A randomized controlled study",
abstract = "Rationale: Situation awareness has been defined as the perception of the elements in the environment within volumes of time and space, the comprehension of their meaning, and the projection of their status in the near future. Intensivists often make time-sensitive critical decisions, and loss of situation awareness can lead to errors. It has been shown that simulation-based training is superior to lecture-based training for some critical scenarios. Because the methods of training to improve situation awareness have not been well studied in the medical field, we compared the impact of simulation vs. lecture training using the Situation Awareness Global Assessment Technique (SAGAT) score. Objectives: To identify an effective method for teaching situation awareness. Methods: We randomly assigned 17 critical care fellows to simulation vs. lecture training. Training consisted of eight cases on airway management, including topics such as elevated intracranial pressure, difficult airway, arrhythmia, and shock. During the testing scenario, at random times between 4 and 6 minutes into the simulation, the scenario was frozen, and the screens were blanked. Respondents then completed the 28 questions on the SAGAT scale. Sample items were categorized as Perception, Projection, and Comprehension of the situation. Results were analyzed using SPSS Version 21. Results: Eight fellows from the simulation group and nine from the lecture group underwent simulation testing. Sixty-four SAGAT scores were recorded for the simulation group and 48 scores were recorded for the lecture group. The mean simulation vs. lecture group SAGAT score was 64.3610.1 (SD) vs. 59.7610.8 (SD) (P = 0.02). There was also a difference in the median Perception ability between the simulation vs. lecture groups (61.1 vs. 55.5, P = 0.01). There was no difference in the median Projection and Comprehension scores between the two groups (50.0 vs. 50.0, P = 0.92, and 83.3 vs. 83.3, P = 0.27). Conclusions: We found a significant, albeit modest, difference between simulation training and lecture training on the total SAGAT score of situation awareness mainly because of the improvement in perception ability. Simulation may be a superior method of teaching situation awareness.",
keywords = "Airway management, Intensive care, Lecture-based training, Simulation-based training, Situation awareness",
author = "Chang, {Alfredo Lee} and Dym, {Andrew A.} and Carla Venegas-Borsellino and Bangar, {Maneesha D.} and Massoud Kazzi and Dmitry Lisenenkov and Nida Qadir and Keene, {Adam B.} and Lewis Eisen",
year = "2017",
month = "4",
day = "1",
doi = "10.1513/AnnalsATS.201612-950OC",
language = "English (US)",
volume = "14",
pages = "529--535",
journal = "Annals of the American Thoracic Society",
issn = "2325-6621",
publisher = "American Thoracic Society",
number = "4",

}

TY - JOUR

T1 - Comparison between simulation-based training and lecture-based education in teaching situation awareness

T2 - A randomized controlled study

AU - Chang, Alfredo Lee

AU - Dym, Andrew A.

AU - Venegas-Borsellino, Carla

AU - Bangar, Maneesha D.

AU - Kazzi, Massoud

AU - Lisenenkov, Dmitry

AU - Qadir, Nida

AU - Keene, Adam B.

AU - Eisen, Lewis

PY - 2017/4/1

Y1 - 2017/4/1

N2 - Rationale: Situation awareness has been defined as the perception of the elements in the environment within volumes of time and space, the comprehension of their meaning, and the projection of their status in the near future. Intensivists often make time-sensitive critical decisions, and loss of situation awareness can lead to errors. It has been shown that simulation-based training is superior to lecture-based training for some critical scenarios. Because the methods of training to improve situation awareness have not been well studied in the medical field, we compared the impact of simulation vs. lecture training using the Situation Awareness Global Assessment Technique (SAGAT) score. Objectives: To identify an effective method for teaching situation awareness. Methods: We randomly assigned 17 critical care fellows to simulation vs. lecture training. Training consisted of eight cases on airway management, including topics such as elevated intracranial pressure, difficult airway, arrhythmia, and shock. During the testing scenario, at random times between 4 and 6 minutes into the simulation, the scenario was frozen, and the screens were blanked. Respondents then completed the 28 questions on the SAGAT scale. Sample items were categorized as Perception, Projection, and Comprehension of the situation. Results were analyzed using SPSS Version 21. Results: Eight fellows from the simulation group and nine from the lecture group underwent simulation testing. Sixty-four SAGAT scores were recorded for the simulation group and 48 scores were recorded for the lecture group. The mean simulation vs. lecture group SAGAT score was 64.3610.1 (SD) vs. 59.7610.8 (SD) (P = 0.02). There was also a difference in the median Perception ability between the simulation vs. lecture groups (61.1 vs. 55.5, P = 0.01). There was no difference in the median Projection and Comprehension scores between the two groups (50.0 vs. 50.0, P = 0.92, and 83.3 vs. 83.3, P = 0.27). Conclusions: We found a significant, albeit modest, difference between simulation training and lecture training on the total SAGAT score of situation awareness mainly because of the improvement in perception ability. Simulation may be a superior method of teaching situation awareness.

AB - Rationale: Situation awareness has been defined as the perception of the elements in the environment within volumes of time and space, the comprehension of their meaning, and the projection of their status in the near future. Intensivists often make time-sensitive critical decisions, and loss of situation awareness can lead to errors. It has been shown that simulation-based training is superior to lecture-based training for some critical scenarios. Because the methods of training to improve situation awareness have not been well studied in the medical field, we compared the impact of simulation vs. lecture training using the Situation Awareness Global Assessment Technique (SAGAT) score. Objectives: To identify an effective method for teaching situation awareness. Methods: We randomly assigned 17 critical care fellows to simulation vs. lecture training. Training consisted of eight cases on airway management, including topics such as elevated intracranial pressure, difficult airway, arrhythmia, and shock. During the testing scenario, at random times between 4 and 6 minutes into the simulation, the scenario was frozen, and the screens were blanked. Respondents then completed the 28 questions on the SAGAT scale. Sample items were categorized as Perception, Projection, and Comprehension of the situation. Results were analyzed using SPSS Version 21. Results: Eight fellows from the simulation group and nine from the lecture group underwent simulation testing. Sixty-four SAGAT scores were recorded for the simulation group and 48 scores were recorded for the lecture group. The mean simulation vs. lecture group SAGAT score was 64.3610.1 (SD) vs. 59.7610.8 (SD) (P = 0.02). There was also a difference in the median Perception ability between the simulation vs. lecture groups (61.1 vs. 55.5, P = 0.01). There was no difference in the median Projection and Comprehension scores between the two groups (50.0 vs. 50.0, P = 0.92, and 83.3 vs. 83.3, P = 0.27). Conclusions: We found a significant, albeit modest, difference between simulation training and lecture training on the total SAGAT score of situation awareness mainly because of the improvement in perception ability. Simulation may be a superior method of teaching situation awareness.

KW - Airway management

KW - Intensive care

KW - Lecture-based training

KW - Simulation-based training

KW - Situation awareness

UR - http://www.scopus.com/inward/record.url?scp=85017279075&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85017279075&partnerID=8YFLogxK

U2 - 10.1513/AnnalsATS.201612-950OC

DO - 10.1513/AnnalsATS.201612-950OC

M3 - Article

VL - 14

SP - 529

EP - 535

JO - Annals of the American Thoracic Society

JF - Annals of the American Thoracic Society

SN - 2325-6621

IS - 4

ER -