Mixed Reality with HoloLens: Where Virtual Reality Meets Augmented Reality in the Operating Room

Oren M. Tepper, Hayeem L. Rudy, Aaron Lefkowitz, Katie A. Weimer, Shelby M. Marks, Carrie S. Stern, Evan S. Garfein

Research output: Contribution to journalArticle

30 Citations (Scopus)

Abstract

Virtual reality and augmented reality devices have recently been described in the surgical literature. The authors have previously explored various iterations of these devices, and although they show promise, it has become clear that virtual reality and/or augmented reality devices alone do not adequately meet the demands of surgeons. The solution may lie in a hybrid technology known as mixed reality, which merges many virtual reality and augmented realty features. Microsoft's HoloLens, the first commercially available mixed reality device, provides surgeons intraoperative hands-free access to complex data, the real environment, and bidirectional communication. This report describes the use of HoloLens in the operating room to improve decision-making and surgical workflow. The pace of mixed reality-related technological development will undoubtedly be rapid in the coming years, and plastic surgeons are ideally suited to both lead and benefit from this advance.

Original languageEnglish (US)
Pages (from-to)1066-1070
Number of pages5
JournalPlastic and Reconstructive Surgery
Volume140
Issue number5
DOIs
StatePublished - Nov 1 2017

Fingerprint

Operating Rooms
Equipment and Supplies
Workflow
Decision Making
Hand
Communication
Technology
Surgeons

ASJC Scopus subject areas

  • Surgery

Cite this

Mixed Reality with HoloLens : Where Virtual Reality Meets Augmented Reality in the Operating Room. / Tepper, Oren M.; Rudy, Hayeem L.; Lefkowitz, Aaron; Weimer, Katie A.; Marks, Shelby M.; Stern, Carrie S.; Garfein, Evan S.

In: Plastic and Reconstructive Surgery, Vol. 140, No. 5, 01.11.2017, p. 1066-1070.

Research output: Contribution to journalArticle

Tepper, Oren M. ; Rudy, Hayeem L. ; Lefkowitz, Aaron ; Weimer, Katie A. ; Marks, Shelby M. ; Stern, Carrie S. ; Garfein, Evan S. / Mixed Reality with HoloLens : Where Virtual Reality Meets Augmented Reality in the Operating Room. In: Plastic and Reconstructive Surgery. 2017 ; Vol. 140, No. 5. pp. 1066-1070.
@article{38d07d5a10e64811be9fdf8a6076a0a7,
title = "Mixed Reality with HoloLens: Where Virtual Reality Meets Augmented Reality in the Operating Room",
abstract = "Virtual reality and augmented reality devices have recently been described in the surgical literature. The authors have previously explored various iterations of these devices, and although they show promise, it has become clear that virtual reality and/or augmented reality devices alone do not adequately meet the demands of surgeons. The solution may lie in a hybrid technology known as mixed reality, which merges many virtual reality and augmented realty features. Microsoft's HoloLens, the first commercially available mixed reality device, provides surgeons intraoperative hands-free access to complex data, the real environment, and bidirectional communication. This report describes the use of HoloLens in the operating room to improve decision-making and surgical workflow. The pace of mixed reality-related technological development will undoubtedly be rapid in the coming years, and plastic surgeons are ideally suited to both lead and benefit from this advance.",
author = "Tepper, {Oren M.} and Rudy, {Hayeem L.} and Aaron Lefkowitz and Weimer, {Katie A.} and Marks, {Shelby M.} and Stern, {Carrie S.} and Garfein, {Evan S.}",
year = "2017",
month = "11",
day = "1",
doi = "10.1097/PRS.0000000000003802",
language = "English (US)",
volume = "140",
pages = "1066--1070",
journal = "Plastic and Reconstructive Surgery",
issn = "0032-1052",
publisher = "Lippincott Williams and Wilkins",
number = "5",

}

TY - JOUR

T1 - Mixed Reality with HoloLens

T2 - Where Virtual Reality Meets Augmented Reality in the Operating Room

AU - Tepper, Oren M.

AU - Rudy, Hayeem L.

AU - Lefkowitz, Aaron

AU - Weimer, Katie A.

AU - Marks, Shelby M.

AU - Stern, Carrie S.

AU - Garfein, Evan S.

PY - 2017/11/1

Y1 - 2017/11/1

N2 - Virtual reality and augmented reality devices have recently been described in the surgical literature. The authors have previously explored various iterations of these devices, and although they show promise, it has become clear that virtual reality and/or augmented reality devices alone do not adequately meet the demands of surgeons. The solution may lie in a hybrid technology known as mixed reality, which merges many virtual reality and augmented realty features. Microsoft's HoloLens, the first commercially available mixed reality device, provides surgeons intraoperative hands-free access to complex data, the real environment, and bidirectional communication. This report describes the use of HoloLens in the operating room to improve decision-making and surgical workflow. The pace of mixed reality-related technological development will undoubtedly be rapid in the coming years, and plastic surgeons are ideally suited to both lead and benefit from this advance.

AB - Virtual reality and augmented reality devices have recently been described in the surgical literature. The authors have previously explored various iterations of these devices, and although they show promise, it has become clear that virtual reality and/or augmented reality devices alone do not adequately meet the demands of surgeons. The solution may lie in a hybrid technology known as mixed reality, which merges many virtual reality and augmented realty features. Microsoft's HoloLens, the first commercially available mixed reality device, provides surgeons intraoperative hands-free access to complex data, the real environment, and bidirectional communication. This report describes the use of HoloLens in the operating room to improve decision-making and surgical workflow. The pace of mixed reality-related technological development will undoubtedly be rapid in the coming years, and plastic surgeons are ideally suited to both lead and benefit from this advance.

UR - http://www.scopus.com/inward/record.url?scp=85033396951&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85033396951&partnerID=8YFLogxK

U2 - 10.1097/PRS.0000000000003802

DO - 10.1097/PRS.0000000000003802

M3 - Article

C2 - 29068946

AN - SCOPUS:85033396951

VL - 140

SP - 1066

EP - 1070

JO - Plastic and Reconstructive Surgery

JF - Plastic and Reconstructive Surgery

SN - 0032-1052

IS - 5

ER -