TutAR: Semi-Automatic Generation of Augmented Reality Tutorials for Medical Education

Daniel Eckhoff, Christian Sandor, Denis Kalkofen, Ulrich Eck, Christian Lins, and Andreas Hein. Tutar: semi-automatic generation of augmented reality tutorials for medical education. In Adjunct Proceedings of the IEEE International Symposium for Mixed and Augmented Reality 2018 (To appear). 2018.
[BibTeX▼]

@inproceedings{ismar2018_demo_10,
    author = "Eckhoff, Daniel and Sandor, Christian and Kalkofen, Denis and Eck, Ulrich and Lins, Christian and Hein, Andreas",
    title = "TutAR: Semi-Automatic Generation of Augmented Reality Tutorials for Medical Education",
    year = "2018",
    booktitle = "Adjunct Proceedings of the IEEE International Symposium for Mixed and Augmented Reality 2018 (To appear)"
}

Abstract

With Augmented Reality (AR) on Optical-See-Through-Head- Mounted Displays (OST-HMD), users can observe the real world and computer graphics at the same time. In this work, we present TutAR, a pipeline that semi-automatically creates AR tutorials out of 2D RGB videos. TutAR extracts relevant 3D hand motion from the input video. The derived motion will be displayed as an animated 3D hand relative to the human body and plays synchronously with the motion in the video on an OST-HMD.

Sponsors

Abstract