ISMAR 2018
IEEEIEEE computer societyIEEE vgtcACM In-CooperationACM In-Cooperation

Sponsors

Platinum Apple
Silver MozillaIntelDaqriPTCAmazon
Bronze FacebookQualcommUmajinDisney ResearchUniSA VenturesReflektOccipital
SME EnvisageARKhronos
Academic TUMETHZ

Jakob Zillner, Erick Mendez, and Daniel Wagner. Augmented reality remote collaboration with dense reconstruction. In Adjunct Proceedings of the IEEE International Symposium for Mixed and Augmented Reality 2018 (To appear). 2018.
[BibTeX▼]

Abstract

We present an Augmented Reality remote collaboration system leveraging dense scene reconstruction for intuitive remote guidance. A local worker can use our system to automatically generate a 3D mesh of the surrounding and stream it to a remote expert. The remote expert can use the reconstruction to explore the scene independently of the local worker. World-stabilized annotations can be placed and strokes drawn on surfaces are intelligently placed in the world. In addition, the remote expert can segment objects from the reconstructed mesh in order to quickly create animations for conveying precise instructions to the local worker.