Augmented Reality Remote Collaboration with Dense Reconstruction

We present an Augmented Reality remote collaboration system leveraging dense scene reconstruction for intuitive remote guidance. A local worker can use our system to automatically generate a 3D mesh of the surrounding and stream it to a remote expert. The remote expert can use the reconstruction to explore the scene independently of the local worker. World-stabilized annotations can be placed and strokes drawn on surfaces are intelligently placed in the world. In addition, the remote expert can segment objects from the reconstructed mesh in order to quickly create animations for conveying precise instructions to the local worker.