General-purpose telepresence with head-worn optical see-through displays and projector-based lighting
In this paper we propose a general-purpose telepresence system design that can be adapted to a wide range of scenarios and present a framework for a proof-of-concept prototype. The prototype system allows users to see remote participants and their surroundings merged into the local environment through the use of an optical see-through head-worn display. Real-time 3D acquisition and head tracking allows the remote imagery to be seen from the correct point of view and with proper occlusion. A projector-based lighting control system permits the remote imagery to appear bright and opaque even in a lit room. Immersion can be adjusted across the VR continuum. Our approach relies only on commodity hardware; we also experiment with wider field of view custom displays.
Publication: Maimone A, Yang X, Dierk N, et al. General-purpose telepresence with head-worn optical see-through displays and projector-based lighting[C]//2013 IEEE Virtual Reality (VR). IEEE, 2013: 23-26.
Preprint PDF: General-purpose telepresence with head-worn optical see-through displays and projector-based lighting.pdf
Video
Citation:
@inproceedings{maimone2013general,
title={General-purpose telepresence with head-worn optical see-through displays and projector-based lighting},
author={Maimone, Andrew and Yang, Xubo and Dierk, Nate and State, Andrei and Dou, Mingsong and Fuchs, Henry},
booktitle={2013 IEEE Virtual Reality (VR)},
pages={23–26},
year={2013},
organization={IEEE}
}