1. Interactive Recorder for 3D Reconstruction with the HoloLens
Write an application for the HoloLens that provides real- time feedback to the user to enable high quality 3D reconstruction
The Microsoft HoloLens is equipped with a broad range of sensors suitable for 3D reconstruction purposes, including an IMU, a depth sensor, and an RGB camera and four grayscale cameras. Using these sensors, the HoloLens builds and maintains a coarse 3D model of the world in real-time that can be used by applications on the device. To enable efficient recording and high quality 3D reconstruction using offline reconstruction algorithms, users should be guided with real-time feedback in terms of coverage and accuracy of the recorded data. This project should extend the existing recorder application based on the HoloLens research mode API by augmenting and visualizing the coarse mesh model with uncertainty information in real-time. More specifically, the developed application should colorize the coarse mesh model with coverage and accuracy information deduced from the viewing geometry. This project will have great impact on enabling high quality 3D reconstruction from the HoloLens by guiding the user during the recording process.
Preferred: C++/C#/Unity
Johannes Schönberger
Sudipta Sinha
Marc Pollefeys