Pre-recorded Sessions: From 4 December 2020 | Live Sessions: 10 – 13 December 2020
4 – 13 December 2020
Learned Hardware-in-the-loop Phase Retrieval for Holographic Near-Eye Displays
-
Ultimate Supporter
-
Ultimate Attendee
Date/Time:
04 – 13 December 2020
All presentations are available in the virtual platform on-demand.
Lecturer(s):
Praneeth Chakravarthula, University of North Carolina at Chapel Hill (UNC), United States of America
Ethan Tseng, Princeton University, United States of America
Tarun Srivastava, Princeton University, United States of America
Henry Fuchs, University of North Carolina at Chapel Hill (UNC), United States of America
Felix Heide, Princeton University, United States of America
Bio:
Description: Holography is arguably the most promising technology to provide wide field-of-view compact eyeglasses-style near-eye displays for augmented and virtual reality. However, the image quality of existing holographic displays is far from that of current generation conventional displays, effectively making today's holographic display systems impractical. This gap stems predominantly from the severe deviations in the idealized approximations of the ``unknown'' light transport model in a real holographic display, used for computing holograms. In this work, we depart from such approximate ``ideal'' coherent light transport models for computing holograms. Instead, we learn the deviations of the real display from the ideal light transport from the images measured using a display-camera hardware system. After this unknown light propagation is learned, we use it to compensate for severe aberrations in real holographic imagery. The proposed hardware-in-the-loop approach is robust to spatial, temporal and hardware deviations, and improves the image quality of existing methods qualitatively and quantitatively in SNR and perceptual quality. We validate our approach on a holographic display prototype and show that the method can fully compensate unknown aberrations and erroneous and non-linear SLM phase delays, without explicitly modeling them. As a result, the proposed method significantly outperforms existing state-of-the-art methods in simulation and experimentation -- just by observing captured holographic images.
