PhD in Computer Science, The University of British Columbia, Canada ( 2013.09-2018.05 )
MSc in Optical Science & Engineering, Zhejiang University, China ( 2010.09-2013.03 )
BEs in Opto-Electronic Engineering (major) / Business Administration (minor), Zhejiang University ( 2006.09-2010.07 )

- Research Assistant, Imager Lab, The University of British Columbia ( 2013.09-2018.09 )
- Visiting Student Researcher, Computational Imaging Group, Stanford University ( 2017.12-2018.03 )
- Visiting Student Researcher, Visual Computing Center, KAUST ( 2016.11-2017.02 & 2015.10-2016.01 & 2014.10-2015.01)
- Display & Interaction Tech. Researcher, Lenovo Global R&T ( 2013.04-2013.08 )
- Research Assistant, State Key Lab. of Modern Optical Instrumentation, Zhejiang University ( 2010.04-2013.04 )

Professional Education

  • Doctor of Philosophy, University of British Columbia (2018)
  • Master of Science, Zhejiang University (2013)
  • Bachelor of Engineering, Zhejiang University (2010)
  • Bachelor of Management, Zhejiang University (2010)


  • Xu Liu, Xinxing Xia, Yifan Peng, Haifeng Li, Zhenrong Zheng. "United States Patent 9036003 Multi-pitching angle suspended 3D display device with 360-degree field of view"
  • Yifan Peng, Guang Yang, Ke Shang. "United States Patent 9800863 Three dimensional display apparatus, display method and electronic device"

Current Research and Scholarly Interests

My research interests ride across the research advances in optics/photonics, computer graphics, and computer vision. In particular, a core route is to incorporate optics and algorithms to enable new imaging modalities, including the research on building computational cameras, computational displays, VRAR solutions, etc.

Lab Affiliations

All Publications

  • Foveated light-field display and real-time rendering for virtual reality APPLIED OPTICS Gao, C., Peng, Y., Wang, R., Zhang, Z., Li, H., Liu, X. 2021; 60 (28): 8634-8643


    Glasses-free light field displays have significantly progressed due to advances in high-resolution microdisplays and high-end graphics processing units (GPUs). However, for near-eye light-field displays requiring portability, the fundamental trade-off regarding achieved spatial resolution remains: retinal blur quality must be degraded; otherwise, computational consumption increases. This has prevented synthesizing the high-quality light field from being fast. By integrating off-the-shelf gaze tracking modules into near-eye light-field displays, we present wearable virtual reality prototypes supporting human visual system-oriented focus cues. An optimized, foveated light field is delivered to each eye subject to the gaze point, providing more natural visual experiences than state-of-the-art solutions. Importantly, the factorization runtime can be immensely reduced, since the image resolution is only high within the gaze cone. In addition, we demonstrate significant improvements in computation and retinal blur quality over counterpart near-eye displays.

    View details for DOI 10.1364/AO.432911

    View details for Web of Science ID 000704359000002

    View details for PubMedID 34613088

  • Differentiable Compound Optics and Processing Pipeline Optimization for End-to-end Camera Design ACM TRANSACTIONS ON GRAPHICS Tseng, E., Mosleh, A., Mannan, F., St-Arnaud, K., Sharma, A., Peng, Y., Braun, A., Nowrouzezahrai, D., Lalonde, J., Heide, F. 2021; 40 (2)

    View details for DOI 10.1145/3446791

    View details for Web of Science ID 000667456500009

  • Optimizing image quality for holographic near-eye displays with Michelson Holography OPTICA Choi, S., Kim, J., Peng, Y., Wetzstein, G. 2021; 8 (2): 143–46
  • Deep-Learned Broadband Encoding Stochastic Filters for Computational Spectroscopic Instruments ADVANCED THEORY AND SIMULATIONS Song, H., Ma, Y., Han, Y., Shen, W., Zhang, W., Li, Y., Liu, X., Peng, Y., Hao, X. 2021; 4 (3)
  • Depth from Defocus with Learned Optics for Imaging and Occlusion-aware Depth Estimation Ikoma, H., Nguyen, C. M., Metzler, C. A., Peng, Y., Wetzstein, G., IEEE IEEE. 2021
  • Neural Holography with Camera-in-the-loop Training ACM TRANSACTIONS ON GRAPHICS Peng, Y., Choi, S., Padmanaban, N., Wetzstein, G. 2020; 39 (6)
  • Learned rotationally symmetric diffractive achromat for full-spectrum computational imaging OPTICA Dun, X., Ikoma, H., Wetzstein, G., Wang, Z., Cheng, X., Peng, Y. 2020; 7 (8): 913–22
  • End-to-end Learned, Optically Coded Super-resolution SPAD Camera ACM TRANSACTIONS ON GRAPHICS Sun, Q., Zhang, J., Dun, X., Ghanem, B., Peng, Y., Heidrich, W. 2020; 39 (2)

    View details for DOI 10.1145/3372261

    View details for Web of Science ID 000583691000001

  • Holographic Near-Eye Displays Based on Overlap-Add Stereograms ACM TRANSACTIONS ON GRAPHICS Padmanaban, N., Peng, Y., Wetzstein, G. 2019; 38 (6)
  • Learned Large Field-of-View Imaging With Thin-Plate Optics ACM TRANSACTIONS ON GRAPHICS Peng, Y., Sun, Q., Dun, X., Wetzstein, G., Heidrich, W., Heide, F. 2019; 38 (6)
  • Wirtinger Holography for Near-Eye Displays ACM TRANSACTIONS ON GRAPHICS Chakravarthula, P., Peng, Y., Kollin, J., Fuchs, H., Heide, F. 2019; 38 (6)
  • Optical-digital joint design of refractive telescope using chromatic priors CHINESE OPTICS LETTERS Zhang, J., Nie, Y., Fu, Q., Peng, Y. 2019; 17 (5)
  • End-to-end Optimization of Optics and Image Processing for Achromatic Extended Depth of Field and Super-resolution Imaging ACM TRANSACTIONS ON GRAPHICS Sitzmann, V., Diamond, S., Peng, Y., Dun, X., Boyd, S., Heidrich, W., Heide, F., Wetzstein, G. 2018; 37 (4)
  • Focal Sweep Imaging with Multi-focal Diffractive Optics Peng, Y., Dun, X., Sun, Q., Heide, F., Heidrich, W., IEEE IEEE. 2018
  • Depth and Transient Imaging with Compressive SPAD Array Cameras Sun, Q., Dun, X., Peng, Y., Heidrich, W., IEEE IEEE. 2018: 273–82
  • Highly efficient waveguide display with space-variant volume holographic gratings APPLIED OPTICS Yu, C., Peng, Y., Zhao, Q., Li, H., Liu, X. 2017; 56 (34): 9390–97


    We propose a highly efficient waveguide display based on space-variant volume holographic gratings (SVVHGs). The local period and slant angle of the SVVHG vary along the tangential direction, enabling variant incident angles to satisfy the Bragg condition of the local gratings. As a result, we enlarge the field of view (FOV) without using the conventional multiplexing scheme, while achieving high efficiency and large FOV at the same time. We experimentally record the SVVHGs on Bayfol HX200 films. We demonstrate that the proposed display can achieve 31.9% system efficiency for a broadband light source and 52.3% for a coherent light source, 20° FOV, and high brightness uniformity, making it a promising candidate for widespread applications in the augmented reality (AR) industry.

    View details for DOI 10.1364/AO.56.009390

    View details for Web of Science ID 000416665400006

    View details for PubMedID 29216051

  • Mix-and-Match Holography Peng, Y., Dun, X., Sun, Q., Heidrich, W. ASSOC COMPUTING MACHINERY. 2017
  • Revisiting Cross-channel Information Transfer for Chromatic Aberration Correction Sun, T., Peng, Y., Heidrich, W., IEEE IEEE. 2017: 3268–76
  • Encoded diffractive optics for full-spectrum computational imaging SCIENTIFIC REPORTS Heide, F., Fu, Q., Peng, Y., Heidrich, W. 2016; 6: 33543


    Diffractive optical elements can be realized as ultra-thin plates that offer significantly reduced footprint and weight compared to refractive elements. However, such elements introduce severe chromatic aberrations and are not variable, unless used in combination with other elements in a larger, reconfigurable optical system. We introduce numerically optimized encoded phase masks in which different optical parameters such as focus or zoom can be accessed through changes in the mechanical alignment of a ultra-thin stack of two or more masks. Our encoded diffractive designs are combined with a new computational approach for self-calibrating imaging (blind deconvolution) that can restore high-quality images several orders of magnitude faster than the state of the art without pre-calibration of the optical system. This co-design of optics and computation enables tunable, full-spectrum imaging using thin diffractive optics.

    View details for DOI 10.1038/srep33543

    View details for Web of Science ID 000383335900002

    View details for PubMedID 27633055

    View details for PubMedCentralID PMC5025844

  • The Diffractive Achromat Full Spectrum Computational Imaging with Diffractive Optics Peng, Y., Fu, Q., Heide, F., Heidrich, W. ASSOC COMPUTING MACHINERY. 2016
  • Grayscale performance enhancement for time-multiplexing light field rendering OPTICS EXPRESS Su, C., Zhong, Q., Peng, Y., Xu, L., Wang, R., Li, H., Liu, X. 2015; 23 (25): 32622–32


    One of the common approaches to compensate for the grayscale performance limitation in time-multiplexing light field displays is to employ a halftone technique. We propose an ordered-dithering halftone algorithm based on a 3-dimension super-mask to increase the gray levels of the time-multiplexing light field display. Our method makes full use of the overlapping perceived pixels which are caused by the time-multiplexing design, such that effectively trading-off the spatial resolution and color performance. A real-time rendering time-multiplexing display prototype is built to validate the proposed halftone algorithm. We conducted a user study to evaluate the quality of display scenes dithered by different super-mask configuration, which showed the consistency with the parameters we pre-calculated. The 3D ordered-dithering algorithm is able to present better visual perception than the conventional halftone algorithms with respect to grayscale representation, and flexible to be applied in different time-multiplexing light field display systems.

    View details for DOI 10.1364/OE.23.032622

    View details for Web of Science ID 000366687200097

    View details for PubMedID 26699051

  • Computational imaging using lightweight diffractive-refractive optics OPTICS EXPRESS Peng, Y., Fu, Q., Amata, H., Su, S., Heide, F., Heidrich, W. 2015; 23 (24): 31393–407


    Diffractive optical elements (DOE) show great promise for imaging optics that are thinner and more lightweight than conventional refractive lenses while preserving their light efficiency. Unfortunately, severe spectral dispersion currently limits the use of DOEs in consumer-level lens design. In this article, we jointly design lightweight diffractive-refractive optics and post-processing algorithms to enable imaging under white light illumination. Using the Fresnel lens as a general platform, we show three phase-plate designs, including a super-thin stacked plate design, a diffractive-refractive-hybrid lens, and a phase coded-aperture lens. Combined with cross-channel deconvolution algorithm, both spherical and chromatic aberrations are corrected. Experimental results indicate that using our computational imaging approach, diffractive-refractive optics is an alternative candidate to build light efficient and thin optics for white light imaging.

    View details for DOI 10.1364/OE.23.031393

    View details for Web of Science ID 000366614100109

    View details for PubMedID 26698765