Manu Gopakumar

All Publications

• Full-colour 3D holographic augmented-reality displays with metasurface waveguides. Nature Gopakumar, M., Lee, G. Y., Choi, S., Chao, B., Peng, Y., Kim, J., Wetzstein, G. 2024

  Abstract

  Emerging spatial computing systems seamlessly superimpose digital information on the physical environment observed by a user, enabling transformative experiences across various domains, such as entertainment, education, communication and training1-3. However, the widespread adoption of augmented-reality (AR) displays has been limited due to the bulky projection optics of their light engines and their inability to accurately portray three-dimensional (3D) depth cues for virtual content, among other factors4,5. Here we introduce a holographic AR system that overcomes these challenges using a unique combination of inverse-designed full-colour metasurface gratings, a compact dispersion-compensating waveguide geometry and artificial-intelligence-driven holography algorithms. These elements are co-designed to eliminate the need for bulky collimation optics between the spatial light modulator and the waveguide and to present vibrant, full-colour, 3D AR content in a compact device form factor. To deliver unprecedented visual quality with our prototype, we develop an innovative image formation model that combines a physically accurate waveguide model with learned components that are automatically calibrated using camera feedback. Our unique co-design of a nanophotonic metasurface waveguide and artificial-intelligence-driven holographic algorithms represents a significant advancement in creating visually compelling 3D AR experiences in a compact wearable device.

  View details for DOI 10.1038/s41586-024-07386-0

  View details for PubMedID 38720077

  View details for PubMedCentralID 8208705

• Holographic Parallax Nam, S., Kim, D., Choi, S., Lee, J., Lee, S., Gopakumar, M., Chao, B., Wetzstein, G., Jeong, Y., Spencer, S. N. ASSOC COMPUTING MACHINERY. 2024

  View details for DOI 10.1145/3641517.3664386

  View details for Web of Science ID 001270700800006

• Large Etendue 3D Holographic Display with Content-adaptive Dynamic Fourier Modulation Chao, B., Gopakumar, M., Choi, S., Kim, J., Shi, L., Wetzstein, G., Spencer, S. N. ASSOC COMPUTING MACHINERY. 2024

  View details for DOI 10.1145/3680528.3687600

  View details for Web of Science ID 001441591200026

• Loss-of-function mutations in <i>Dnmt3a</i> and <i>Tet2</i> lead to accelerated atherosclerosis and concordant macrophage phenotypes NATURE CARDIOVASCULAR RESEARCH Rauch, P. J., Gopakumar, J., Silver, A. J., Nachun, D., Ahmad, H., Mcconkey, M., Nakao, T., Bosse, M., Rentz, T., Gonzalez, N., Greenwald, N. F., Mccaffrey, E. F., Khair, Z., Gopakumar, M., Rodrigues, K. B., Lin, A. E., Sinha, E., Fefer, M., Cohen, D. N., Vromman, A., Shvartz, E., Sukhova, G., Bendall, S., Angelo, M., Libby, P., Ebert, B. L., Jaiswal, S. 2023; 2 (9): 805-+

  View details for DOI 10.1038/s44161-023-00326-7

  View details for Web of Science ID 001127053400010

• Loss-of-function mutations in Dnmt3a and Tet2 lead to accelerated atherosclerosis and concordant macrophage phenotypes. Nature cardiovascular research Rauch, P. J., Gopakumar, J., Silver, A. J., Nachun, D., Ahmad, H., McConkey, M., Nakao, T., Bosse, M., Rentz, T., Vivanco Gonzalez, N., Greenwald, N. F., McCaffrey, E. F., Khair, Z., Gopakumar, M., Rodrigues, K. B., Lin, A. E., Sinha, E., Fefer, M., Cohen, D. N., Vromman, A., Shvartz, E., Sukhova, G., Bendall, S., Angelo, M., Libby, P., Ebert, B. L., Jaiswal, S. 2023; 2 (9): 805-818

  Abstract

  Clonal hematopoiesis of indeterminate potential (CHIP) is defined by the presence of a cancer-associated somatic mutation in white blood cells in the absence of overt hematological malignancy. It arises most commonly from loss-of-function mutations in the epigenetic regulators DNMT3A and TET2. CHIP predisposes to both hematological malignancies and atherosclerotic cardiovascular disease in humans. Here we demonstrate that loss of Dnmt3a in myeloid cells increased murine atherosclerosis to a similar degree as previously seen with loss of Tet2. Loss of Dnmt3a enhanced inflammation in macrophages in vitro and generated a distinct adventitial macrophage population in vivo which merges a resident macrophage profile with an inflammatory cytokine signature. These changes surprisingly phenocopy the effect of loss of Tet2. Our results identify a common pathway promoting heightened innate immune cell activation with loss of either gene, providing a biological basis for the excess atherosclerotic disease burden in carriers of these two most prevalent CHIP mutations.

  View details for DOI 10.1038/s44161-023-00326-7

  View details for PubMedID 39196062

  View details for PubMedCentralID 8050831

• High-brightness holographic projection. Optics letters Chao, B., Gopakumar, M., Choi, S., Wetzstein, G. 2023; 48 (15): 4041-4044

  Abstract

  We propose a holographic projection system that achieves high image quality, brightness, and light efficiency. Using a novel, to the best of our knowledge, light-efficiency loss function, we are able to concentrate more light on the projection region and improve display brightness compared with conventional projectors. Leveraging emerging artificial intelligence-driven computer-generated holography and camera-in-the-loop calibration techniques, we learn a holographic wave propagation model using experimentally captured holographic images and demonstrate state-of-the-art light reallocation performance with high image quality.

  View details for DOI 10.1364/OL.489617

  View details for PubMedID 37527113

• Partially-Coherent Neural Holography with Fast Spatial Light Modulators Choi, S., Gopakumar, M., Peng, Y., Kim, J., O'Toole, M., Wetzstein, G., Ehmke, J., Lee, B. L. SPIE-INT SOC OPTICAL ENGINEERING. 2023

  View details for DOI 10.1117/12.2655404

  View details for Web of Science ID 001012190800001

• Neural 3D Holography: Learning Accurate Wave Propagation Models for 3D Holographic Virtual and Augmented Reality Displays ACM TRANSACTIONS ON GRAPHICS Choi, S., Gopakumar, M., Peng, Y., Kim, J., Wetzstein, G. 2021; 40 (6)

  View details for DOI 10.1145/3478513.3480542

  View details for Web of Science ID 000729846700045

• Unfiltered holography: optimizing high diffraction orders without optical filtering for compact holographic displays OPTICS LETTERS Gopakumar, M., Kim, J., Choi, S., Peng, Y., Wetzstein, G. 2021; 46 (23): 5822-5825

  Abstract

  Computer-generated holography suffers from high diffraction orders (HDOs) created from pixelated spatial light modulators, which must be optically filtered using bulky optics. Here, we develop an algorithmic framework for optimizing HDOs without optical filtering to enable compact holographic displays. We devise a wave propagation model of HDOs and use it to optimize phase patterns, which allows HDOs to contribute to forming the image instead of creating artifacts. The proposed method significantly outperforms previous algorithms in an unfiltered holographic display prototype.

  View details for DOI 10.1364/OL.442851

  View details for Web of Science ID 000722896900011

  View details for PubMedID 34851899