Marc Levoy
VMware Founders Professor in Computer Science and Professor of Electrical Engineering, Emeritus
Bio
Levoy's current interests include the science and art of photography, computational photography, light field sensing and display, and applications of computer graphics in microscopy and biology.
Academic Appointments
-
Emeritus Faculty, Acad Council, Computer Science
Honors & Awards
-
Member, National Academy of Engineering (2022)
-
Fellow, Association for Computing Machinery (2007)
Program Affiliations
-
Symbolic Systems Program
Professional Education
-
PhD, University of North Carolina, Computer Science, Electrical Engineering (1989)
2023-24 Courses
-
Independent Studies (15)
- Advanced Reading and Research
CS 499 (Aut, Win, Spr, Sum) - Advanced Reading and Research
CS 499P (Aut, Win, Spr, Sum) - Curricular Practical Training
CS 390A (Aut, Win, Spr, Sum) - Curricular Practical Training
CS 390B (Aut, Win, Spr, Sum) - Curricular Practical Training
CS 390C (Aut, Win, Spr, Sum) - Independent Project
CS 399 (Aut, Win, Spr, Sum) - Independent Project
CS 399P (Aut, Win, Spr, Sum) - Independent Work
CS 199 (Aut, Win, Spr, Sum) - Independent Work
CS 199P (Aut, Win, Spr, Sum) - Part-time Curricular Practical Training
CS 390D (Aut, Win) - Programming Service Project
CS 192 (Aut, Win, Spr, Sum) - Senior Project
CS 191 (Aut, Win, Spr, Sum) - Special Studies and Reports in Electrical Engineering (WIM)
EE 191W (Aut) - Special Studies or Projects in Electrical Engineering
EE 190 (Aut) - Writing Intensive Senior Research Project
CS 191W (Aut, Win, Spr)
- Advanced Reading and Research
All Publications
-
Wave optics theory and 3-D deconvolution for the light field microscope
OPTICS EXPRESS
2013; 21 (21): 25418-25439
Abstract
Light field microscopy is a new technique for high-speed volumetric imaging of weakly scattering or fluorescent specimens. It employs an array of microlenses to trade off spatial resolution against angular resolution, thereby allowing a 4-D light field to be captured using a single photographic exposure without the need for scanning. The recorded light field can then be used to computationally reconstruct a full volume. In this paper, we present an optical model for light field microscopy based on wave optics, instead of previously reported ray optics models. We also present a 3-D deconvolution method for light field microscopy that is able to reconstruct volumes at higher spatial resolution, and with better optical sectioning, than previously reported. To accomplish this, we take advantage of the dense spatio-angular sampling provided by a microlens array at axial positions away from the native object plane. This dense sampling permits us to decode aliasing present in the light field to reconstruct high-frequency information. We formulate our method as an inverse problem for reconstructing the 3-D volume, which we solve using a GPU-accelerated iterative algorithm. Theoretical limits on the depth-dependent lateral resolution of the reconstructed volumes are derived. We show that these limits are in good agreement with experimental results on a standard USAF 1951 resolution target. Finally, we present 3-D reconstructions of pollen grains that demonstrate the improvements in fidelity made possible by our method.
View details for DOI 10.1364/OE.21.025418
View details for Web of Science ID 000326085600097
View details for PubMedID 24150383
View details for PubMedCentralID PMC3867103
-
The Frankencamera: An Experimental Platform for Computational Photography
COMMUNICATIONS OF THE ACM
2012; 55 (11): 90-98
View details for DOI 10.1145/2366316.2366339
View details for Web of Science ID 000311293300029
-
Application of Zernike polynomials towards accelerated adaptive focusing of transcranial high intensity focused ultrasound
MEDICAL PHYSICS
2012; 39 (10): 6254-6263
Abstract
To study the phase aberrations produced by human skulls during transcranial magnetic resonance imaging guided focused ultrasound surgery (MRgFUS), to demonstrate the potential of Zernike polynomials (ZPs) to accelerate the adaptive focusing process, and to investigate the benefits of using phase corrections obtained in previous studies to provide the initial guess for correction of a new data set.The five phase aberration data sets, analyzed here, were calculated based on preoperative computerized tomography (CT) images of the head obtained during previous transcranial MRgFUS treatments performed using a clinical prototype hemispherical transducer. The noniterative adaptive focusing algorithm [Larrat et al., "MR-guided adaptive focusing of ultrasound," IEEE Trans. Ultrason. Ferroelectr. Freq. Control 57(8), 1734-1747 (2010)] was modified by replacing Hadamard encoding with Zernike encoding. The algorithm was tested in simulations to correct the patients' phase aberrations. MR acoustic radiation force imaging (MR-ARFI) was used to visualize the effect of the phase aberration correction on the focusing of a hemispherical transducer. In addition, two methods for constructing initial phase correction estimate based on previous patient's data were investigated. The benefits of the initial estimates in the Zernike-based algorithm were analyzed by measuring their effect on the ultrasound intensity at the focus and on the number of ZP modes necessary to achieve 90% of the intensity of the nonaberrated case.Covariance of the pairs of the phase aberrations data sets showed high correlation between aberration data of several patients and suggested that subgroups can be based on level of correlation. Simulation of the Zernike-based algorithm demonstrated the overall greater correction effectiveness of the low modes of ZPs. The focal intensity achieves 90% of nonaberrated intensity using fewer than 170 modes of ZPs. The initial estimates based on using the average of the phase aberration data from the individual subgroups of subjects was shown to increase the intensity at the focal spot for the five subjects.The application of ZPs to phase aberration correction was shown to be beneficial for adaptive focusing of transcranial ultrasound. The skull-based phase aberrations were found to be well approximated by the number of ZP modes representing only a fraction of the number of elements in the hemispherical transducer. Implementing the initial phase aberration estimate together with Zernike-based algorithm can be used to improve the robustness and can potentially greatly increase the viability of MR-ARFI-based focusing for a clinical transcranial MRgFUS therapy.
View details for DOI 10.1118/1.4752085
View details for Web of Science ID 000310101900044
View details for PubMedID 23039661
View details for PubMedCentralID PMC3470612
-
Unstructured Light Fields
COMPUTER GRAPHICS FORUM
2012; 31 (2): 305-314
View details for DOI 10.1111/j.1467-8659.2012.03009.x
View details for Web of Science ID 000304901400010
-
CMOS Image Sensors With Multi-Bucket Pixels for Computational Photography
IEEE JOURNAL OF SOLID-STATE CIRCUITS
2012; 47 (4): 1031-1042
View details for DOI 10.1109/JSSC.2012.2185189
View details for Web of Science ID 000302494700022
- Applications of Multi-Bucket Sensors to Computational Photography. Stanford Computer Graphics Laboratory Technical Report 2012-2 2012
- Focal stack compositing for depth of field control Stanford Computer Graphics Laboratory Technical 2012-1 2012
- Digital Video Stabilization and Rolling Shutter Correction using Gyroscopes Stanford Computer Science Tech Report CSTR 2011-03 2011
-
Experimental Platforms for Computational Photography
IEEE COMPUTER GRAPHICS AND APPLICATIONS
2010; 30 (5): 81-87
View details for Web of Science ID 000281035500012
-
The Frankencamera: An Experimental Platform for Computational Photography
ACM TRANSACTIONS ON GRAPHICS
2010; 29 (4)
View details for DOI 10.1145/1778765.1778766
View details for Web of Science ID 000279806600001
-
Recording and controlling the 4D light field in a microscope using microlens arrays
JOURNAL OF MICROSCOPY
2009; 235 (2): 144-162
Abstract
By inserting a microlens array at the intermediate image plane of an optical microscope, one can record four-dimensional light fields of biological specimens in a single snapshot. Unlike a conventional photograph, light fields permit manipulation of viewpoint and focus after the snapshot has been taken, subject to the resolution of the camera and the diffraction limit of the optical system. By inserting a second microlens array and video projector into the microscope's illumination path, one can control the incident light field falling on the specimen in a similar way. In this paper, we describe a prototype system we have built that implements these ideas, and we demonstrate two applications for it: simulating exotic microscope illumination modalities and correcting for optical aberrations digitally.
View details for Web of Science ID 000268300100005
View details for PubMedID 19659909
-
Gaussian KD-Trees for Fast High-Dimensional Filtering
ACM SIGGRAPH Conference 2009
ASSOC COMPUTING MACHINERY. 2009
View details for DOI 10.1145/1531326.1531327
View details for Web of Science ID 000269278000001
- Gaussian KD-Trees for Fast High-Dimensional Filtering 2009
- Wigner Distributions and How They Relate to the Light Field IEEE International Conference on Computational Photography (ICCP) 2009
- Flexible Multimodal Camera Using a Light Field Architecture IEEE International Conference on Computational Photography (ICCP) 2009
-
Computational Photography on Large Collections of Images
COMMUNICATIONS OF THE ACM
2008; 51 (10): 86-86
View details for DOI 10.1145/1400181.1400201
View details for Web of Science ID 000259930000029
-
Combining confocal imaging and descattering
Eurographics Symposium on Rendering 2008
WILEY-BLACKWELL. 2008: 1245–53
View details for Web of Science ID 000258223600022
- Spatially Adaptive Photographic Flash Technical Report 612, ETH Zurich, Institute of Visual Computing 2008; 612
-
Veiling glare in high dynamic range imaging
ACM SIGGRAPH 2007 Conference
ASSOC COMPUTING MACHINERY. 2007
View details for DOI 10.1145/1239451.1239488
View details for Web of Science ID 000248914000040
-
Synthetic aperture focusing using dense camera arrays
Workshop on Advanced 3D Imaging for Safety and Security held in Conjunction with the International Conference on Computer Vision and Pattern Recognition
SPRINGER. 2007: 159-?
View details for Web of Science ID 000250475200007
- General Linear Cameras with Finite Aperture Eurographics Symposium on Rendering (EGSR) 2007
- Veiling Glare in High Dynamic Range Imaging 2007
-
Light fields and computational imaging
COMPUTER
2006; 39 (8): 46-?
View details for Web of Science ID 000239562000015
-
Light field microscopy
ACM TRANSACTIONS ON GRAPHICS
2006; 25 (3): 924-934
View details for Web of Science ID 000239817400054
- Reconstructing Occluded Surfaces using Synthetic Apertures: Stereo, Focus and Robust Measures 2006
- Symmetric Photography : Exploiting Data-sparseness in Reflectance Fields 2006
- Light Field Microscopy 2006
- Fragments of the City: Stanford's Digital Forma Urbis Romae Project 2006
- Computer-aided Reconstruction and New Matches in the Forma Urbis Romae 2006
-
High performance imaging using large camera arrays
ACM SIGGRAPH 2005 Conference
ASSOC COMPUTING MACHINERY. 2005: 765–76
View details for Web of Science ID 000231223700047
-
Dual photography
ACM SIGGRAPH 2005 Conference
ASSOC COMPUTING MACHINERY. 2005: 745–55
View details for Web of Science ID 000231223700045
-
Protecting 3D graphics content
COMMUNICATIONS OF THE ACM
2005; 48 (6): 74-80
View details for Web of Science ID 000229360000020
-
High-speed videography using a dense camera array
26th International Congress on High-Speed Photography and Photonics
SPIE-INT SOC OPTICAL ENGINEERING. 2005: 913–920
View details for Web of Science ID 000228994200101
- Synthetic Aperture Focusing using a Shear-Warp Factorization of the Viewing Transform 2005
- High Performance Imaging Using Large Camera Arrays 2005
- Light Field Photography with a Hand-Held Plenoptic Camera Stanford University Computer Science Tech Report CSTR 2005: 2005-02
- Interactive Deformation of Light Fields 2005
- Dual Photography 2005
-
Protected interactive 3D graphics via remote rendering
Annual Symposium of the ACM SIGGRAPH
ASSOC COMPUTING MACHINERY. 2004: 695–703
View details for Web of Science ID 000222972600064
-
Synthetic aperture confocal imaging
Annual Symposium of the ACM SIGGRAPH
ASSOC COMPUTING MACHINERY. 2004: 825–34
View details for Web of Science ID 000222972600083
-
High-speed videography using a dense camera array
Conference on Computer Vision and Pattern Recognition
IEEE COMPUTER SOC. 2004: 294–301
View details for Web of Science ID 000223605500039
- Protected Interactive 3D Graphics Via Remote Rendering 2004
- Synthetic aperture confocal imaging ACM Transactions on Graphics 2004; 3 (23)
- High Speed Video Using a Dense Camera Array 2004
-
Using plane plus parallax for calibrating dense camera arrays
Conference on Computer Vision and Pattern Recognition
IEEE COMPUTER SOC. 2004: 2–9
View details for Web of Science ID 000223603900001
-
Interactive design of multi-perspective images for visualizing urban landscapes
IEEE Visualization 2004 Conference
IEEE. 2004: 537–544
View details for Web of Science ID 000225187500068
-
Geometrically stable sampling for the ICP algorithm
4th International Conference on 3-D Digital Imaging and Modeling (3-DIM 2003)
IEEE COMPUTER SOC. 2003: 260–267
View details for Web of Science ID 000186392000033
- A Hierarchical Method for Aligning Warped Meshes 2003
-
A hierarchical method for aligning warped meshes
4th International Conference on 3-D Digital Imaging and Modeling (3-DIM 2003)
IEEE COMPUTER SOC. 2003: 434–441
View details for Web of Science ID 000186392000054
-
Unwrapping and visualizing cuneiform tablets
IEEE COMPUTER GRAPHICS AND APPLICATIONS
2002; 22 (6): 82-88
View details for Web of Science ID 000178844800013
-
Real-time 3D model acquisition
SIGGRAPH 2002 Meeting
ASSOC COMPUTING MACHINERY. 2002: 438–46
View details for Web of Science ID 000176671100028
-
Filling holes in complex surfaces using volumetric diffusion
1st International Symposium on 3D Data Processing Visualization and Transmission
IEEE COMPUTER SOC. 2002: 428–438
View details for Web of Science ID 000177028700061
- Order-Independent Texture Synthesis Technical Report TR-2002-01, Computer Science Department, Stanford University 2002
-
A practical model for subsurface light transport
SIGGRAPH 2001
ASSOC COMPUTING MACHINERY. 2001: 511–518
View details for Web of Science ID 000173048800056
- Streaming QSplat: A Viewer for Networked Visualization of Large, Dense Models 2001
- An Assessment of Laser Range Measurement of Marble Surfaces 2001
-
Efficient variants of the ICP algorithm
3rd International Conference on 3-D Digital Imaging and Modeling
IEEE COMPUTER SOC. 2001: 145–152
View details for Web of Science ID 000169642900018
-
Texture synthesis over arbitrary manifold surfaces
SIGGRAPH 2001
ASSOC COMPUTING MACHINERY. 2001: 355–360
View details for Web of Science ID 000173048800037
-
Untitled
COMPUTER GRAPHICS-US
2000; 34 (3): 4-4
View details for Web of Science ID 000165059200002
-
Error in volume rendering paper was in exposition only
IEEE COMPUTER GRAPHICS AND APPLICATIONS
2000; 20 (4): 6-6
View details for Web of Science ID 000087793500002
-
The digital Michelangelo project: 3D scanning of large statues
Computer Graphics Annual Conference
ASSOC COMPUTING MACHINERY. 2000: 131–144
View details for Web of Science ID 000165991100014
- Digitizing the Forma Urbis Romae Siggraph Digital Campfire on Computers and Archeology 2000
-
Fast texture synthesis using tree-structured vector quantization
Computer Graphics Annual Conference
ASSOC COMPUTING MACHINERY. 2000: 479–488
View details for Web of Science ID 000165991100054
-
QSplat: A multiresolution point rendering system for large meshes
Computer Graphics Annual Conference
ASSOC COMPUTING MACHINERY. 2000: 343–352
View details for Web of Science ID 000165991100038
-
The digital Michelangelo project
COMPUTER GRAPHICS FORUM
1999; 18 (3): XV-XVIII
View details for Web of Science ID 000082816100002
- A Volumetric Method for Building Complex Models from Range Images 1996
- Light Field Rendering 1996
- Fitting Smooth Surfaces to Dense Polygon Meshes 1996
-
Better optical triangulation through spacetime analysis
5th International Conference on Computer Vision
I E E E, COMPUTER SOC PRESS. 1995: 987–994
View details for Web of Science ID A1995BD71W00145
- Feature-Based Volume Metamorphosis 1995
- 3D Painting on Scanned Surfaces 1995
- Polygon-Assisted JPEG and MPEG Compression of Synthetic Images 1995
-
PARALLEL VISUALIZATION ALGORITHMS - PERFORMANCE AND ARCHITECTURAL IMPLICATIONS
COMPUTER
1994; 27 (7): 45-55
View details for Web of Science ID A1994NW99700015
- Zippered Polygon Meshes from Range Images 1994
- Spreadsheets for Images 1994
- Fast Volume Rendering Using a Shear-Warp Factorization of the Viewing Transformation 1994
- Frequency Domain Volume Rendering 1993
- Volume Rendering on Scalable Shared-Memory MIMD Architectures 1992
- Volume Rendering using the Fourier Projection-Slice Theorem 1992
- Efficient Ray Tracing of Volume Data ACM Transactions on Graphics 1990; 9 (3): 245-261
- A Hybrid Ray Tracer for Rendering Polygon and Volume Data IEEE Computer Graphics and Applications 1990; 10 (2): 33-40
- Volume Rendering in Radiation Treatment Planning 1990
- Volume Rendering by Adaptive Refinement The Visual Computer 1990; 6 (1): 2-7
- Gaze-Directed Volume Rendering 1990
- Display of Surfaces from Volume Data IEEE Computer Graphics and Applications 1988; 8 (3)
- The Use of Points as a Display Primitive UNC-Chapel Hill Computer Science Technical Report 1985: 85-022
- Area Flooding Algorithms SIGGRAPH 1981 Two-Dimensional Computer course notes. 1981
- Merging and Transformation of Raster Images for Cartoon Animation 1981
- Synthetic Texturing Using Digital Filters 1980
- A Color Animation System Based on the Multiplane Technique 1977