Bio


E.J. Chichilnisky is the John R. Adler Professor of Neurosurgery, and Professor of Ophthalmology, at Stanford University, where he has worked since 2013. Previously, he worked at the Salk Institute for Biological Studies for 15 years. He received his B.A. in Mathematics from Princeton University, and his M.S. in mathematics and Ph.D. in neuroscience from Stanford University. His research has focused on understanding the spatiotemporal patterns of electrical activity in the retina that convey visual information to the brain, and their origins in retinal circuitry, using large-scale multi-electrode recordings. His ongoing work now focuses on using basic science knowledge along with electrical stimulation to develop a novel high-fidelity artificial retina for treating incurable blindness.

Academic Appointments


Honors & Awards


  • Stein Innovation Award, Research to Prevent Blindness (2018)
  • Sayer Vision Research Award, Foundation for the National Institutes of Health (2014)
  • John R. Adler Endowed Chair, Department of Neurosurgery, Stanford University (2014)
  • Ralph & Becky O’Connor Endowed Chair, Salk Institute for Biological Studies (2012)
  • McKnight Technological Innovation in Neuroscience Award, McKnight Foundation (2004)
  • Basic Sciences Teaching Award, UCSD School of Medicine (2001)
  • McKnight Scholar’s Award, McKnight Foundation (2001)
  • Alfred P. Sloan Foundation Research Fellowship, Alfred P. Sloan Foundation (2000)

Professional Education


  • A.B., Princeton University, Mathematics (1985)
  • M.Sc., Stanford University, Mathematics (1992)
  • Ph.D., Stanford University, Neuroscience (1995)

Patents


  • B. Murmann, D. Muratore, E.J. Chichilnisky, P. Tandon. "United States Patent 2020082081 Data-compressive sensor array", Leland Stanford Junior University, Apr 23, 2020
  • G. Silva, M.L. Kraiche, G. Cauwenberghs, Y. Lo, W.R. Freeman, S. Ha, Jing Y, E.J. Chichilnisky. "United States Patent 10,603,493 Integrated nanowire array devices for detecting and/or applying electrical signals to tissue", University of California, San Diego, Oct 10, 2018
  • E.J. Chichilnisky, Martin Greschner, Lauren Jepson. "United States Patent US9990861B2 Smart prosthesis for facilitating artificial vision using scene abstraction", Pixium Vision SA, May 28, 2014
  • E.J. Chichilnisky, Lauren Jepson, Martin Greschner. "United States Patent US9452289B2 Method for identification of retinal cell types intrinsic properties", Pixium Vision SA, University of California, Salk Institute for Biological Studies, Mar 19, 2012
  • Robert J. Greenberg, Matthew J. McMahon, Chris Sekirnjak, E. J. Chichilnisky. "United States Patent US8712538B2 Method and apparatus for visual neural stimulation", Second Sight Medical Products Inc, Salk Institute for Biological Studies, May 27, 2010

Current Research and Scholarly Interests


The goal of our research is to develop an artificial retina -- an electronic implant that will restore vision to people blinded by retinal degeneration. We focus on a combination of basic and applied research to develop an implant that can reproduce the electrical signals that the retina normally transmits to the brain. To accomplish this goal, we work closely with collaborators in fields spanning neurophysiology, electrical engineering, materials science, retinal surgery, visual behavior, and computational neuroscience. This collaboration constitutes the Stanford Artificial Retina Project, funded in part by the Stanford Neurotechnology Initiative.

The design of the implant is based on knowledge acquired in our unique laboratory setting. We use large-scale multi-electrode recording from the retina to study normal light-evoked activity in hundreds of retinal ganglion cells of multiple types simultaneously, and then evoke similar patterns of activity by electrical stimulation. This approach provides a laboratory prototype for the artificial retina. We focus on several questions:

• what visual signals are transmitted by the diverse ganglion cell types to the brain?
• what computational models can accurately reproduce these diverse retinal signals?
• how can we precisely electrically stimulate retinal ganglion cells using an implant?
• how can retinal cell types be recognized and separately targeted by the implant?
• what are the constraints and algorithms for the electronic circuitry in the implant?
• how faithfully can the implant reproduce normal visual sensations in blind patients?

We anticipate that in addition to restoring vision, the artificial retina will allow us to transmit visual information to the brain in ways that are not possible with light stimulation, opening the door to visual augmentation -- creating visual sensations that were never before possible. It will also provide a unique and powerful research instrument for studying the diverse retinal pathways and how they contribute to vision. In the long run, our understanding of the retinal circuitry and how to interface to it effectively will be relevant for developing other interfaces to the brain – for treating disease, and for augmenting human capabilities.

Projects


  • retinal circuitry, Stanford University

    Using large-scale multi-electrode recordings to understand how the primate retinal transforms visual information and transmits it to the brain

    Location

    Stanford, CA

  • retinal prostheses, Stanford University

    using multi-electrode recording and stimulation to understand how electrical stimulation of the retina can be used to transmit artificial visual signals to the brain

    Location

    Stanford, CA

2023-24 Courses


Stanford Advisees


Graduate and Fellowship Programs


All Publications


  • Inferring light responses of primate retinal ganglion cells using intrinsic electrical signatures. Journal of neural engineering Zaidi, M., Aggarwal, G., Shah, N. P., Karniol-Tambour, O., Goetz, G., Madugula, S. S., Gogliettino, A., Wu, E. G., Kling, A., Brackbill, N., Sher, A., Litke, A. M., Chichilnisky, E. J. 2023

    Abstract

    Objective Retinal implants are designed to stimulate retinal ganglion cells (RGCs) in a way that restores sight to individuals blinded by photoreceptor degeneration. Reproducing high-acuity vision with these devices will likely require inferring the natural light responses of diverse RGC types in the implanted retina, without being able to measure them directly. Here we demonstrate an inference approach that exploits intrinsic electrophysiological features of primate RGCs. Approach First, ON-parasol and OFF-parasol RGC types were identified using their intrinsic electrical features in large-scale multi-electrode recordings from macaque retina. Then, the electrically inferred somatic location, inferred cell type, and average linear-nonlinear-Poisson model parameters of each cell type were used to infer a light response model for each cell. The accuracy of the cell type classification and of reproducing measured light responses with the model were evaluated. Main results A cell-type classifier trained on 246 large-scale multi-electrode recordings from 148 retinas achieved 95% mean accuracy on 29 test retinas. In five retinas tested, the inferred models achieved an average correlation with measured firing rates of 0.49 for white noise visual stimuli and 0.50 for natural scenes stimuli, compared to 0.65 and 0.58 respectively for models fitted to recorded light responses (an upper bound). Linear decoding of natural images from predicted RGC activity in one retina showed a mean correlation of 0.55 between decoded and true images, compared to an upper bound of 0.81 using models fitted to light response data. Significance These results suggest that inference of RGC light response properties from intrinsic features of their electrical activity may be a useful approach for high-fidelity sight restoration. The overall strategy of first inferring cell type from electrical features and then exploiting cell type to help infer natural cell function may also prove broadly useful to neural interfaces.

    View details for DOI 10.1088/1741-2552/ace657

    View details for PubMedID 37433293

  • Data Compression Versus Signal Fidelity Tradeoff in Wired-OR Analog-to-Digital Compressive Arrays for Neural Recording. IEEE transactions on biomedical circuits and systems Yan, P., Akhoundi, A., Shah, N. P., Tandon, P., Muratore, D. G., Chichilnisky, E. J., Murmann, B. 2023; PP

    Abstract

    Future high-density and high channel count neural interfaces that enable simultaneous recording of tens of thousands of neurons will provide a gateway to study, restore and augment neural functions. However, building such technology within the bit-rate limit and power budget of a fully implantable device is challenging. The wired-OR compressive readout architecture addresses the data deluge challenge of a high channel count neural interface using lossy compression at the analog-to-digital interface. In this paper, we assess the suitability of wired-OR for several steps that are important for neuroengineering, including spike detection, spike assignment and waveform estimation. For various wiring configurations of wired-OR and assumptions about the quality of the underlying signal, we characterize the trade-off between compression ratio and task-specific signal fidelity metrics. Using data from 18 large-scale microelectrode array recordings in macaque retina ex vivo, we find that for an event SNR of 7-10, wired-OR correctly detects and assigns at least 80% of the spikes with at least 50* compression. The wired-OR approach also robustly encodes action potential waveform information, enabling downstream processing such as cell -type classification. Finally, we show that by applying an LZ77-based lossless compressor (gzip) to the output of the wired-OR architecture, 1000* compression can be achieved over the baseline recordings.

    View details for DOI 10.1109/TBCAS.2023.3292058

    View details for PubMedID 37402181

  • Inference of Electrical Stimulation Sensitivity from Recorded Activity of Primate Retinal Ganglion Cells. The Journal of neuroscience : the official journal of the Society for Neuroscience Madugula, S. S., Vilkhu, R., Shah, N. P., Grosberg, L. E., Kling, A., Gogliettino, A. R., Nguyen, H., Hottowy, P., Sher, A., Litke, A. M., Chichilnisky, E. J. 2023

    Abstract

    High-fidelity electronic implants can in principle restore the function of neural circuits by precisely activating neurons via extracellular stimulation. However, direct characterization of the individual electrical sensitivity of a large population of target neurons, in order to precisely control their activity, can be difficult or impossible. A potential solution is to leverage biophysical principles to infer sensitivity to electrical stimulation from features of spontaneous electrical activity, which can be recorded relatively easily. Here, this approach is developed and its potential value for vision restoration is tested quantitatively using large-scale multi-electrode stimulation and recording from male and female macaque retinal ganglion cells (RGCs) ex vivo Electrodes recording larger spikes from a given cell exhibited lower stimulation thresholds across cell types, retinas, and eccentricities, with systematic and distinct trends for somas and axons. Thresholds for somatic stimulation increased with distance from the axon initial segment. The dependence of spike probability on injected current was inversely related to threshold, and was substantially steeper for axonal than somatic compartments, which could be identified by their recorded electrical signatures. Dendritic stimulation was largely ineffective for eliciting spikes. These trends were quantitatively reproduced with biophysical simulations. Results from human RGCs were broadly consistent. The inference of stimulation sensitivity from recorded electrical features was tested in a data-driven simulation of visual reconstruction, revealing that the approach could significantly improve the function of future high-fidelity retinal implants.Significance Statement:This study demonstrates that individual in situ primate retinal ganglion cells of different types respond to artificially generated, external electrical fields in a systematic manner, in accordance with theoretical predictions, that allows for prediction of electrical stimulus sensitivity from recorded spontaneous activity. It also provides evidence that such an approach could be immensely helpful in the calibration of clinical retinal implants.

    View details for DOI 10.1523/JNEUROSCI.1023-22.2023

    View details for PubMedID 37268418

  • High-fidelity reproduction of visual signals by electrical stimulation in the central primate retina. The Journal of neuroscience : the official journal of the Society for Neuroscience Gogliettino, A. R., Madugula, S. S., Grosberg, L. E., Vilkhu, R. S., Brown, J., Nguyen, H., Kling, A., Hottowy, P., Dąbrowski, W., Sher, A., Litke, A. M., Chichilnisky, E. J. 2023

    Abstract

    Electrical stimulation of retinal ganglion cells (RGCs) with electronic implants provides rudimentary artificial vision to people blinded by retinal degeneration. However, current devices stimulate indiscriminately and therefore cannot reproduce the intricate neural code of the retina. Recent work has demonstrated more precise activation of RGCs using focal electrical stimulation with multi-electrode arrays in the peripheral macaque retina, but it is unclear how effective this can be in the central retina, which is required for high-resolution vision. This work probes the neural code and effectiveness of focal epiretinal stimulation in the central macaque retina, using large-scale electrical recording and stimulation ex vivo The functional organization, light response properties, and electrical properties of the major RGC types in the central retina were mostly similar to the peripheral retina, with some notable differences in density, kinetics, linearity, spiking statistics and correlations. The major RGC types could be distinguished by their intrinsic electrical properties. Electrical stimulation targeting parasol cells revealed similar activation thresholds and reduced axon bundle activation in the central retina, but lower stimulation selectivity. Quantitative evaluation of the potential for image reconstruction from electrically-evoked parasol cell signals revealed higher overall expected image quality in the central retina. An exploration of inadvertent midget cell activation suggested that it could contribute high spatial frequency noise to the visual signal carried by parasol cells. These results support the possibility of reproducing high-acuity visual signals in the central retina with an epiretinal implant.SIGNIFICANCE STATEMENT:Artificial restoration of vision with retinal implants is a major treatment for blindness. However, present-day implants do not provide high-resolution visual perception, in part because they do not reproduce the natural neural code of the retina. Here we demonstrate the level of visual signal reproduction that is possible with a future implant by examining how accurately responses to electrical stimulation of parasol retinal ganglion cells (RGCs) can convey visual signals. Although the precision of electrical stimulation in the central retina was diminished relative to the peripheral retina, the quality of expected visual signal reconstruction in parasol cells was greater. These findings suggest that visual signals could be restored with high fidelity in the central retina using a future retinal implant.

    View details for DOI 10.1523/JNEUROSCI.1091-22.2023

    View details for PubMedID 37188516

  • Focal electrical stimulation of human retinal ganglion cells for vision restoration. Journal of neural engineering Madugula, S. S., Gogliettino, A. R., Zaidi, M., Aggarwal, G., Kling, A., Shah, N. P., Brown, J. B., Vilkhu, R., Hays, M. R., Nguyen, H., Fan, V., Wu, E. G., Hottowy, P., Sher, A., Litke, A. M., Silva, R. A., Chichilnisky, E. J. 2022; 19 (6)

    Abstract

    Objective. Vision restoration with retinal implants is limited by indiscriminate simultaneous activation of many cells and cell types, which is incompatible with reproducing the neural code of the retina. Recent work has shown that primate retinal ganglion cells (RGCs), which transmit visual information to the brain, can be directly electrically activated with single-cell, single-spike, cell-type precision - however, this possibility has never been tested in the human retina. In this study we aim to characterize, for the first time, direct in situ extracellular electrical stimulation of individual human RGCs.Approach. Extracellular electrical stimulation of individual human RGCs was conducted in three human retinas ex vivo using a custom large-scale, multi-electrode array capable of simultaneous recording and stimulation. Measured activation properties were compared directly to extensive results from macaque.Main results. Precise activation was in many cases possible without activating overlying axon bundles, at low stimulation current levels similar to those used in macaque. The major RGC types could be identified and targeted based on their distinctive electrical signatures. The measured electrical activation properties of RGCs, combined with a dynamic stimulation algorithm, was sufficient to produce an evoked visual signal that was nearly optimal given the constraints of the interface.Significance. These results suggest the possibility of high-fidelity vision restoration in humans using bi-directional epiretinal implants.

    View details for DOI 10.1088/1741-2552/aca5b5

    View details for PubMedID 36533865

  • An RF-Ultrasound Relay for Adaptive Wireless Powering Across Tissue Interfaces. IEEE journal of solid-state circuits So, E., Yeon, P., Chichilnisky, E. J., Arbabian, A. 2022; 57 (11): 3429-3441

    Abstract

    Single modality wireless power transfer has limited depth for mm-sized implants across air / tissue or skull / tissue interfaces because they either suffer from high loss in tissue (RF, Optical) or high reflection at the medium interface (Ultrasound (US)). This paper proposes an RF-US relay chip at the media interface avoiding the reflection at the boundary, and enabling efficient wireless powering to mm-sized deep implants across multiple media. The relay chip rectifies the incoming RF power through an 85.5% efficient RF inductive link (across air) using a multi-output regulating rectifier (MORR) with 81% power conversion efficiency (PCE) at 186 mW load, and transmits ultrasound using adiabatic power amplifiers (PAs) to the implant in order to minimize cascaded power loss. To adapt the US focus to implant movement or placement, beamforming was implemented using 6 channels of US PAs with 2-bit phase control (0, 90, 180, and 270°) and 3 different amplitudes (6-29, 4.5, and 1.8 V) from the MORR. The adiabatic PA contributes a 30-40% increase in efficiency over class-D and beamforming increases the efficiency by 251% at 2.5 cm over fixed focusing. The proof-of-concept powering system for a retinal implant, from an external PA on a pair of glasses to a hydrophone with 1.2 cm (air) + 2.9 cm (agar eyeball phantom in mineral oil) separation distance, had a power delivered to the load (PDL) of 946 μW. The 2.3 × 2 mm2 relay chip was fabricated in a 180 nm high-voltage (HV) BCD process.

    View details for DOI 10.1109/jssc.2022.3171233

    View details for PubMedID 37138581

    View details for PubMedCentralID PMC10153624

  • Automated identification of ganglion and amacrine cell types in a large primate retina dataset Cooler, S., Kling, A., Wu, E., Rhoades, C., Brackbill, N., Sher, A., Litke, A., Chichilnisky, E. ASSOC RESEARCH VISION OPHTHALMOLOGY INC. 2022
  • Unusual properties of novel ganglion cell and amacrine cell types in macaque and human retina Kling, A., Wu, E., Cooler, S., Rhoades, C., Brackbill, N., Litke, A., Sher, A., Chichilnisky, E. J. ASSOC RESEARCH VISION OPHTHALMOLOGY INC. 2022
  • An RF-Ultrasound Relay for Adaptive Wireless Powering Across Tissue Interfaces IEEE JOURNAL OF SOLID-STATE CIRCUITS So, E., Yeon, P., Chichilnisky, E. J., Arbabian, A. 2022
  • Individual variability of neural computations in the primate retina. Neuron Shah, N. P., Brackbill, N., Samarakoon, R., Rhoades, C., Kling, A., Sher, A., Litke, A., Singer, Y., Shlens, J., Chichilnisky, E. J. 1800

    Abstract

    Variation in the neural code contributes to making each individual unique. We probed neural code variation using 100 population recordings from major ganglion cell types in the macaque retina, combined with an interpretable computational representation of individual variability. This representation captured variation and covariation in properties such as nonlinearity, temporal dynamics, and spatial receptive field size and preserved invariances such as asymmetries between On and Off cells. The covariation of response properties in different cell types was associated with the proximity of lamination of their synaptic input. Surprisingly, male retinas exhibited higher firing rates and faster temporal integration than female retinas. Exploiting data from previously recorded retinas enabled efficient characterization of a new macaque retina, and of a human retina. Simulations indicated that combining a large dataset of retinal recordings with behavioral feedback could reveal the neural code in a living human and thus improve vision restoration with retinal implants.

    View details for DOI 10.1016/j.neuron.2021.11.026

    View details for PubMedID 34932942

  • Nonlinear Decoding of Natural Images From Large-Scale Primate Retinal Ganglion Recordings NEURAL COMPUTATION Kim, Y., Brackbill, N., Batty, E., Lee, J., Mitelut, C., Tong, W., Chichilnisky, E. J., Paninski, L. 2021; 33 (7): 1719-1750
  • Nonlinear Decoding of Natural Images From Large-Scale Primate Retinal Ganglion Recordings. Neural computation Kim, Y. J., Brackbill, N., Batty, E., Lee, J., Mitelut, C., Tong, W., Chichilnisky, E. J., Paninski, L. 2021; 33 (7): 1719-1750

    Abstract

    Decoding sensory stimuli from neural activity can provide insight into how the nervous system might interpret the physical environment, and facilitates the development of brain-machine interfaces. Nevertheless, the neural decoding problem remains a significant open challenge. Here, we present an efficient nonlinear decoding approach for inferring natural scene stimuli from the spiking activities of retinal ganglion cells (RGCs). Our approach uses neural networks to improve on existing decoders in both accuracy and scalability. Trained and validated on real retinal spike data from more than 1000 simultaneously recorded macaque RGC units, the decoder demonstrates the necessity of nonlinear computations for accurate decoding of the fine structures of visual stimuli. Specifically, high-pass spatial features of natural images can only be decoded using nonlinear techniques, while low-pass features can be extracted equally well by linear and nonlinear methods. Together, these results advance the state of the art in decoding natural stimuli from large populations of neurons.

    View details for DOI 10.1162/neco_a_01395

    View details for PubMedID 34411268

  • Spatially Patterned Bi-electrode Epiretinal Stimulation for Axon Avoidance at Cellular Resolution. Journal of neural engineering Vilkhu, R. S., Madugula, S. S., Grosberg, L. E., Gogliettino, A. R., Hottowy, P., Dabrowski, W., Sher, A., Litke, A. M., Mitra, S., Chichilnisky, E. J. 2021

    Abstract

    Epiretinal prostheses are designed to restore vision to people blinded by photoreceptor degenerative diseases by stimulating surviving retinal ganglion cells (RGCs), which carry visual signals to the brain. However, inadvertent stimulation of RGCs at their axons can result in non-focal visual percepts, limiting the quality of artificial vision. Theoretical work has suggested that axon activation can be avoided with current stimulation designed to minimize the second spatial derivative of the induced extracellular voltage along the axon. However, this approach has not been verified experimentally at the resolution of single cells.In this work, a custom multi-electrode array (512 electrodes, 10 μm diameter, 60 μm pitch) was used to stimulate and record RGCs in macaque retina ex vivo at single-cell, single-spike resolution. RGC activation thresholds resulting from bi-electrode stimulation, which consisted of bipolar currents simultaneously delivered through two electrodes straddling an axon, were compared to activation thresholds from traditional single-electrode stimulation.On average, across three retinal preparations, the bi-electrode stimulation strategy reduced somatic activation thresholds (~21%) while increasing axonal activation thresholds (~14%), thus favoring selective somatic activation. Furthermore, individual examples revealed rescued selective activation of somas that was not possible with any individual electrode.This work suggests that a bi-electrode epiretinal stimulation strategy can reduce inadvertent axonal activation at cellular resolution, for high-fidelity artificial vision.

    View details for DOI 10.1088/1741-2552/ac3450

    View details for PubMedID 34710857

  • Automatic Identification of Axon Bundle Activation for Epiretinal Prosthesis IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING Tandon, P., Bhaskhar, N., Shah, N., Madugula, S., Grosberg, L., Fan, V. H., Hottowy, P., Sher, A., Litke, A. M., Chichilnisky, E. J., Mitra, S. 2021; 29: 2496-2502

    Abstract

    Retinal prostheses must be able to activate cells in a selective way in order to restore high-fidelity vision. However, inadvertent activation of far-away retinal ganglion cells (RGCs) through electrical stimulation of axon bundles can produce irregular and poorly controlled percepts, limiting artificial vision. In this work, we aim to provide an algorithmic solution to the problem of detecting axon bundle activation with a bi-directional epiretinal prostheses.The algorithm utilizes electrical recordings to determine the stimulation current amplitudes above which axon bundle activation occurs. Bundle activation is defined as the axonal stimulation of RGCs with unknown soma and receptive field locations, typically beyond the electrode array. The method exploits spatiotemporal characteristics of electrically-evoked spikes to overcome the challenge of detecting small axonal spikes.The algorithm was validated using large-scale, single-electrode and short pulse, ex vivo stimulation and recording experiments in macaque retina, by comparing algorithmically and manually identified bundle activation thresholds. For 88% of the electrodes analyzed, the threshold identified by the algorithm was within ±10% of the manually identified threshold, with a correlation coefficient of 0.95.This works presents a simple, accurate and efficient algorithm to detect axon bundle activation in epiretinal prostheses.The algorithm could be used in a closed-loop manner by a future epiretinal prosthesis to reduce poorly controlled visual percepts associated with bundle activation. Activation of distant cells via axonal stimulation will likely occur in other types of retinal implants and cortical implants, and the method may therefore be broadly applicable.

    View details for DOI 10.1109/TNSRE.2021.3128486

    View details for Web of Science ID 000730473200002

    View details for PubMedID 34784278

  • Computational challenges and opportunities for a bi-directional artificial retina. Journal of neural engineering Shah, N. P., Chichilnisky, E. J. 2020; 17 (5): 055002

    Abstract

    A future artificial retina that can restore high acuity vision in blind people will rely on the capability to both read (observe) and write (control) the spiking activity of neurons using an adaptive, bi-directional and high-resolution device. Although current research is focused on overcoming the technical challenges of building and implanting such a device, exploiting its capabilities to achieve more acute visual perception will also require substantial computational advances. Using high-density large-scale recording and stimulation in the primate retina with an ex vivo multi-electrode array lab prototype, we frame several of the major computational problems, and describe current progress and future opportunities in solving them. First, we identify cell types and locations from spontaneous activity in the blind retina, and then efficiently estimate their visual response properties by using a low-dimensional manifold of inter-retina variability learned from a large experimental dataset. Second, we estimate retinal responses to a large collection of relevant electrical stimuli by passing current patterns through an electrode array, spike sorting the resulting recordings and using the results to develop a model of evoked responses. Third, we reproduce the desired responses for a given visual target by temporally dithering a diverse collection of electrical stimuli within the integration time of the visual system. Together, these novel approaches may substantially enhance artificial vision in a next-generation device.

    View details for DOI 10.1088/1741-2552/aba8b1

    View details for PubMedID 33089827

  • Inference of nonlinear receptive field subunits with spike-triggered clustering. eLife Shah, N. P., Brackbill, N., Rhoades, C., Kling, A., Goetz, G., Litke, A. M., Sher, A., Simoncelli, E., Chichilnisky, E. J. 2020; 9

    Abstract

    Responses of sensory neurons are often modeled using a weighted combination of rectified linear subunits. Since these subunits often cannot be measured directly, a flexible method is needed to infer their properties from the responses of downstream neurons. We present a method for maximum likelihood estimation of subunits by soft-clustering spike-triggered stimuli, and demonstrate its effectiveness in visual neurons. For parasol retinal ganglion cells in macaque retina, estimated subunits partitioned the receptive field into compact regions, likely representing aggregated bipolar cell inputs. Joint clustering revealed shared subunits between neighboring cells, producing a parsimonious population model. Closed-loop validation, using stimuli lying in the null space of the linear receptive field, revealed stronger nonlinearities in OFF cells than ON cells. Responses to natural images, jittered to emulate fixational eye movements, were accurately predicted by the subunit model. Finally, the generality of the approach was demonstrated in macaque V1 neurons.

    View details for DOI 10.7554/eLife.45743

    View details for PubMedID 32149600

  • Reconstruction of natural images from responses of primate retinal ganglion cells. eLife Brackbill, N. n., Rhoades, C. n., Kling, A. n., Shah, N. P., Sher, A. n., Litke, A. M., Chichilnisky, E. J. 2020; 9

    Abstract

    The visual message conveyed by a retinal ganglion cell (RGC) is often summarized by its spatial receptive field, but in principle also depends on the responses of other RGCs and natural image statistics. This possibility was explored by linear reconstruction of natural images from responses of the four numerically-dominant macaque RGC types. Reconstructions were highly consistent across retinas. The optimal reconstruction filter for each RGC - its visual message - reflected natural image statistics, and resembled the receptive field only when nearby, same-type cells were included. ON and OFF cells conveyed largely independent, complementary representations, and parasol and midget cells conveyed distinct features. Correlated activity and nonlinearities had statistically significant but minor effects on reconstruction. Simulated reconstructions, using linear-nonlinear cascade models of RGC light responses that incorporated measured spatial properties and nonlinearities, produced similar results. Spatiotemporal reconstructions exhibited similar spatial properties, suggesting that the results are relevant for natural vision.

    View details for DOI 10.7554/eLife.58516

    View details for PubMedID 33146609

  • Massively parallel microwire arrays integrated with CMOS chips for neural recording. Science advances Obaid, A. n., Hanna, M. E., Wu, Y. W., Kollo, M. n., Racz, R. n., Angle, M. R., Müller, J. n., Brackbill, N. n., Wray, W. n., Franke, F. n., Chichilnisky, E. J., Hierlemann, A. n., Ding, J. B., Schaefer, A. T., Melosh, N. A. 2020; 6 (12): eaay2789

    Abstract

    Multi-channel electrical recordings of neural activity in the brain is an increasingly powerful method revealing new aspects of neural communication, computation, and prosthetics. However, while planar silicon-based CMOS devices in conventional electronics scale rapidly, neural interface devices have not kept pace. Here, we present a new strategy to interface silicon-based chips with three-dimensional microwire arrays, providing the link between rapidly-developing electronics and high density neural interfaces. The system consists of a bundle of microwires mated to large-scale microelectrode arrays, such as camera chips. This system has excellent recording performance, demonstrated via single unit and local-field potential recordings in isolated retina and in the motor cortex or striatum of awake moving mice. The modular design enables a variety of microwire types and sizes to be integrated with different types of pixel arrays, connecting the rapid progress of commercial multiplexing, digitisation and data acquisition hardware together with a three-dimensional neural interface.

    View details for DOI 10.1126/sciadv.aay2789

    View details for PubMedID 32219158

    View details for PubMedCentralID PMC7083623

  • A Data-Compressive Wired-OR Readout for Massively Parallel Neural Recording Muratore, D., Tandon, P., Wootters, M., Chichilnisky, E. J., Mitra, S., Murmann, B. IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC. 2019: 1128–40

    Abstract

    Neural interfaces of the future will be used to help restore lost sensory, motor, and other capabilities. However, realizing this futuristic promise requires a major leap forward in how electronic devices interface with the nervous system. Next generation neural interfaces must support parallel recording from tens of thousands of electrodes within the form factor and power budget of a fully implanted device, posing a number of significant engineering challenges. In this paper, we exploit sparsity and diversity of neural signals to achieve simultaneous data compression and channel multiplexing for neural recordings. The architecture uses wired-OR interactions within an array of single-slope A/D converters to obtain massively parallel digitization of neural action potentials. The achieved compression is lossy but effective at retaining the critical samples belonging to action potentials, enabling efficient spike sorting and cell type identification. Simulation results of the architecture using data obtained from primate retina ex-vivo with a 512-channel electrode array show average compression rates up to  ∼ 40× while missing less than 5% of cells. In principle, the techniques presented here could be used to design interfaces to other parts of the nervous system.

    View details for DOI 10.1109/TBCAS.2019.2935468

    View details for Web of Science ID 000507321400002

    View details for PubMedID 31425051

  • Unusual Physiological Properties of Smooth Monostratified Ganglion Cell Types in Primate Retina. Neuron Rhoades, C. E., Shah, N. P., Manookin, M. B., Brackbill, N., Kling, A., Goetz, G., Sher, A., Litke, A. M., Chichilnisky, E. J. 2019

    Abstract

    The functions of the diverse retinal ganglion cell types in primates and the parallel visual pathways they initiate remain poorly understood. Here, unusual physiological and computational properties of the ON and OFF smooth monostratified ganglion cells are explored. Large-scale multi-electrode recordings from 48 macaque retinas revealed that these cells exhibit irregular receptive field structure composed of spatially segregated hotspots, quite different from the classic center-surround model of retinal receptive fields. Surprisingly, visual stimulation of different hotspots in the same cell produced spikes with subtly different spatiotemporal voltage signatures, consistent with a dendritic contribution to hotspot structure. Targeted visual stimulation and computational inference demonstrated strong nonlinear subunit properties associated with each hotspot, supporting a model in which the hotspots apply nonlinearities at a larger spatial scale than bipolar cells. These findings reveal a previously unreported nonlinear mechanism in the output of the primate retina that contributes to signaling spatial information.

    View details for DOI 10.1016/j.neuron.2019.05.036

    View details for PubMedID 31227309

  • Simulation of visual perception and learning with a retinal prosthesis JOURNAL OF NEURAL ENGINEERING Golden, J. R., Erickson-Davis, C., Cottaris, N. P., Parthasarathy, N., Rieke, F., Brainard, D. H., Wandell, B. A., Chichilnisky, E. J. 2019; 16 (2)
  • Epiretinal stimulation with local returns enhances selectivity at cellular resolution JOURNAL OF NEURAL ENGINEERING Fan, V. H., Grosberg, L. E., Madugula, S. S., Hottowy, P., Dabrowski, W., Sher, A., Litke, A. M., Chichilnisky, E. J. 2019; 16 (2)
  • Probing Computation in the Primate Visual System at Single-Cone Resolution. Annual review of neuroscience Kling, A., Field, G. D., Brainard, D. H., Chichilnisky, E. J. 2019

    Abstract

    Daylight vision begins when light activates cone photoreceptors in the retina, creating spatial patterns of neural activity. These cone signals are then combined and processed in downstream neural circuits, ultimately producing visual perception. Recent technical advances have made it possible to deliver visual stimuli to the retina that probe this processing by the visual system at its elementary resolution of individual cones. Physiological recordings from nonhuman primate retinas reveal the spatial organization of cone signals in retinal ganglion cells, including how signals from cones of different types are combined to support both spatial and color vision. Psychophysical experiments with human subjects characterize the visual sensations evoked by stimulating a single cone, including the perception of color. Future combined physiological and psychophysical experiments focusing on probing the elementary visual inputs are likely to clarify how neural processing generates our perception of the visual world. Expected final online publication date for the Annual Review of Neuroscience Volume 42 is July 8, 2019. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

    View details for PubMedID 30857477

  • Optimization of Electrical Stimulation for a High-Fidelity Artificial Retina Shah, N. P., Madugula, S., Grosberg, L., Mena, G., Tandon, P., Hottowy, P., Sher, A., Litke, A., Mitra, S., Chichilnisky, E. J., IEEE IEEE. 2019: 714–18
  • A Data-Compressive Wired-OR Readout for Massively Parallel Neural Recording Muratore, D. G., Tandon, P., Wootters, M., Chichilnisky, E. J., Mitra, S., Murmann, B., IEEE IEEE. 2019
  • Probing Computation in the Primate Visual System at Single-Cone Resolution ANNUAL REVIEW OF NEUROSCIENCE, VOL 42 Kling, A., Field, G. D., Brainard, D. H., Chichilnisky, E. J., Roska, B., Zoghbi, H. Y. 2019; 42: 169–86
  • Efficient characterization of electrically evoked responses for neural interfaces Shah, N. P., Madugula, S., Hottowy, P., Sher, A., Litke, A., Paninski, L., Chichilnisky, E. J., Wallach, H., Larochelle, H., Beygelzimer, A., d'Alche-Buc, F., Fox, E., Garnett, R. NEURAL INFORMATION PROCESSING SYSTEMS (NIPS). 2019
  • Temporal resolution of single-photon responses in primate rod photoreceptors and limits imposed by cellular noise JOURNAL OF NEUROPHYSIOLOGY Field, G. D., Uzzell, V., Chichilnisky, E. J., Rieke, F. 2019; 121 (1): 255–68
  • Temporal resolution of single photon responses in primate rod photoreceptors and limits imposed by cellular noise. Journal of neurophysiology Field, G. D., Uzzell, V., Chichilnisky, E. J., Rieke, F. 2018

    Abstract

    Sensory receptor noise corrupts sensory signals, contributing to imperfect perception and dictating central processing strategies. For example, noise in rod phototransduction limits our ability to detect light and minimizing the impact of this noise requires precisely tuned nonlinear processing by the retina. But detection sensitivity is only one aspect of night vision: prompt and accurate behavior also requires that rods reliably encode the timing of photon arrivals. We show here that the temporal resolution of responses of primate rods is much finer than the duration of the light response and identify the key limiting sources of transduction noise. We also find that the thermal activation rate of rhodopsin is lower than previous estimates, implying that other noise sources are more important than previously appreciated. A model of rod single-photon responses reveals that the limiting noise relevant for behavior depends critically on how rod signals are pooled by downstream neurons.

    View details for PubMedID 30485153

  • Simulation of visual perception and learning with a retinal prosthesis. Journal of neural engineering Golden, J. R., Erickson-Davis, C., Cottaris, N. P., Parthasarathy, N., Rieke, F., Brainard, D., Wandell, B., Chichilnisky, E. J. 2018

    Abstract

    The nature of artificial vision with a retinal prosthesis, and the degree to which the brain can adapt to the unnatural input from such a device, are poorly understood. Therefore, the development of current and future devices may be aided by theory and simulations that help to infer and understand what prosthesis patients see. A biologically-informed, extensible computational framework is presented here to predict visual perception and the potential effect of learning with a subretinal prosthesis. The framework relies on linear reconstruction of the stimulus from retinal responses to infer the visual information available to the patient. A simulation of the physiological optics of the eye and light responses of the major retinal neurons was used to calculate the optimal linear transformation for reconstructing natural images from retinal activity. The result was then used to reconstruct the visual stimulus during the artificial activation expected from a subretinal prosthesis in a degenerated retina, as a proxy for inferred visual perception. Several simple observations reveal the potential utility of such a simulation framework. The inferred perception obtained with prosthesis activation was substantially degraded compared to the inferred perception obtained with normal retinal responses, as expected given the limited resolution and lack of cell type specificity of the prosthesis. Consistent with clinical findings and the importance of cell type specificity, reconstruction using only ON cells, and not OFF cells, was substantially more accurate. Finally, when reconstruction was re-optimized for prosthesis stimulation, simulating idealized learning by the patient, the accuracy of inferred perception was much closer to that of healthy vision. The reconstruction approach thus provides a more complete method for exploring the potential for treating blindness with retinal prostheses than has been available previously. It may also be useful for interpreting patient data in clinical trials, and for improving prosthesis design.

    View details for PubMedID 30523985

  • Epiretinal stimulation with local returns enhances selectivity at cellular resolution. Journal of neural engineering Fan, V. H., Grosberg, L. E., Madugula, S. S., Hottowy, P., Dabrowski, W., Sher, A., Litke, A. M., Chichilnisky, E. J. 2018

    Abstract

    OBJECTIVE: Epiretinal prostheses are designed to restore vision in people blinded by photoreceptor degenerative diseases, by directly activating retinal ganglion cells (RGCs) using an electrode array implanted on the retina. In present-day clinical devices, current spread from the stimulating electrode to a distant return electrode often results in the activation of many cells, potentially limiting the quality of artificial vision. In the laboratory, epiretinal activation of RGCs with cellular resolution has been demonstrated with small electrodes, but distant returns may still cause undesirable current spread. Here, the ability of local return stimulation to improve the selective activation of RGCs at cellular resolution was evaluated. Approach: A custom multi-electrode array (512 electrodes, 10 mum diameter, 60 mum pitch) was used to simultaneously stimulate and record from RGCs in isolated primate retina. Stimulation near the RGC soma with a single electrode and a distant return was compared to stimulation in which the return was provided by six neighboring electrodes. Main Results: Local return stimulation enhanced the capability to activate cells near the central electrode (<30 m) while avoiding cells farther away (>30 m). This resulted in an improved ability to selectively activate ON and OFF cells, including cells encoding immediately adjacent regions in the visual field. Significance: These results suggest that a device that restricts the electric field through local returns could optimize activation of neurons at cellular resolution, improving the quality of artificial vision.

    View details for PubMedID 30523958

  • Pathway-Specific Asymmetries between ON and OFF Visual Signals JOURNAL OF NEUROSCIENCE Ravi, S., Ahn, D., Greschner, M., Chichilnisky, E. J., Field, G. D. 2018; 38 (45): 9728–40

    Abstract

    Visual processing is largely organized into ON and OFF pathways that signal stimulus increments and decrements, respectively. These pathways exhibit natural pairings based on morphological and physiological similarities, such as ON and OFF α-ganglion cells in the mammalian retina. Several studies have noted asymmetries in the properties of ON and OFF pathways. For example, the spatial receptive fields (RFs) of OFF α-cells are systematically smaller than ON α-cells. Analysis of natural scenes suggests that these asymmetries are optimal for visual encoding. To test the generality of ON/OFF asymmetries, we measured the spatiotemporal RF properties of multiple RGC types in rat retina. Through a quantitative and serial classification, we identified three functional pairs of ON and OFF RGCs. We analyzed the structure of their RFs and compared spatial integration, temporal integration, and gain across ON and OFF pairs. Similar to previous results from the cat and primate, RGC types with larger spatial RFs exhibited briefer temporal integration and higher gain. However, each pair of ON and OFF RGC types exhibited distinct asymmetric relationships between RF properties, some of which were opposite to the findings of previous reports. These results reveal the functional organization of six RGC types in the rodent retina and indicate that ON/OFF asymmetries are pathway specific.SIGNIFICANCE STATEMENT Circuits that process sensory input frequently process increments separately from decrements, so-called ON and OFF responses. Theoretical studies indicate that this separation, and associated asymmetries in ON and OFF pathways, may be beneficial for encoding natural stimuli. However, the generality of ON and OFF pathway asymmetries has not been tested. Here we compare the functional properties of three distinct pairs of ON and OFF pathways in the rodent retina and show that their asymmetries are pathway specific. These results provide a new view on the partitioning of vision across diverse ON and OFF signaling pathways.

    View details for PubMedID 30249795

  • Electrical stimulus artifact cancellation and neural spike detection on large multi-electrode arrays PLOS COMPUTATIONAL BIOLOGY Mena, G. E., Grosberg, L. E., Madugula, S., Hottowy, P., Litke, A., Cunningham, J., Chichilnisky, E. J., Paninski, L. 2017; 13 (11): e1005842

    Abstract

    Simultaneous electrical stimulation and recording using multi-electrode arrays can provide a valuable technique for studying circuit connectivity and engineering neural interfaces. However, interpreting these measurements is challenging because the spike sorting process (identifying and segregating action potentials arising from different neurons) is greatly complicated by electrical stimulation artifacts across the array, which can exhibit complex and nonlinear waveforms, and overlap temporarily with evoked spikes. Here we develop a scalable algorithm based on a structured Gaussian Process model to estimate the artifact and identify evoked spikes. The effectiveness of our methods is demonstrated in both real and simulated 512-electrode recordings in the peripheral primate retina with single-electrode and several types of multi-electrode stimulation. We establish small error rates in the identification of evoked spikes, with a computational complexity that is compatible with real-time data analysis. This technology may be helpful in the design of future high-resolution sensory prostheses based on tailored stimulation (e.g., retinal prostheses), and for closed-loop neural stimulation at a much larger scale than currently possible.

    View details for PubMedID 29131818

    View details for PubMedCentralID PMC5703587

  • Activation of ganglion cells and axon bundles using epiretinal electrical stimulation. Journal of neurophysiology Grosberg, L. E., Ganesan, K., Goetz, G. A., Madugula, S. S., Bhaskhar, N., Fan, V., Li, P., Hottowy, P., Dabrowski, W., Sher, A., Litke, A. M., Mitra, S., Chichilnisky, E. J. 2017: jn 00750 2016-?

    Abstract

    Epiretinal prostheses for treating blindness activate axon bundles, causing large, arc-shaped visual percepts that limit the quality of artificial vision. Improving the function of epiretinal prostheses therefore requires understanding and avoiding axon bundle activation. This paper introduces a method to detect axon bundle activation based on its electrical signature, and uses the method to test whether epiretinal stimulation can directly elicit spikes in individual retinal ganglion cells without activating nearby axon bundles. Combined electrical stimulation and recording from isolated primate retina were performed using a custom multi-electrode system (512 electrodes, 10 μm diameter, 60 μm pitch). Axon bundle signals were identified by their bi-directional propagation, speed, and increasing amplitude as a function of stimulation current. The threshold for bundle activation varied across electrodes and retinas, and was in the same range as the threshold for activating retinal ganglion cells near their somas. In the peripheral retina, 45% of electrodes that activated individual ganglion cells (17% of all electrodes) did so without activating bundles. This permitted selective activation of 21% of recorded ganglion cells (7% of all ganglion cells) over the array. In the central retina, 75% of electrodes that activated individual ganglion cells (16% of all electrodes) did so without activating bundles. The ability to selectively activate a subset of retinal ganglion cells without axon bundles suggests a possible novel architecture for future epiretinal prostheses.

    View details for DOI 10.1152/jn.00750.2016

    View details for PubMedID 28566464

  • YASS: Yet Another Spike Sorter Lee, J., Carlson, D., Shokri, H., Yao, W., Goetz, G., Hagen, E., Batty, E., Chichilnisky, E. J., Einevoll, G., Paninski, L., Guyon, Luxburg, U. V., Bengio, S., Wallach, H., Fergus, R., Vishwanathan, S., Garnett, R. NEURAL INFORMATION PROCESSING SYSTEMS (NIPS). 2017
  • Neural Networks for Efficient Bayesian Decoding of Natural Images from Retinal Neurons Parthasarathy, N., Batty, E., Falcon, W., Rutten, T., Rajpal, M., Chichilnisky, E. J., Paninski, L., Guyon, Luxburg, U. V., Bengio, S., Wallach, H., Fergus, R., Vishwanathan, S., Garnett, R. NEURAL INFORMATION PROCESSING SYSTEMS (NIPS). 2017
  • Identification of a Retinal Circuit for Recurrent Suppression Using Indirect Electrical Imaging. Current biology Greschner, M., Heitman, A. K., Field, G. D., Li, P. H., Ahn, D., Sher, A., Litke, A. M., Chichilnisky, E. J. 2016; 26 (15): 1935-1942

    Abstract

    Understanding the function of modulatory interneuron networks is a major challenge, because such networks typically operate over long spatial scales and involve many neurons of different types. Here, we use an indirect electrical imaging method to reveal the function of a spatially extended, recurrent retinal circuit composed of two cell types. This recurrent circuit produces peripheral response suppression of early visual signals in the primate magnocellular visual pathway. We identify a type of polyaxonal amacrine cell physiologically via its distinctive electrical signature, revealed by electrical coupling with ON parasol retinal ganglion cells recorded using a large-scale multi-electrode array. Coupling causes the amacrine cells to fire spikes that propagate radially over long distances, producing GABA-ergic inhibition of other ON parasol cells recorded near the amacrine cell axonal projections. We propose and test a model for the function of this amacrine cell type, in which the extra-classical receptive field of ON parasol cells is formed by reciprocal inhibition from other ON parasol cells in the periphery, via the electrically coupled amacrine cell network.

    View details for DOI 10.1016/j.cub.2016.05.051

    View details for PubMedID 27397894

  • Anatomical Identification of Extracellularly Recorded Cells in Large-Scale Multielectrode Recordings JOURNAL OF NEUROSCIENCE Li, P. H., Gauthier, J. L., Schiff, M., Sher, A., Ahn, D., Field, G. D., Greschner, M., Callaway, E. M., Litke, A. M., Chichilnisky, E. J. 2015; 35 (11): 4663-4675

    Abstract

    This study combines for the first time two major approaches to understanding the function and structure of neural circuits: large-scale multielectrode recordings, and confocal imaging of labeled neurons. To achieve this end, we develop a novel approach to the central problem of anatomically identifying recorded cells, based on the electrical image: the spatiotemporal pattern of voltage deflections induced by spikes on a large-scale, high-density multielectrode array. Recordings were performed from identified ganglion cell types in the macaque retina. Anatomical images of cells in the same preparation were obtained using virally transfected fluorescent labeling or by immunolabeling after fixation. The electrical image was then used to locate recorded cell somas, axon initial segments, and axon trajectories, and these signatures were used to identify recorded cells. Comparison of anatomical and physiological measurements permitted visualization and physiological characterization of numerically dominant ganglion cell types with high efficiency in a single preparation.

    View details for DOI 10.1523/JNEUROSCI.3675-14.2015

    View details for Web of Science ID 000352202300017

    View details for PubMedID 25788683

    View details for PubMedCentralID PMC4363392

  • Mapping nonlinear receptive field structure in primate retina at single cone resolution. eLife Freeman, J., Field, G. D., Li, P. H., Greschner, M., Gunning, D. E., Mathieson, K., Sher, A., Litke, A. M., Paninski, L., Simoncelli, E. P., Chichilnisky, E. J. 2015; 4

    Abstract

    The function of a neural circuit is shaped by the computations performed by its interneurons, which in many cases are not easily accessible to experimental investigation. Here, we elucidate the transformation of visual signals flowing from the input to the output of the primate retina, using a combination of large-scale multi-electrode recordings from an identified ganglion cell type, visual stimulation targeted at individual cone photoreceptors, and a hierarchical computational model. The results reveal nonlinear subunits in the circuity of OFF midget ganglion cells, which subserve high-resolution vision. The model explains light responses to a variety of stimuli more accurately than a linear model, including stimuli targeted to cones within and across subunits. The recovered model components are consistent with known anatomical organization of midget bipolar interneurons. These results reveal the spatial structure of linear and nonlinear encoding, at the resolution of single cells and at the scale of complete circuits.

    View details for DOI 10.7554/eLife.05241

    View details for PubMedID 26517879

    View details for PubMedCentralID PMC4623615

  • Recognizing retinal ganglion cells in the dark Richard, E., Goetz, G., Chichilnisky, E. J., Cortes, C., Lawrence, N. D., Lee, D. D., Sugiyama, M., Garnett, R. NEURAL INFORMATION PROCESSING SYSTEMS (NIPS). 2015
  • High-fidelity reproduction of spatiotemporal visual signals for retinal prosthesis. Neuron Jepson, L. H., Hottowy, P., Weiner, G. A., Dabrowski, W., Litke, A. M., Chichilnisky, E. J. 2014; 83 (1): 87-92

    Abstract

    Natural vision relies on spatiotemporal patterns of electrical activity in the retina. We investigated the feasibility of veridically reproducing such patterns with epiretinal prostheses. Multielectrode recordings and visual and electrical stimulation were performed on populations of identified ganglion cells in isolated peripheral primate retina. Electrical stimulation patterns were designed to reproduce recorded waves of activity elicited by a moving visual stimulus. Electrical responses in populations of ON parasol cells exhibited high spatial and temporal precision, matching or exceeding the precision of visual responses measured in the same cells. Computational readout of electrical and visual responses produced similar estimates of stimulus speed, confirming the fidelity of electrical stimulation for biologically relevant visual signals. These results suggest the possibility of producing rich spatiotemporal patterns of retinal activity with a prosthesis and that temporal multiplexing may aid in reproducing the neural code of the retina.

    View details for DOI 10.1016/j.neuron.2014.04.044

    View details for PubMedID 24910077

  • Retinal Representation of the Elementary Visual Signal (vol 81, pg 130, 2014) NEURON Li, P. H., Field, G. D., Greschner, M., Ahn, D., Gunning, D. E., Mathieson, K., Sher, A., Litke, A. M., Chichilnisky, E. J. 2014; 82 (2): 500
  • Spatially patterned electrical stimulation to enhance resolution of retinal prostheses. journal of neuroscience Jepson, L. H., Hottowy, P., Mathieson, K., Gunning, D. E., Dabrowski, W., Litke, A. M., Chichilnisky, E. J. 2014; 34 (14): 4871-4881

    Abstract

    Retinal prostheses electrically stimulate neurons to produce artificial vision in people blinded by photoreceptor degenerative diseases. The limited spatial resolution of current devices results in indiscriminate stimulation of interleaved cells of different types, precluding veridical reproduction of natural activity patterns in the retinal output. Here we investigate the use of spatial patterns of current injection to increase the spatial resolution of stimulation, using high-density multielectrode recording and stimulation of identified ganglion cells in isolated macaque retina. As previously shown, current passed through a single electrode typically induced a single retinal ganglion cell spike with submillisecond timing precision. Current passed simultaneously through pairs of neighboring electrodes modified the probability of activation relative to injection through a single electrode. This modification could be accurately summarized by a piecewise linear model of current summation, consistent with a simple biophysical model based on multiple sites of activation. The generalizability of the piecewise linear model was tested by using the measured responses to stimulation with two electrodes to predict responses to stimulation with three electrodes. Finally, the model provided an accurate prediction of which among a set of spatial stimulation patterns maximized selective activation of a cell while minimizing activation of a neighboring cell. The results demonstrate that tailored multielectrode stimulation patterns based on a piecewise linear model may be useful in increasing the spatial resolution of retinal prostheses.

    View details for DOI 10.1523/JNEUROSCI.2882-13.2014

    View details for PubMedID 24695706

    View details for PubMedCentralID PMC3972715

  • A polyaxonal amacrine cell population in the primate retina. journal of neuroscience Greschner, M., Field, G. D., Li, P. H., Schiff, M. L., Gauthier, J. L., Ahn, D., Sher, A., Litke, A. M., Chichilnisky, E. J. 2014; 34 (10): 3597-3606

    Abstract

    Amacrine cells are the most diverse and least understood cell class in the retina. Polyaxonal amacrine cells (PACs) are a unique subset identified by multiple long axonal processes. To explore their functional properties, populations of PACs were identified by their distinctive radially propagating spikes in large-scale high-density multielectrode recordings of isolated macaque retina. One group of PACs exhibited stereotyped functional properties and receptive field mosaic organization similar to that of parasol ganglion cells. These PACs had receptive fields coincident with their dendritic fields, but much larger axonal fields, and slow radial spike propagation. They also exhibited ON-OFF light responses, transient response kinetics, sparse and coordinated firing during image transitions, receptive fields with antagonistic surrounds and fine spatial structure, nonlinear spatial summation, and strong homotypic neighbor electrical coupling. These findings reveal the functional organization and collective visual signaling by a distinctive, high-density amacrine cell population.

    View details for DOI 10.1523/JNEUROSCI.3359-13.2014

    View details for PubMedID 24599459

    View details for PubMedCentralID PMC3942577

  • Retinal representation of the elementary visual signal. Neuron Li, P. H., Field, G. D., Greschner, M., Ahn, D., Gunning, D. E., Mathieson, K., Sher, A., Litke, A. M., Chichilnisky, E. J. 2014; 81 (1): 130-139

    Abstract

    The propagation of visual signals from individual cone photoreceptors through parallel neural circuits was examined in the primate retina. Targeted stimulation of individual cones was combined with simultaneous recording from multiple retinal ganglion cells of identified types. The visual signal initiated by an individual cone produced strong responses with different kinetics in three of the four numerically dominant ganglion cell types. The magnitude and kinetics of light responses in each ganglion cell varied nonlinearly with stimulus strength but in a manner that was independent of the cone of origin after accounting for the overall input strength of each cone. Based on this property of independence, the receptive field profile of an individual ganglion cell could be well estimated from responses to stimulation of each cone individually. Together, these findings provide a quantitative account of how elementary visual inputs form the ganglion cell receptive field.

    View details for DOI 10.1016/j.neuron.2013.10.043

    View details for PubMedID 24411737

  • Inferring synaptic conductances from spike trains under a biophysically inspired point process model Latimer, K. W., Chichilnisky, E. J., Rieke, F., Pillow, J. W., Ghahramani, Z., Welling, M., Cortes, C., Lawrence, N. D., Weinberger, K. Q. NEURAL INFORMATION PROCESSING SYSTEMS (NIPS). 2014
  • Focal Electrical Stimulation of Major Ganglion Cell Types in the Primate Retina for the Design of Visual Prostheses JOURNAL OF NEUROSCIENCE Jepson, L. H., Hottowy, P., Mathieson, K., Gunning, D. E., Dabrowski, W., Litke, A. M., Chichilnisky, E. J. 2013; 33 (17): 7194-7205

    Abstract

    Electrical stimulation of retinal neurons with an advanced retinal prosthesis may eventually provide high-resolution artificial vision to the blind. However, the success of future prostheses depends on the ability to activate the major parallel visual pathways of the human visual system. Electrical stimulation of the five numerically dominant retinal ganglion cell types was investigated by simultaneous stimulation and recording in isolated peripheral primate (Macaca sp.) retina using multi-electrode arrays. ON and OFF midget, ON and OFF parasol, and small bistratified ganglion cells could all be activated directly to fire a single spike with submillisecond latency using brief pulses of current within established safety limits. Thresholds for electrical stimulation were similar in all five cell types. In many cases, a single cell could be specifically activated without activating neighboring cells of the same type or other types. These findings support the feasibility of direct electrical stimulation of the major visual pathways at or near their native spatial and temporal resolution.

    View details for DOI 10.1523/JNEUROSCI.4967-12.2013

    View details for Web of Science ID 000318419300009

    View details for PubMedID 23616529

    View details for PubMedCentralID PMC3735130

  • Efficient Coding of Spatial Information in the Primate Retina JOURNAL OF NEUROSCIENCE Doi, E., Gauthier, J. L., Field, G. D., Shlens, J., Sher, A., Greschner, M., Machado, T. A., Jepson, L. H., Mathieson, K., Gunning, D. E., Litke, A. M., Paninski, L., Chichilnisky, E. J., Simoncelli, E. P. 2012; 32 (46): 16256-16264

    Abstract

    Sensory neurons have been hypothesized to efficiently encode signals from the natural environment subject to resource constraints. The predictions of this efficient coding hypothesis regarding the spatial filtering properties of the visual system have been found consistent with human perception, but they have not been compared directly with neural responses. Here, we analyze the information that retinal ganglion cells transmit to the brain about the spatial information in natural images subject to three resource constraints: the number of retinal ganglion cells, their total response variances, and their total synaptic strengths. We derive a model that optimizes the transmitted information and compare it directly with measurements of complete functional connectivity between cone photoreceptors and the four major types of ganglion cells in the primate retina, obtained at single-cell resolution. We find that the ganglion cell population exhibited 80% efficiency in transmitting spatial information relative to the model. Both the retina and the model exhibited high redundancy (~30%) among ganglion cells of the same cell type. A novel and unique prediction of efficient coding, the relationships between projection patterns of individual cones to all ganglion cells, was consistent with the observed projection patterns in the retina. These results indicate a high level of efficiency with near-optimal redundancy in visual signaling by the retina.

    View details for DOI 10.1523/JNEUROSCI.4036-12.2012

    View details for Web of Science ID 000311091000019

    View details for PubMedID 23152609

    View details for PubMedCentralID PMC3537829

  • Modeling the impact of common noise inputs on the network activity of retinal ganglion cells JOURNAL OF COMPUTATIONAL NEUROSCIENCE Vidne, M., Ahmadian, Y., Shlens, J., Pillow, J. W., Kulkarni, J., Litke, A. M., Chichilnisky, E. J., Simoncelli, E., Paninski, L. 2012; 33 (1): 97-121

    Abstract

    Synchronized spontaneous firing among retinal ganglion cells (RGCs), on timescales faster than visual responses, has been reported in many studies. Two candidate mechanisms of synchronized firing include direct coupling and shared noisy inputs. In neighboring parasol cells of primate retina, which exhibit rapid synchronized firing that has been studied extensively, recent experimental work indicates that direct electrical or synaptic coupling is weak, but shared synaptic input in the absence of modulated stimuli is strong. However, previous modeling efforts have not accounted for this aspect of firing in the parasol cell population. Here we develop a new model that incorporates the effects of common noise, and apply it to analyze the light responses and synchronized firing of a large, densely-sampled network of over 250 simultaneously recorded parasol cells. We use a generalized linear model in which the spike rate in each cell is determined by the linear combination of the spatio-temporally filtered visual input, the temporally filtered prior spikes of that cell, and unobserved sources representing common noise. The model accurately captures the statistical structure of the spike trains and the encoding of the visual stimulus, without the direct coupling assumption present in previous modeling work. Finally, we examined the problem of decoding the visual stimulus from the spike train given the estimated parameters. The common-noise model produces Bayesian decoding performance as accurate as that of a model with direct coupling, but with significantly more robustness to spike timing perturbations.

    View details for DOI 10.1007/s10827-011-0376-2

    View details for Web of Science ID 000306288900006

    View details for PubMedID 22203465

    View details for PubMedCentralID PMC3560841

  • Cone photoreceptor contributions to noise and correlations in the retinal output NATURE NEUROSCIENCE Ala-Laurila, P., Greschner, M., Chichilnisky, E. J., Rieke, F. 2011; 14 (10): 1309-U127

    Abstract

    Transduction and synaptic noise generated in retinal cone photoreceptors determine the fidelity with which light inputs are encoded, and the readout of cone signals by downstream circuits determines whether this fidelity is used for vision. We examined the effect of cone noise on visual signals by measuring its contribution to correlated noise in primate retinal ganglion cells. Correlated noise was strong in the responses of dissimilar cell types with shared cone inputs. The dynamics of cone noise could account for rapid correlations in ganglion cell activity, and the extent of shared cone input could explain correlation strength. Furthermore, correlated noise limited the fidelity with which visual signals were encoded by populations of ganglion cells. Thus, a simple picture emerges: cone noise, traversing the retina through diverse pathways, accounts for most of the noise and correlations in the retinal output and constrains how higher centers exploit signals carried by parallel visual pathways.

    View details for DOI 10.1038/nn.2927

    View details for Web of Science ID 000295254200020

    View details for PubMedID 21926983

    View details for PubMedCentralID PMC3183110

  • Changes in physiological properties of rat ganglion cells during retinal degeneration JOURNAL OF NEUROPHYSIOLOGY Sekirnjak, C., Jepson, L. H., Hottowy, P., Sher, A., Dabrowski, W., Litke, A. M., Chichilnisky, E. J. 2011; 105 (5): 2560-2571

    Abstract

    Retinitis pigmentosa (RP) is a leading cause of degenerative vision loss, yet its progressive effects on visual signals transmitted from the retina to the brain are not well understood. The transgenic P23H rat is a valuable model of human autosomal dominant RP, exhibiting extensive similarities to the human disease pathology, time course, and electrophysiology. In this study, we examined the physiological effects of degeneration in retinal ganglion cells (RGCs) of P23H rats aged between P37 and P752, and compared them with data from wild-type control animals. The strength and the size of visual receptive fields of RGCs decreased rapidly with age in P23H retinas. Light responses mediated by rod photoreceptors declined earlier (∼ P300) than cone-mediated light responses (∼ P600). Responses of ON and OFF RGCs diminished at a similar rate. However, OFF cells exhibited hyperactivity during degeneration, whereas ON cells showed a decrease in firing rate. The application of synaptic blockers abolished about half of the elevated firing in OFF RGCs, indicating that the remodeled circuitry was not the only source of degeneration-induced hyperactivity. These results advance our understanding of the functional changes associated with retinal degeneration.

    View details for DOI 10.1152/jn.01061.2010

    View details for Web of Science ID 000290710300052

    View details for PubMedID 21389304

    View details for PubMedCentralID PMC3094174

  • Correlated firing among major ganglion cell types in primate retina JOURNAL OF PHYSIOLOGY-LONDON Greschner, M., Shlens, J., Bakolitsa, C., Field, G. D., Gauthier, J. L., Jepson, L. H., Sher, A., Litke, A. M., Chichilnisky, E. J. 2011; 589 (1): 75-86

    Abstract

    Retinal ganglion cells exhibit substantial correlated firing: a tendency to fire nearly synchronously at rates different from those expected by chance. These correlations suggest that network interactions significantly shape the visual signal transmitted from the eye to the brain. This study describes the degree and structure of correlated firing among the major ganglion cell types in primate retina. Correlated firing among ON and OFF parasol, ON and OFF midget, and small bistratified cells, which together constitute roughly 75% of the input to higher visual areas, was studied using large-scale multi-electrode recordings. Correlated firing in the presence of constant, spatially uniform illumination exhibited characteristic strength, time course and polarity within and across cell types. Pairs of nearby cells with the same light response polarity were positively correlated; cells with the opposite polarity were negatively correlated. The strength of correlated firing declined systematically with distance for each cell type, in proportion to the degree of receptive field overlap. The pattern of correlated firing across cell types was similar at photopic and scotopic light levels, although additional slow correlations were present at scotopic light levels. Similar results were also observed in two other retinal ganglion cell types. Most of these observations are consistent with the hypothesis that shared noise from photoreceptors is the dominant cause of correlated firing. Surprisingly, small bistratified cells, which receive ON input from S cones, fired synchronously with ON parasol and midget cells, which receive ON input primarily from L and M cones. Collectively, these results provide an overview of correlated firing across cell types in the primate retina, and constraints on the underlying mechanisms.

    View details for DOI 10.1113/jphysiol.2010.193888

    View details for Web of Science ID 000285760900011

    View details for PubMedID 20921200

    View details for PubMedCentralID PMC3039261

  • Functional connectivity in the retina at the resolution of photoreceptors NATURE Field, G. D., Gauthier, J. L., Sher, A., Greschner, M., Machado, T. A., Jepson, L. H., Shlens, J., Gunning, D. E., Mathieson, K., Dabrowski, W., Paninski, L., Litke, A. M., Chichilnisky, E. J. 2010; 467 (7316): 673-U54

    Abstract

    To understand a neural circuit requires knowledge of its connectivity. Here we report measurements of functional connectivity between the input and ouput layers of the macaque retina at single-cell resolution and the implications of these for colour vision. Multi-electrode technology was used to record simultaneously from complete populations of the retinal ganglion cell types (midget, parasol and small bistratified) that transmit high-resolution visual signals to the brain. Fine-grained visual stimulation was used to identify the location, type and strength of the functional input of each cone photoreceptor to each ganglion cell. The populations of ON and OFF midget and parasol cells each sampled the complete population of long- and middle-wavelength-sensitive cones. However, only OFF midget cells frequently received strong input from short-wavelength-sensitive cones. ON and OFF midget cells showed a small non-random tendency to selectively sample from either long- or middle-wavelength-sensitive cones to a degree not explained by clumping in the cone mosaic. These measurements reveal computations in a neural circuit at the elementary resolution of individual neurons.

    View details for DOI 10.1038/nature09424

    View details for Web of Science ID 000282572500030

    View details for PubMedID 20930838

    View details for PubMedCentralID PMC2953734

  • Receptive Field Mosaics of Retinal Ganglion Cells Are Established Without Visual Experience JOURNAL OF NEUROPHYSIOLOGY Anishchenko, A., Greschner, M., Elstrott, J., Sher, A., Litke, A. M., Feller, M. B., Chichilnisky, E. J. 2010; 103 (4): 1856-1864

    Abstract

    A characteristic feature of adult retina is mosaic organization: a spatial arrangement of cells of each morphological and functional type that produces uniform sampling of visual space. How the mosaics of visual receptive fields emerge in the retina during development is not fully understood. Here we use a large-scale multielectrode array to determine the mosaic organization of retinal ganglion cells (RGCs) in rats around the time of eye opening and in the adult. At the time of eye opening, we were able to reliably distinguish two types of ON RGCs and two types of OFF RGCs in rat retina based on their light response and intrinsic firing properties. Although the light responses of individual cells were not yet mature at this age, each of the identified functional RGC types formed a receptive field mosaic, where the spacing of the receptive field centers and the overlap of the receptive field extents were similar to those observed in the retinas of adult rats. These findings suggest that, although the light response properties of RGCs may need vision to reach full maturity, extensive visual experience is not required for individual RGC types to form a regular sensory map of visual space.

    View details for DOI 10.1152/jn.00896.2009

    View details for Web of Science ID 000276555800015

    View details for PubMedID 20107116

    View details for PubMedCentralID PMC2853272

  • Loss of Responses to Visual But Not Electrical Stimulation in Ganglion Cells of Rats With Severe Photoreceptor Degeneration JOURNAL OF NEUROPHYSIOLOGY Sekirnjak, C., Hulse, C., Jepson, L. H., Hottowy, P., Sher, A., Dabrowski, W., Litke, A. M., Chichilnisky, E. J. 2009; 102 (6): 3260-3269

    Abstract

    Retinal implants are intended to help patients with degenerative conditions by electrically stimulating surviving cells to produce artificial vision. However, little is known about how individual retinal ganglion cells respond to direct electrical stimulation in degenerating retina. Here we used a transgenic rat model to characterize ganglion cell responses to light and electrical stimulation during photoreceptor degeneration. Retinas from pigmented P23H-1 rats were compared with wild-type retinas between ages P37 and P752. During degeneration, retinal thickness declined by 50%, largely as a consequence of photoreceptor loss. Spontaneous electrical activity in retinal ganglion cells initially increased two- to threefold, but returned to nearly normal levels around P600. A profound decrease in the number of light-responsive ganglion cells was observed during degeneration, culminating in retinas without detectable light responses by P550. Ganglion cells from transgenic and wild-type animals were targeted for focal electrical stimulation using multielectrode arrays with electrode diameters of approximately 10 microns. Ganglion cells were stimulated directly and the success rate of stimulation in both groups was 60-70% at all ages. Surprisingly, thresholds (approximately 0.05 mC/cm(2)) and latencies (approximately 0.25 ms) in P23H rat ganglion cells were comparable to those in wild-type ganglion cells at all ages and showed no change over time. Thus ganglion cells in P23H rats respond normally to direct electrical stimulation despite severe photoreceptor degeneration and complete loss of light responses. These findings suggest that high-resolution epiretinal prosthetic devices may be effective in treating vision loss resulting from photoreceptor degeneration.

    View details for DOI 10.1152/jn.00663.2009

    View details for Web of Science ID 000272463200018

    View details for PubMedID 19726725

    View details for PubMedCentralID PMC2804428

  • High-sensitivity rod photoreceptor input to the blue-yellow color opponent pathway in macaque retina NATURE NEUROSCIENCE Field, G. D., Greschner, M., Gauthier, J. L., Rangel, C., Shlens, J., Sher, A., Marshak, D. W., Litke, A. M., Chichilnisky, E. J. 2009; 12 (9): 1159-U20

    Abstract

    Small bistratified cells (SBCs) in the primate retina carry a major blue-yellow opponent signal to the brain. We found that SBCs also carry signals from rod photoreceptors, with the same sign as S cone input. SBCs exhibited robust responses under low scotopic conditions. Physiological and anatomical experiments indicated that this rod input arose from the AII amacrine cell-mediated rod pathway. Rod and cone signals were both present in SBCs at mesopic light levels. These findings have three implications. First, more retinal circuits may multiplex rod and cone signals than were previously thought to, efficiently exploiting the limited number of optic nerve fibers. Second, signals from AII amacrine cells may diverge to most or all of the approximately 20 retinal ganglion cell types in the peripheral primate retina. Third, rod input to SBCs may be the substrate for behavioral biases toward perception of blue at mesopic light levels.

    View details for DOI 10.1038/nn.2353

    View details for Web of Science ID 000269317300018

    View details for PubMedID 19668201

    View details for PubMedCentralID PMC2789108

  • The Structure of Large-Scale Synchronized Firing in Primate Retina JOURNAL OF NEUROSCIENCE Shlens, J., Field, G. D., Gauthier, J. L., Greschner, M., Sher, A., Litke, A. M., Chichilnisky, E. J. 2009; 29 (15): 5022-5031

    Abstract

    Synchronized firing among neurons has been proposed to constitute an elementary aspect of the neural code in sensory and motor systems. However, it remains unclear how synchronized firing affects the large-scale patterns of activity and redundancy of visual signals in a complete population of neurons. We recorded simultaneously from hundreds of retinal ganglion cells in primate retina, and examined synchronized firing in completely sampled populations of approximately 50-100 ON-parasol cells, which form a major projection to the magnocellular layers of the lateral geniculate nucleus. Synchronized firing in pairs of cells was a subset of a much larger pattern of activity that exhibited local, isotropic spatial properties. However, a simple model based solely on interactions between adjacent cells reproduced 99% of the spatial structure and scale of synchronized firing. No more than 20% of the variability in firing of an individual cell was predictable from the activity of its neighbors. These results held both for spontaneous firing and in the presence of independent visual modulation of the firing of each cell. In sum, large-scale synchronized firing in the entire population of ON-parasol cells appears to reflect simple neighbor interactions, rather than a unique visual signal or a highly redundant coding scheme.

    View details for DOI 10.1523/JNEUROSCI.5187-08.2009

    View details for Web of Science ID 000265232000034

    View details for PubMedID 19369571

    View details for PubMedCentralID PMC2678680

  • Uniform Signal Redundancy of Parasol and Midget Ganglion Cells in Primate Retina JOURNAL OF NEUROSCIENCE Gauthier, J. L., Field, G. D., Sher, A., Shlens, J., Greschner, M., Litke, A. M., Chichilnisky, E. J. 2009; 29 (14): 4675-4680

    Abstract

    The collective representation of visual space in high resolution visual pathways was explored by simultaneously measuring the receptive fields of hundreds of ON and OFF midget and parasol ganglion cells in isolated primate retina. As expected, the receptive fields of all four cell types formed regular mosaics uniformly tiling the visual scene. Surprisingly, comparison of all four mosaics revealed that the overlap of neighboring receptive fields was nearly identical, for both the excitatory center and inhibitory surround components of the receptive field. These observations contrast sharply with the large differences in the dendritic overlap between the parasol and midget cell populations, revealing a surprising lack of correspondence between the anatomical and functional architecture in the dominant circuits of the primate retina.

    View details for DOI 10.1523/JNEUROSCI.5294-08.2009

    View details for Web of Science ID 000265009600033

    View details for PubMedID 19357292

    View details for PubMedCentralID PMC3202971

  • Receptive Fields in Primate Retina Are Coordinated to Sample Visual Space More Uniformly PLOS BIOLOGY Gauthier, J. L., Field, G. D., Sher, A., Greschner, M., Shlens, J., Litke, A. M., Chichilnisky, E. J. 2009; 7 (4): 747-755

    Abstract

    In the visual system, large ensembles of neurons collectively sample visual space with receptive fields (RFs). A puzzling problem is how neural ensembles provide a uniform, high-resolution visual representation in spite of irregularities in the RFs of individual cells. This problem was approached by simultaneously mapping the RFs of hundreds of primate retinal ganglion cells. As observed in previous studies, RFs exhibited irregular shapes that deviated from standard Gaussian models. Surprisingly, these irregularities were coordinated at a fine spatial scale: RFs interlocked with their neighbors, filling in gaps and avoiding large variations in overlap. RF shapes were coordinated with high spatial precision: the observed uniformity was degraded by angular perturbations as small as 15 degrees, and the observed populations sampled visual space with more than 50% of the theoretical ideal uniformity. These results show that the primate retina encodes light with an exquisitely coordinated array of RF shapes, illustrating a higher degree of functional precision in the neural circuitry than previously appreciated.

    View details for DOI 10.1371/journal.pbio.1000063

    View details for Web of Science ID 000266500000005

    View details for PubMedID 19355787

    View details for PubMedCentralID PMC2672597

  • Spatio-temporal correlations and visual signalling in a complete neuronal population NATURE Pillow, J. W., Shlens, J., Paninski, L., Sher, A., Litke, A. M., Chichilnisky, E. J., Simoncelli, E. P. 2008; 454 (7207): 995-U37

    Abstract

    Statistical dependencies in the responses of sensory neurons govern both the amount of stimulus information conveyed and the means by which downstream neurons can extract it. Although a variety of measurements indicate the existence of such dependencies, their origin and importance for neural coding are poorly understood. Here we analyse the functional significance of correlated firing in a complete population of macaque parasol retinal ganglion cells using a model of multi-neuron spike responses. The model, with parameters fit directly to physiological data, simultaneously captures both the stimulus dependence and detailed spatio-temporal correlations in population responses, and provides two insights into the structure of the neural code. First, neural encoding at the population level is less noisy than one would expect from the variability of individual neurons: spike times are more precise, and can be predicted more accurately when the spiking of neighbouring neurons is taken into account. Second, correlations provide additional sensory information: optimal, model-based decoding that exploits the response correlation structure extracts 20% more information about the visual scene than decoding under the assumption of independence, and preserves 40% more visual information than optimal linear decoding. This model-based approach reveals the role of correlated activity in the retinal coding of visual stimuli, and provides a general framework for understanding the importance of correlated activity in populations of neurons.

    View details for DOI 10.1038/nature07140

    View details for Web of Science ID 000258591000039

    View details for PubMedID 18650810

    View details for PubMedCentralID PMC2684455

  • Synchronized firing in the retina CURRENT OPINION IN NEUROBIOLOGY Shlens, J., Rieke, F., Chichilnisky, E. J. 2008; 18 (4): 396-402

    Abstract

    Synchronized firing in neural populations has been proposed to constitute an elementary aspect of the neural code, but a complete understanding of its origins and significance has been elusive. Synchronized firing has been extensively documented in retinal ganglion cells, the output neurons of the retina. However, differences in synchronized firing across species and cell types have led to varied conclusions about its mechanisms and role in visual signaling. Recent work on two identified cell populations in the primate retina, the ON-parasol and OFF-parasol cells, permits a more unified understanding. Intracellular recordings reveal that synchronized firing in these cell types arises primarily from common synaptic input to adjacent pairs of cells. Statistical analysis indicates that local pairwise interactions can explain the pattern of synchronized firing in the entire parasol cell population. Computational analysis reveals that the aggregate impact of synchronized firing on the visual signal is substantial. Thus, in the parasol cells, the origin and impact of synchronized firing on the neural code may be understood as locally shared input which influences the visual signals transmitted from eye to brain.

    View details for DOI 10.1016/j.conb.2008.09.010

    View details for Web of Science ID 000261561400008

    View details for PubMedID 18832034

    View details for PubMedCentralID PMC2711873

  • Direction selectivity in the retina is established independent of visual experience and cholinergic retinal waves NEURON Elstrott, J., Anishchenko, A., Greschner, M., Sher, A., Litke, A. M., Chichilnisky, E. J., Feller, M. B. 2008; 58 (4): 499-506

    Abstract

    Direction selectivity in the retina requires the asymmetric wiring of inhibitory inputs onto four subtypes of On-Off direction-selective ganglion cells (DSGCs), each preferring motion in one of four cardinal directions. The primary model for the development of direction selectivity is that patterned activity plays an instructive role. Here, we use a unique, large-scale multielectrode array to demonstrate that DSGCs are present at eye opening, in mice that have been reared in darkness and in mice that lack cholinergic retinal waves. These data suggest that direction selectivity in the retina is established largely independent of patterned activity and is therefore likely to emerge as a result of complex molecular interactions.

    View details for DOI 10.1016/j.neuron.2008.03.013

    View details for Web of Science ID 000256120500005

    View details for PubMedID 18498732

    View details for PubMedCentralID PMC2474739

  • High-resolution electrical stimulation of primate retina for epiretinal implant design JOURNAL OF NEUROSCIENCE Sekirnjak, C., Hottowy, P., Sher, A., Dabrowski, W., Litke, A. M., Chichilnisky, E. J. 2008; 28 (17): 4446-4456

    Abstract

    The development of retinal implants for the blind depends crucially on understanding how neurons in the retina respond to electrical stimulation. This study used multielectrode arrays to stimulate ganglion cells in the peripheral macaque retina, which is very similar to the human retina. Analysis was restricted to parasol cells, which form one of the major high-resolution visual pathways in primates. Individual cells were characterized using visual stimuli, and subsequently targeted for electrical stimulation using electrodes 9-15 microm in diameter. Results were accumulated across 16 ON and 9 OFF parasol cells. At threshold, all cells responded to biphasic electrical pulses 0.05-0.1 ms in duration by firing a single spike with latency lower than 0.35 ms. The average threshold charge density was 0.050 +/- 0.005 mC/cm(2), significantly below established safety limits for platinum electrodes. ON and OFF ganglion cells were stimulated with similar efficacy. Repetitive stimulation elicited spikes within a 0.1 ms time window, indicating that the high temporal precision necessary for spike-by-spike stimulation can be achieved in primate retina. Spatial analysis of observed thresholds suggests that electrical activation occurred near the axon hillock, and that dendrites contributed little. Finally, stimulation of a single parasol cell produced little or no activation of other cells in the ON and OFF parasol cell mosaics. The low-threshold, temporally precise, and spatially specific responses hold promise for the application of high-density arrays of small electrodes in epiretinal implants.

    View details for DOI 10.1523/JNEUROSCI.5138-07.2008

    View details for Web of Science ID 000255301100019

    View details for PubMedID 18434523

    View details for PubMedCentralID PMC2681084

  • Spatial properties and functional organization of small bistratified ganglion cells in primate retina JOURNAL OF NEUROSCIENCE Field, G. D., Sher, A., Gauthier, J. L., Greschner, M., Shlens, J., Litke, A. M., Chichilnisky, E. J. 2007; 27 (48): 13261-13272

    Abstract

    The primate visual system consists of parallel pathways initiated by distinct cell types in the retina that encode different features of the visual scene. Small bistratified cells (SBCs), which form a major projection to the thalamus, exhibit blue-ON/yellow-OFF [S-ON/(L+M)-OFF] light responses thought to be important for high-acuity color vision. However, the spatial processing properties of individual SBCs and their spatial arrangement across the visual field are poorly understood. The present study of peripheral primate retina reveals that contrary to previous suggestions, SBCs exhibit center-surround spatial structure, with the (L+M)-OFF component of the receptive field approximately 50% larger in diameter than the S-ON component. Analysis of response kinetics shows that the (L+M)-OFF response in SBCs is slower than the S-ON response and significantly less transient than that of simultaneously recorded OFF-parasol cells. The (L+M)-OFF response in SBCs was eliminated by bath application of the metabotropic glutamate receptor agonist L-APB. These observations indicate that the (L+M)-OFF response of SBCs is not formed by OFF-bipolar cell input as has been suspected and suggest that it arises from horizontal cell feedback. Finally, the receptive fields of SBCs form orderly mosaics, with overlap and regularity similar to those of ON-parasol cells. Thus, despite their distinctive morphology and chromatic properties, SBCs exhibit two features of other retinal ganglion cell types: center-surround antagonism and regular mosaic sampling of visual space.

    View details for DOI 10.1523/JNEUROSCI.3437-07.2007

    View details for Web of Science ID 000251296700023

    View details for PubMedID 18045920

  • Identification and characterization of a Y-like primate retinal ganglion cell type JOURNAL OF NEUROSCIENCE Petrusca, D., Grivich, M. I., Sher, A., Field, G. D., Gauthier, J. L., Greschner, M., Shlens, J., Chichilnisky, E. J., Litke, A. M. 2007; 27 (41): 11019-11027

    Abstract

    The primate retina communicates visual information to the brain via a set of parallel pathways that originate from at least 22 anatomically distinct types of retinal ganglion cells. Knowledge of the physiological properties of these ganglion cell types is of critical importance for understanding the functioning of the primate visual system. Nonetheless, the physiological properties of only a handful of retinal ganglion cell types have been studied in detail. Here we show, using a newly developed multielectrode array system for the large-scale recording of neural activity, the existence of a physiologically distinct population of ganglion cells in the primate retina with distinctive visual response properties. These cells, which we will refer to as upsilon cells, are characterized by large receptive fields, rapid and transient responses to light, and significant nonlinearities in their spatial summation. Based on the measured properties of these cells, we speculate that they correspond to the smooth/large radiate cells recently identified morphologically in the primate retina and may therefore provide visual input to both the lateral geniculate nucleus and the superior colliculus. We further speculate that the upsilon cells may be the primate retina's counterparts of the Y-cells observed in the cat and other mammalian species.

    View details for DOI 10.1523/JNEUROSCI.2836-07.2007

    View details for Web of Science ID 000250083300012

    View details for PubMedID 17928443

  • Cone inputs to simple and complex cells in V1 of awake macaque JOURNAL OF NEUROPHYSIOLOGY Horwitz, G. D., Chichilnisky, E. J., Albright, T. D. 2007; 97 (4): 3070-3081

    Abstract

    Rules by which V1 neurons combine signals originating in the cone photoreceptors are poorly understood. We measured cone inputs to V1 neurons in awake, fixating monkeys with white-noise analysis techniques that reveal properties of light responses not revealed by purely linear models used in previous studies. Simple cells were studied by spike-triggered averaging that is robust to static nonlinearities in spike generation. This analysis revealed, among heterogeneously tuned neurons, two relatively discrete categories: one with opponent L- and M-cone weights and another with nonopponent cone weights. Complex cells were studied by spike-triggered covariance, which identifies features in the stimulus sequence that trigger spikes in neurons with receptive fields containing multiple linear subunits that combine nonlinearly. All complex cells responded to nonopponent stimulus modulations. Although some complex cells responded to cone-opponent stimulus modulations too, none exhibited the pure opponent sensitivity observed in many simple cells. These results extend the findings on distinctions between simple and complex cell chromatic tuning observed in previous studies in anesthetized monkeys.

    View details for DOI 10.1152/jn.00965.2006

    View details for Web of Science ID 000247929900045

    View details for PubMedID 17303812

  • Information processing in the primate retina: Circuitry and coding ANNUAL REVIEW OF NEUROSCIENCE Field, G. D., Chichilnisky, E. J. 2007; 30: 1-30

    Abstract

    The function of any neural circuit is governed by connectivity of neurons in the circuit and the computations performed by the neurons. Recent research on retinal function has substantially advanced understanding in both areas. First, visual information is transmitted to the brain by at least 17 distinct retinal ganglion cell types defined by characteristic morphology, light response properties, and central projections. These findings provide a much more accurate view of the parallel visual pathways emanating from the retina than do previous models, and they highlight the importance of identifying distinct cell types and their connectivity in other neural circuits. Second, encoding of visual information involves significant temporal structure and interactions in the spike trains of retinal neurons. The functional importance of this structure is revealed by computational analysis of encoding and decoding, an approach that may be applicable to understanding the function of other neural circuits.

    View details for DOI 10.1146/annurev.neuro.30.051606.094252

    View details for Web of Science ID 000248735400001

    View details for PubMedID 17335403

  • The structure of multi-neuron firing patterns in primate retina JOURNAL OF NEUROSCIENCE Shlens, J., Field, G. D., Gauthier, J. L., Grivich, M. I., Petrusca, D., Sher, A., Litke, A. M., Chichilnisky, E. J. 2006; 26 (32): 8254-8266

    Abstract

    Current understanding of many neural circuits is limited by our ability to explore the vast number of potential interactions between different cells. We present a new approach that dramatically reduces the complexity of this problem. Large-scale multi-electrode recordings were used to measure electrical activity in nearly complete, regularly spaced mosaics of several hundred ON and OFF parasol retinal ganglion cells in macaque monkey retina. Parasol cells exhibited substantial pairwise correlations, as has been observed in other species, indicating functional connectivity. However, pairwise measurements alone are insufficient to determine the prevalence of multi-neuron firing patterns, which would be predicted from widely diverging common inputs and have been hypothesized to convey distinct visual messages to the brain. The number of possible multi-neuron firing patterns is far too large to study exhaustively, but this problem may be circumvented if two simple rules of connectivity can be established: (1) multi-cell firing patterns arise from multiple pairwise interactions, and (2) interactions are limited to adjacent cells in the mosaic. Using maximum entropy methods from statistical mechanics, we show that pairwise and adjacent interactions accurately accounted for the structure and prevalence of multi-neuron firing patterns, explaining approximately 98% of the departures from statistical independence in parasol cells and approximately 99% of the departures that were reproducible in repeated measurements. This approach provides a way to define limits on the complexity of network interactions and thus may be relevant for probing the function of many neural circuits.

    View details for DOI 10.1523/JNEUROSCI.1282-06.2006

    View details for Web of Science ID 000239678800006

    View details for PubMedID 16899720

  • Fidelity of the ensemble code for visual motion in primate retina (vol 94, pg 119, 2005) JOURNAL OF NEUROPHYSIOLOGY Frechette, E. S., Sher, A., Grivich, M., Petrusca, D., Litke, A. M., Chichilnisky, E. J. 2006; 96 (2): 963
  • Electrical stimulation of mammalian retinal ganglion cells with multielectrode arrays JOURNAL OF NEUROPHYSIOLOGY Sekirnjak, C., Hottowy, P., Sher, A., Dabrowski, W., Litke, A. M., Chichilnisky, E. J. 2006; 95 (6): 3311-3327

    Abstract

    Existing epiretinal implants for the blind are designed to electrically stimulate large groups of surviving retinal neurons using a small number of electrodes with diameters of several hundred micrometers. To increase the spatial resolution of artificial sight, electrodes much smaller than those currently in use are desirable. In this study, we stimulated and recorded ganglion cells in isolated pieces of rat, guinea pig, and monkey retina. We used microfabricated hexagonal arrays of 61 platinum disk electrodes with diameters between 6 and 25 microm, spaced 60 microm apart. Charge-balanced current pulses evoked one or two spikes at latencies as short as 0.2 ms, and typically only one or a few recorded ganglion cells were stimulated. Application of several synaptic blockers did not abolish the evoked responses, implying direct activation of ganglion cells. Threshold charge densities were typically <0.1 mC/cm2 for a pulse duration of 100 micros, corresponding to charge thresholds of <100 pC. Stimulation remained effective after several hours and at high frequencies. To show that closely spaced electrodes can elicit independent ganglion cell responses, we used the multielectrode array to stimulate several nearby ganglion cells simultaneously. From these data, we conclude that electrical stimulation of mammalian retina with small-diameter electrode arrays is achievable and can provide high temporal and spatial precision at low charge densities. We review previous epiretinal stimulation studies and discuss our results in the context of 32 other publications, comparing threshold parameters and safety limits.

    View details for DOI 10.1152/jn.01168.2005

    View details for Web of Science ID 000237653900003

    View details for PubMedID 16436479

  • Prediction and decoding of retinal ganglion cell responses with a probabilistic spiking model JOURNAL OF NEUROSCIENCE Pillow, J. W., Paninski, L., Uzzell, V. J., Simoncelli, E. P., Chichilnisky, E. J. 2005; 25 (47): 11003-11013

    Abstract

    Sensory encoding in spiking neurons depends on both the integration of sensory inputs and the intrinsic dynamics and variability of spike generation. We show that the stimulus selectivity, reliability, and timing precision of primate retinal ganglion cell (RGC) light responses can be reproduced accurately with a simple model consisting of a leaky integrate-and-fire spike generator driven by a linearly filtered stimulus, a postspike current, and a Gaussian noise current. We fit model parameters for individual RGCs by maximizing the likelihood of observed spike responses to a stochastic visual stimulus. Although compact, the fitted model predicts the detailed time structure of responses to novel stimuli, accurately capturing the interaction between the spiking history and sensory stimulus selectivity. The model also accounts for the variability in responses to repeated stimuli, even when fit to data from a single (nonrepeating) stimulus sequence. Finally, the model can be used to derive an explicit, maximum-likelihood decoding rule for neural spike trains, thus providing a tool for assessing the limitations that spiking variability imposes on sensory performance.

    View details for DOI 10.1523/JNEUROSCI.3305-05.2005

    View details for Web of Science ID 000233460400021

    View details for PubMedID 16306413

  • Fidelity of the ensemble code for visual motion in primate retina JOURNAL OF NEUROPHYSIOLOGY Frechette, E. S., Sher, A., Grivich, M. I., Petrusca, D., Litke, A. M., Chichilnisky, E. J. 2005; 94 (1): 119-135

    Abstract

    Sensory experience typically depends on the ensemble activity of hundreds or thousands of neurons, but little is known about how populations of neurons faithfully encode behaviorally important sensory information. We examined how precisely speed of movement is encoded in the population activity of magnocellular-projecting parasol retinal ganglion cells (RGCs) in macaque monkey retina. Multi-electrode recordings were used to measure the activity of approximately 100 parasol RGCs simultaneously in isolated retinas stimulated with moving bars. To examine how faithfully the retina signals motion, stimulus speed was estimated directly from recorded RGC responses using an optimized algorithm that resembles models of motion sensing in the brain. RGC population activity encoded speed with a precision of approximately 1%. The elementary motion signal was conveyed in approximately 10 ms, comparable to the interspike interval. Temporal structure in spike trains provided more precise speed estimates than time-varying firing rates. Correlated activity between RGCs had little effect on speed estimates. The spatial dispersion of RGC receptive fields along the axis of motion influenced speed estimates more strongly than along the orthogonal direction, as predicted by a simple model based on RGC response time variability and optimal pooling. on and off cells encoded speed with similar and statistically independent variability. Simulation of downstream speed estimation using populations of speed-tuned units showed that peak (winner take all) readout provided more precise speed estimates than centroid (vector average) readout. These findings reveal how faithfully the retinal population code conveys information about stimulus speed and the consequences for motion sensing in the brain.

    View details for DOI 10.1152/jn.01175.2004

    View details for Web of Science ID 000230135500013

    View details for PubMedID 15625091

  • Blue-yellow signals are enhanced by spatiotemporal luminance contrast in macaque V1 JOURNAL OF NEUROPHYSIOLOGY Horwitz, G. D., Chichilinisky, E. J., Albright, T. D. 2005; 93 (4): 2263-2278

    Abstract

    We measured the color tuning of a population of S-cone-driven V1 neurons in awake, fixating monkeys. Analysis of randomly chosen color stimuli that were effective in evoking action potentials showed that these neurons received opposite sign input from the S cones and a combination of L and M cones. Surprisingly, these cells also responded to LM cone contrast irrespective of polarity, a nonlinear sensitivity that was masked by conventional linear analysis methods. Taken together, these observations can be summarized in a nonlinear model that combines nonopponent and opponent signals such that luminance contrast enhances color processing. These findings indicate that important aspects of the cortical representation of color cannot be described by classical linear analysis, and reveal a possible neural correlate of perceptual color-luminance interactions.

    View details for DOI 10.1152/jn.00743.2004

    View details for Web of Science ID 000227701600040

    View details for PubMedID 15496484

  • Detection sensitivity and temporal resolution of visual signals near absolute threshold in the salamander retina JOURNAL OF NEUROSCIENCE Chichilnisky, E. J., Rieke, F. 2005; 25 (2): 318-330

    Abstract

    Several studies have suggested that the visual system can detect dim lights with a fidelity limited only by Poisson fluctuations in photon absorption and spontaneous activation of rhodopsin. If correct, this implies that neural processing of responses produced by rod photoreceptors is efficient and effectively noiseless. However, experimental uncertainty makes this conclusion tenuous. Furthermore, previous work provided no information about how accurately stimulus timing is represented. Here, the detection sensitivity and temporal resolution of salamander rods and retinal ganglion cells (RGCs) are compared in nearly matched experimental conditions by using recorded responses to identify the time of a flash. At detection threshold, RGCs could reliably signal the absorption of 20-50 photons, but the rods within the RGC receptive field could signal stimuli 3-10 times weaker. For flash strengths 10 times higher than detection threshold, some RGCs could distinguish stimulus timing with a resolution finer than 100 msec, within a factor of 2 of the rod limit. The relationship between RGC and rod sensitivity could not be explained by added noise in the retinal circuitry but could be explained by a threshold acting after pooling of rod signals. Simulations of rod signals indicated that continuous noise, rather than spontaneous activation of rhodopsin or fluctuations in the single-photon response, limited temporal resolution. Thus, detection of dim lights was limited by retinal processing, but, at higher light levels, synaptic transmission, cellular integration of synaptic inputs, and spike generation in RGCs faithfully conveyed information about the time of photon absorption.

    View details for DOI 10.1523/JNEUROSCI.2339-04.2005

    View details for Web of Science ID 000226271400006

    View details for PubMedID 15647475

  • Precision of spike trains in primate retinal ganglion cells JOURNAL OF NEUROPHYSIOLOGY Uzzell, V. J., Chichilnisky, E. J. 2004; 92 (2): 780-789

    Abstract

    Recent studies have revealed striking precision in the spike trains of retinal ganglion cells in several species and suggested that this precision could be an important aspect of visual signaling. However, the precision of spike trains has not yet been described in primate retina. The spike time and count variability of parasol (magnocellular-projecting) retinal ganglion cells was examined in isolated macaque monkey retinas stimulated with repeated presentations of high contrast, spatially uniform intensity modulation. At the onset of clearly delineated periods of firing, retinal ganglion cells fired spikes time-locked to the stimulus with a variability across trials as low as 1 ms. Spike count variance across trials was much lower than the mean and sometimes approached the minimum variance possible with discrete counts, inconsistent with Poisson statistics expected from independently generated spikes. Spike time and count variability decreased systematically with stimulus strength. These findings were consistent with a model in which firing probability was determined by a stimulus-driven free firing rate modulated by a recovery function representing the action potential absolute and relative refractory period.

    View details for DOI 10.1152/jn.01171.2003

    View details for Web of Science ID 000222908200013

    View details for PubMedID 15277596

  • What does the eye tell the brain?: Development of a system for the large-scale recording of retinal output activity IEEE-Nuclear-Science Symposium/Medical Imaging Conference Litke, A. M., Bezayiff, N., Chichilnisky, E. J., Cunningham, W., Dabrowski, W., Grillo, A. A., Grivich, M., Grybos, P., Hottowy, P., Kachiguine, S., Kalmar, R. S., Mathieson, K., Petrusca, D., Rahman, A., Sher, A. IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC. 2004: 1434–40
  • Temporal resolution of ensemble visual motion signals in primate retina JOURNAL OF NEUROSCIENCE Chichilnisky, E. J., Kalmar, R. S. 2003; 23 (17): 6681-6689

    Abstract

    Recent studies have examined the temporal precision of spiking in visual system neurons, but less is known about the time scale that is relevant for behaviorally important visual computations. We examined how spatiotemporal patterns of spikes in ensembles of primate retinal ganglion cells convey information about visual motion to the brain. The direction of motion of a bar was estimated by comparing the timing of responses in ensembles of parasol (magnocellular-projecting) retinal ganglion cells recorded simultaneously, using a cross-correlation approach similar to standard models of motion sensing. To identify the temporal resolution of motion signals, spike trains were low-pass filtered before estimating the direction of motion. The filter time constant that resulted in most accurate motion sensing was in the range of 10-50 msec for a range of stimulus speeds and contrasts and approached a lower limit of approximately 10 msec at high speeds and contrasts. This time constant was, on average, comparable to the length of interspike intervals. These findings suggest that cortical neurons could filter their inputs on a time scale of tens of milliseconds, rather than relying on the precise times of individual input spikes, to sense motion most reliably.

    View details for Web of Science ID 000184469200002

    View details for PubMedID 12890760

  • Functional asymmetries in ON and OFF ganglion cells of primate retina JOURNAL OF NEUROSCIENCE Chichilnisky, E. J., Kalmar, R. S. 2002; 22 (7): 2737-2747

    Abstract

    Functional asymmetries in the ON and OFF pathways of the primate visual system were examined using simultaneous multi-electrode recordings from dozens of retinal ganglion cells (RGCs) in vitro. Light responses of RGCs were characterized using white noise stimulation. Two distinct functional types of cells frequently encountered, one ON and one OFF, had non-opponent spectral sensitivity, relatively high response gain, transient light responses, and large receptive fields (RFs) that tiled the region of retina recorded, suggesting that they belonged to the same morphological cell class, most likely parasol. Three principal functional asymmetries were observed. (1) Receptive fields of ON cells were 20% larger in diameter than those of OFF cells, resulting in higher full-field sensitivity. (2) ON cells had faster response kinetics than OFF cells, with a 10-20% shorter time to peak, trough and zero crossing in the biphasic temporal impulse response. (3) ON cells had more nearly linear light responses and were capable of signaling decrements, whereas OFF cells had more strongly rectifying responses that provided little information about increments. These findings suggest specific mechanistic asymmetries in retinal ON and OFF circuits and differences in visual performance on the basis of the activity of ON and OFF parasol cells.

    View details for Web of Science ID 000174626000037

    View details for PubMedID 11923439

  • Characterizing neural gain control using spike-triggered covariance 15th Annual Conference on Neural Information Processing Systems (NIPS) Schwartz, O., Chichilnisky, E. J., Simoncelli, E. P. M I T PRESS. 2002: 269–276
  • Adaptation to temporal contrast in primate and salamander retina JOURNAL OF NEUROSCIENCE Chander, D., Chichilnisky, E. J. 2001; 21 (24): 9904-9916

    Abstract

    Visual adaptation to temporal contrast (intensity modulation of a spatially uniform, randomly flickering stimulus) was examined in simultaneously recorded ensembles of retinal ganglion cells (RGCs) in tiger salamander and macaque monkey retina. Slow contrast adaptation similar to that recently discovered in salamander and rabbit retina was observed in monkey retina. A novel method was developed to quantify the effect of temporal contrast on steady-state sensitivity and kinetics of light responses, separately from nonlinearities that would otherwise significantly contaminate estimates of sensitivity. Increases in stimulus contrast progressively and reversibly attenuated and sped light responses in both salamander and monkey RGCs, indicating that a portion of the contrast adaptation observed in visual cortex originates in the retina. The effect of adaptation on sensitivity and kinetics differed in simultaneously recorded populations of ON and OFF cells. In salamander, adaptation affected the sensitivity of OFF cells more than ON cells. In monkey, adaptation affected the sensitivity of ON cells more than OFF cells. In both species, adaptation sped the light responses of OFF cells more than ON cells. Functionally defined subclasses of ON and OFF cells also exhibited asymmetric adaptation. These findings indicate that contrast adaptation differs in parallel retinal circuits that convey distinct visual signals to the brain.

    View details for DOI 10.1523/JNEUROSCI.21-24-09904.2001

    View details for Web of Science ID 000172654800040

    View details for PubMedID 11739598

    View details for PubMedCentralID PMC6763043

  • A simple white noise analysis of neuronal light responses NETWORK-COMPUTATION IN NEURAL SYSTEMS Chichilnisky, E. J. 2001; 12 (2): 199-213

    Abstract

    A white noise technique is presented for estimating the response properties of spiking visual system neurons. The technique is simple, robust, efficient and well suited to simultaneous recordings from multiple neurons. It provides a complete and easily interpretable model of light responses even for neurons that display a common form of response nonlinearity that precludes classical linear systems analysis. A theoretical justification of the technique is presented that relies only on elementary linear algebra and statistics. Implementation is described with examples. The technique and the underlying model of neural responses are validated using recordings from retinal ganglion cells, and in principle are applicable to other neurons. Advantages and disadvantages of the technique relative to classical approaches are discussed.

    View details for DOI 10.1088/0954-898X/12/2/306

    View details for Web of Science ID 000169077500006

    View details for PubMedID 11405422

  • Receptive-field microstructure of blue-yellow ganglion cells in primate retina NATURE NEUROSCIENCE Chichilnisky, E. J., Baylor, D. A. 1999; 2 (10): 889-893

    Abstract

    We examined the functional microcircuitry of cone inputs to blue-ON/yellow-OFF (BY) ganglion cells in the macaque retina using multielectrode recording. BY cells were identified by their ON responses to blue light and OFF responses to red or green light. Cone-isolating stimulation indicated that ON responses originated in short (S) wavelength-sensitive cones, whereas OFF responses originated in both long (L) and middle (M) wavelength-sensitive cones. Stimulation with fine spatial patterns revealed locations of individual S cones in BY cell receptive fields. Neighboring BY cells received common but unequal inputs from one or more S cones. Inputs from individual S cones differed in strength, indicating different synaptic weights, and summed approximately linearly to control BY cell firing.

    View details for Web of Science ID 000083883200014

    View details for PubMedID 10491609

  • Trichromatic opponent color classification VISION RESEARCH Chichilnisky, E. J., Wandell, B. A. 1999; 39 (20): 3444-3458

    Abstract

    Stimuli varying in intensity and chromaticity, presented on numerous backgrounds, were classified into red/green, blue/yellow and white/black opponent color categories. These measurements revealed the shapes of the boundaries that separate opponent colors in three-dimensional color space. Opponent color classification boundaries were generally not planar, but their shapes could be summarized by a piecewise linear model in which increment and decrement color signals are combined with different weights at two stages to produce opponent color sensations. The effect of background light on classification was largely explained by separate gain changes in increment and decrement cone signals.

    View details for Web of Science ID 000081693700011

    View details for PubMedID 10615508

  • Single S cone inputs to blue-on ganglion cells in monkey retina Chichilnisky, E. J., Baylor, D. A. ASSOC RESEARCH VISION OPHTHALMOLOGY INC. 1999: S589
  • Increment-decrement asymmetry in adaptation VISION RESEARCH Chichilnisky, E. J., Wandell, B. A. 1997; 37 (5): 616
  • Seeing gray through the ON and OFF pathways VISUAL NEUROSCIENCE Chichilnisky, E. J., Wandell, B. A. 1996; 13 (3): 591-596

    Abstract

    Color appearance judgments revealed fundamental differences in visual processing of incremental and decremental lights. First, the balance of cone activation required for a light to appear achromatic was different for increments and decrements (Judd, 1940; Helson & Michels, 1948). Second, adaptation--the visual system's adjustment to background light--affected achromatic decrements more than increments. Third, the regulation of adaptation for incremental and decremental stimuli depended differently on background signals from the three cone types. We interpret these asymmetries as differences in mechanisms of adaptation in the ON and OFF pathways, and suggest that they evolved to accommodate the range and physical sources of color signals in the two pathways.

    View details for Web of Science ID A1996UH52800020

    View details for PubMedID 8782387

  • CHROMATIC ADAPTATION AFFECTS ACHROMATIC INCREMENT AND DECREMENT SETTINGS DIFFERENTLY CHICHILNISKY, E. J., WANDELL, B. A. LIPPINCOTT-RAVEN PUBL. 1995: S209
  • PHOTORECEPTOR SENSITIVITY CHANGES EXPLAIN COLOR APPEARANCE SHIFTS INDUCED BY LARGE UNIFORM BACKGROUNDS IN DICHOPTIC MATCHING VISION RESEARCH Chichilnisky, E. J., Wandell, B. A. 1995; 35 (2): 239-254

    Abstract

    Photoreceptor sensitivity changes explained the effect of large uniform backgrounds on the color appearance of small targets in a dichoptic asymmetric color matching experiment. Subjects viewed in each eye a target superimposed on a large background. The backgrounds presented to the two eyes had different spectral compositions. Subjects adjusted the target seen by the right eye to match the appearance of the target seen by the left eye. Receptor sensitivity changes explained the effect of numerous adapting backgrounds on the color appearance of many targets with high precision. Post-receptoral sensitivity changes provided a poorer account of the data. The apparent sensitivity of each receptor class varied inversely with changes in background light absorbed by that receptor class, but did not depend on background light absorbed by the other two receptor classes.

    View details for Web of Science ID A1995QA11800005

    View details for PubMedID 7839619

  • FMRI OF HUMAN VISUAL-CORTEX NATURE Engel, S. A., Rumelhart, D. E., Wandell, B. A., Lee, A. T., Glover, G. H., Chichilnisky, E. J., Shadlen, M. N. 1994; 369 (6481): 525-525

    View details for Web of Science ID A1994NR29400030

    View details for PubMedID 8031403

  • CONE SENSITIVITY CHANGES EXPLAIN COLOR MATCHES UNDER DICHOPTIC CHROMATIC ADAPTATION WANDELL, B. A., CHICHILNISKY, E. J. LIPPINCOTT-RAVEN PUBL. 1994: 1836
  • FUNCTIONAL SEGREGATION OF COLOR AND MOTION PERCEPTION EXAMINED IN MOTION NULLING VISION RESEARCH Chichilnisky, E. J., Heeger, D., Wandell, B. A. 1993; 33 (15): 2113-2125

    Abstract

    We examine two hypotheses about the functional segregation of color and motion perception, using a motion nulling task. The most common interpretation of functional segregation, that motion perception depends only on one of the three dimensions of color, is rejected. We propose and test an alternative formulation of functional segregation: that motion perception depends on a univariate motion signal driven by all three color dimensions, and that the motion signal is determined by the product of the stimulus contrast and a term that depends only on the relative cone excitations. Two predictions of this model are confirmed. First, motion nulling is transitive: when two stimuli null a third they also null another. Second, motion nulling is homogeneous: if two stimuli null one another, they continue to null one another when their contrasts are scaled equally. We describe how to apply our formulation of functional segregation to other behavioral and physiological measurements.

    View details for Web of Science ID A1993LQ40900010

    View details for PubMedID 8266653

  • MOTION NULLING IS NOT MONOCHROMATIC CHICHILNISKY, E. J., HEEGER, D., WANDELL, B. A. LIPPINCOTT-RAVEN PUBL. 1992: 954
  • A MATHEMATICAL-MODEL OF PATTERN-FORMATION JOURNAL OF THEORETICAL BIOLOGY CHICHILNISKY, E. J. 1986; 123 (1): 81-101

    Abstract

    This paper presents an explicit mathematical model describing pattern formation in monolayer epithelia. The approach is a generalization of the equations describing soap bubble configurations (Plateau, 1873; Thompson, 1917; Almgren & Taylor, 1976) that allows adjacent cells to adhere with differing intensities (Steinberg, 1962, 1978). The model is a system of simultaneous non-linear equations that considers cell-cell interactions in a two-dimensional sheet. The implementation involves using the equations of the model to predict explicitly the energy-minimizing configuration of a system of cells, based on the adhesivity of their membranes. The model can thus be used to explore the effects of varying adhesions on the dynamics of pattern formation. Following Chichilnisky (1985), such a descriptive system is introduced in this paper, and its predictive properties explored.

    View details for DOI 10.1016/S0022-5193(86)80237-5

    View details for Web of Science ID A1986E803100007

    View details for PubMedID 3626586