Brian A. Wandell
Isaac and Madeline Stein Family Professor and Professor, by courtesy, of Electrical Engineering, of Ophthalmology and of Education
Psychology
Web page: http://www.stanford.edu/~wandell
Bio
Brian A. Wandell is the first Isaac and Madeline Stein Family Professor. He is a member of the Stanford Psychology faculty and a member, by courtesy, of Electrical Engineering, Ophthalmology, and the Graduate School of Education. He directs Stanford's Center for Cognitive and Neurobiological Imaging, an MRI service center, and he was deputy director of the Wu Tsai Neurosciences Institute from 2013-2021. Wandell’s research centers on vision science, spanning topics from visual disorders, reading development in children, to digital imaging devices and algorithms for both magnetic resonance imaging and digital imaging. Wandell’s work in visual neuroscience uses functional, structural and quantitative MRI along with behavior testing and modeling to understand the action of the visual portions of the brain. His lab has worked to identify and then understand the organization of the visual field maps in the human brain, color and motion processing within these maps, the potential for reorganization following injury, and the development of the cortical circuitry for reading. The Wandell lab develops software tools for digital imaging applications. The software includes methods for analyzing magnetic resonance imaging (MRI) data, as well as tools to design and evaluate cameras used in a range of applications: consumer photography, medical imaging, and artificial intelligence for automotive applications. Wandell's work has led to commercial applications including two companies that he co-founded, Imageval, LLC and Flywheel.io, LLC.
Academic Appointments
-
Professor, Psychology
-
Professor (By courtesy), Electrical Engineering
-
Professor (By courtesy), Ophthalmology
-
Professor (By courtesy), Graduate School of Education
-
Member, Bio-X
-
Member, Wu Tsai Neurosciences Institute
Administrative Appointments
-
Chair, Psychology (2006 - 2009)
-
Advisory Board Chair, Stanford's Center for Cognitive and Neurobiological Imaging (2023 - Present)
-
Director, Stanford's Center for Cognitive and Neurobiological Imaging (2010 - 2023)
-
Deputy Director, Wu Tsai Neurosciences Institute (2013 - 2021)
Honors & Awards
-
Proctor Medal, Association for Research in Vision and Ophthalmology (2021)
-
George Miller Prize, Cognitive Neuroscience Society (2016)
-
Oberdorfer Award, ARVO (2012)
-
Member, American Academy of Arts and Sciences (2011)
-
Electronic Imaging Scientist of the Year, SPIE/IS&T (2007)
-
Member, US National Academy of Sciences (2003)
-
Macbeth Prize, Inter-Society Color Council (2000)
-
Edridge-Green Medal in Ophthalmology for work in visual neuroscience, Edridge-Green Medal in Ophthalmology for work in visual neuroscience (1997)
-
Senior Investigator, McKnight (1997)
-
Fellow, Optical Society of America (1990)
-
Troland Research Award, National Academy of Sciences (1986)
Boards, Advisory Committees, Professional Organizations
-
Scientific Advisory Board, Dept. Neurobiology, Weizmann Institute of Science (2009 - 2014)
-
Advisory board, Max Planck Institue for Cybernetics, Tuebingen (2005 - 2014)
-
Board member, Ontario brain institute (2013 - 2016)
-
Class president, National Academy of Sciences (2012 - 2015)
Program Affiliations
-
Symbolic Systems Program
Professional Education
-
PhD, UC Irvine, Social Sciences (1977)
Research Interests
-
Brain and Learning Sciences
-
Psychology
-
Technology and Education
Current Research and Scholarly Interests
Visual perception
Professor Wandell's work in visual neuroscience uses both neuroimaging and computational models to understand the action of the visual portions of the brain. His team has developed a set of magnetic resonance imaging methods for identifying and measuring distinct and specialized regions of human visual cortex and the connections between them. His team has been particularly interested in measuring the development of brain function and reorganization following injury or abnormal development.
Along with a group of colleagues around the world, Wandell is developing software simulations to model how light is encoded by the human eye and through advanced optics in new camera designs. The open-source ISET project generates physically realistic descriptions of three dimensional scene radiances and how they are transformed by the optics and then evoke responses in camera sensors or in the retinal and cortical circuitry of in the brain. (https://github.com/iset)
Reading development
The Wandell lab is applying a powerful set of MRI measurement methodologies to study human brain development. These include diffusion measures, functional measures, and novel approaches for assessing quantitative tissue properties such as tissue volume and chemistry. In one group of studies, they are measuring the signals and growth of visual cortex in children, aged 8-12, during the period children become skilled readers. Using very high spatial resolution and neuroimaging techniques, including some methods developed by this group, the lab is hoping to understand how visual signals contribute to the neural pathways of reading. These measurements of the developmental changes during the acquisition of skilled reading are intended to explain how visual signals are rapidly identified and classified as we read.
Data management and computational methods
In support of reproducible research in neuroimaging, Professor Wandell and his team implemented a data and computational management system for medical imaging. The original system (Neurobiological Image Management System) was developed with the support of the Simons Foundation and used at the MRI Center Professor Wandell directs. That system has evolved into a commercial product that supports cloud-scale collaborative science (https://flywheel.io/). The Flywheel system is deployed at more than thirty neuroimaging research centers and companies around the world.
2024-25 Courses
- Human Neuroimaging Methods
PSYCH 204A (Win) - Image Systems Engineering
PSYCH 221, SYMSYS 195I (Aut) - Seminar Series for Image Systems Engineering
EE 292E (Aut, Win, Spr) -
Independent Studies (8)
- Directed Reading in Neurosciences
NEPR 299 (Aut, Win, Spr, Sum) - Graduate Research
NEPR 399 (Aut, Win, Spr, Sum) - Graduate Research
PSYCH 275 (Aut, Win, Spr, Sum) - Graduate Research
PSYCH 276 (Aut, Win, Spr, Sum) - Master's Degree Project
SYMSYS 290 (Aut, Win, Spr, Sum) - Practicum in Teaching
PSYCH 281 (Aut, Win, Spr, Sum) - Reading and Special Work
PSYCH 194 (Aut, Win, Spr, Sum) - Special Laboratory Projects
PSYCH 195 (Aut, Win, Spr, Sum)
- Directed Reading in Neurosciences
-
Prior Year Courses
2023-24 Courses
- Human Neuroimaging Methods
PSYCH 204A (Win) - Image Systems Engineering
PSYCH 221, SYMSYS 195I (Aut) - Seminar Series for Image Systems Engineering
EE 292E (Aut, Win, Spr)
2022-23 Courses
- Human Neuroimaging Methods
PSYCH 204A (Win) - Image Systems Engineering
PSYCH 221, SYMSYS 195I (Aut) - Seminar Series for Image Systems Engineering
EE 292E (Aut, Win, Spr)
2021-22 Courses
- Human Neuroimaging Methods
PSYCH 204A (Win) - Image Systems Engineering
PSYCH 221, SYMSYS 195I (Aut) - Seminar Series for Image Systems Engineering
EE 292E (Aut, Win, Spr)
- Human Neuroimaging Methods
Stanford Advisees
-
Doctoral Dissertation Reader (AC)
Insub Kim, Emily Kubota, Austin Kuo, Joshua Ryu, Haley So, Itamar Terem
All Publications
-
Deriving the cone fundamentals: a subspace intersection method.
Proceedings. Biological sciences
2024; 291 (2030): 20240347
Abstract
Two ideas, proposed by Thomas Young and James Clerk Maxwell, form the foundations of colour science: (i) three types of retinal receptors encode light under daytime conditions, and (ii) colour matching experiments establish the critical spectral properties of this encoding. Experimental quantification of these ideas is used in international colour standards. However, for many years, the field did not reach consensus on the spectral properties of the biological substrate of colour matching: the spectral sensitivity of the cone fundamentals. By combining auxiliary data (thresholds, inert pigment analyses), complex calculations, and colour matching from genetically analysed dichromats, the human cone fundamentals have now been standardized. Here, we describe a new computational method to estimate the cone fundamentals using only colour matching from the three types of dichromatic observers. We show that it is not necessary to include data from trichromatic observers in the analysis or to know the primary lights used in the matching experiments. Remarkably, it is even possible to estimate the fundamentals by combining data from experiments using different, unknown primaries. We then suggest how the new method may be applied to colour management in modern image systems.
View details for DOI 10.1098/rspb.2024.0347
View details for PubMedID 39226931
View details for PubMedCentralID PMC11371420
-
Measuring brain beats: Cardiac-aligned fast functional magnetic resonance imaging signals.
Human brain mapping
2022
Abstract
Blood and cerebrospinal fluid (CSF) pulse and flow throughout the brain, driven by the cardiac cycle. These fluid dynamics, which are essential to healthy brain function, are characterized by several noninvasive magnetic resonance imaging (MRI) methods. Recent developments in fast MRI, specifically simultaneous multislice acquisition methods, provide a new opportunity to rapidly and broadly assess cardiac-driven flow, including CSF spaces, surface vessels and parenchymal vessels. We use these techniques to assess blood and CSF flow dynamics in brief (3.5min) scans on a conventional 3T MRI scanner in five subjects. Cardiac pulses are measured with a photoplethysmography (PPG) on the index finger, along with functional MRI (fMRI) signals in the brain. We, retrospectively, align the fMRI signals to the heartbeat. Highly reliable cardiac-gated fMRI temporal signals are observed in CSF and blood on the timescale of one heartbeat (test-retest reliability within subjects R2 >50%). In blood vessels, a local minimum is observed following systole. In CSF spaces, the ventricles and subarachnoid spaces have a local maximum following systole instead. Slower resting-state scans with slice timing, retrospectively, aligned to the cardiac pulse, reveal similar cardiac-gated responses. The cardiac-gated measurements estimate the amplitude and phase of fMRI pulsations in the CSF relative to those in the arteries, an estimate of the local intracranial impedance. Cardiac aligned fMRI signals can provide new insights about fluid dynamics or diagnostics for diseases where these dynamics are important.
View details for DOI 10.1002/hbm.26128
View details for PubMedID 36308417
-
Validation of Physics-Based Image Systems Simulation With 3-D Scenes
IEEE SENSORS JOURNAL
2022; 22 (20): 19400-19410
View details for DOI 10.1109/JSEN.2022.3199699
View details for Web of Science ID 000870341900036
-
Visual encoding: Principles and software.
Progress in brain research
2022; 273 (1): 199-229
Abstract
For more than two centuries scientists and engineers have worked to understand and model how the eye encodes electromagnetic radiation (light). We now understand the principles of how light is transmitted through the optics of the eye and encoded by retinal photoreceptors and light-sensitive neurons. In recent years, new instrumentation has enabled scientists to measure the specific parameters of the optics and photoreceptor encoding. We implemented the principles and parameter estimates that characterize the human eye in an open-source software toolbox. This chapter describes the principles behind these tools and illustrates how to use them to compute the initial visual encoding.
View details for DOI 10.1016/bs.pbr.2022.04.006
View details for PubMedID 35940717
-
A computational observer model of spatial contrast sensitivity: Effects of photocurrent encoding, fixational eye movements, and inference engine
JOURNAL OF VISION
2020; 20 (7): 17
Abstract
We have recently shown that the relative spatial contrast sensitivity function (CSF) of a computational observer operating on the cone mosaic photopigment excitations of a stationary retina has the same shape as human subjects. Absolute human sensitivity, however, is 5- to 10-fold lower than the computational observer. Here we model how additional known features of early vision affect the CSF: fixational eye movements and the conversion of cone photopigment excitations to cone photocurrents (phototransduction). For a computational observer that uses a linear classifier applied to the responses of a stimulus-matched linear filter, fixational eye movements substantially change the shape of the CSF by reducing sensitivity above 10 c/deg. For a translation-invariant computational observer that operates on the squared response of a quadrature-pair of linear filters, the CSF shape is little changed by eye movements, but there is a two fold reduction in sensitivity. Phototransduction dynamics introduce an additional two fold sensitivity decrease. Hence, the combined effects of fixational eye movements and phototransduction bring the absolute CSF of the translation-invariant computational observer to within a factor of 1 to 2 of the human CSF. We note that the human CSF depends on processing of the retinal representation by many thalamo-cortical neurons, which are individually quite noisy. Our modeling suggests that the net effect of post-retinal noise on contrast-detection performance, when considered at the neural population and behavioral level, is quite small: The inference mechanisms that determine the CSF, presumably in cortex, make efficient use of the information carried by the cone photocurrents of the fixating eye.
View details for DOI 10.1167/jov.20.7.17
View details for Web of Science ID 000561869800026
View details for PubMedID 32692826
View details for PubMedCentralID PMC7424933
-
A validation framework for neuroimaging software: The case of populationreceptive fields.
PLoS computational biology
2020; 16 (6): e1007924
Abstract
Neuroimaging software methods are complex, making it a near certainty that some implementations will contain errors. Modern computational techniques (i.e., public code and data repositories, continuous integration, containerization) enable the reproducibility of the analyses and reduce coding errors, but they do not guarantee the scientific validity of the results. It is difficult, nay impossible, for researchers to check the accuracy of software by reading the source code; ground truth test datasets are needed. Computational reproducibility means providing software so that for the same input anyone obtains the same result, right or wrong. Computational validity means obtaining the right result for the ground-truth test data. We describe a framework for validating and sharing software implementations, and we illustrate its usage with an example application: population receptive field (pRF) methods for functional MRI data. The framework is composed of three main components implemented with containerization methods to guarantee computational reproducibility. In our example pRF application, those components are: (1) synthesis of fMRI time series from ground-truth pRF parameters, (2) implementation of four public pRF analysis tools and standardization of inputs and outputs, and (3) report creation to compare the results with the ground truth parameters. The framework was useful in identifying realistic conditions that lead to imperfect parameter recovery in all four pRF implementations, that would remain undetected using classic validation methods. We provide means to mitigate these problems in future experiments. A computational validation framework supports scientific rigor and creativity, as opposed to the oft-repeated suggestion that investigators rely upon a few agreed upon packages. We hope that the framework will be helpful to validate other critical neuroimaging algorithms, as having a validation framework helps (1) developers to build new software, (2) research scientists to verify the software's accuracy, and (3) reviewers to evaluate the methods used in publications and grants.
View details for DOI 10.1371/journal.pcbi.1007924
View details for PubMedID 32584808
-
Neural Network Generalization: The Impact of Camera Parameters
IEEE ACCESS
2020; 8: 10443–54
View details for DOI 10.1109/ACCESS.2020.2965089
View details for Web of Science ID 000525404800008
-
A computational-observer model of spatial contrast sensitivity: Effects of wave-front-based optics, cone-mosaic structure, and inference engine.
Journal of vision
2019; 19 (4): 8
Abstract
We present a computational-observer model of the human spatial contrast-sensitivity function based on the Image Systems Engineering Toolbox for Biology (ISETBio) simulation framework. We demonstrate that ISETBio-derived contrast-sensitivity functions agree well with ones derived using traditional ideal-observer approaches, when the mosaic, optics, and inference engine are matched. Further simulations extend earlier work by considering more realistic cone mosaics, more recent measurements of human physiological optics, and the effect of varying the inference engine used to link visual representations to psychophysical performance. Relative to earlier calculations, our simulations show that the spatial structure of realistic cone mosaics reduces the upper bounds on performance at low spatial frequencies, whereas realistic optics derived from modern wave-front measurements lead to increased upper bounds at high spatial frequencies. Finally, we demonstrate that the type of inference engine used has a substantial effect on the absolute level of predicted performance. Indeed, the performance gap between an ideal observer with exact knowledge of the relevant signals and human observers is greatly reduced when the inference engine has to learn aspects of the visual task. ISETBio-derived estimates of stimulus representations at various stages along the visual pathway provide a powerful tool for computing the limits of human performance.
View details for PubMedID 30943530
-
Ray tracing 3D spectral scenes through human optics models.
Journal of vision
2019; 19 (12): 23
Abstract
Scientists and engineers have created computations and made measurements that characterize the first steps of seeing. ISETBio software integrates such computations and data into an open-source software package. The initial ISETBio implementations modeled image formation (physiological optics) for planar or distant scenes. The ISET3d software described here extends that implementation, simulating image formation for three-dimensional scenes. The software system relies on a quantitative computer graphics program that ray traces the scene radiance through the physiological optics to the retinal irradiance. We describe and validate the implementation for several model eyes. Then, we use the software to quantify the impact of several physiological optics parameters on three-dimensional image formation. ISET3d is integrated with ISETBio, making it straightforward to convert the retinal irradiance into cone excitations. These methods help the user compute the predictions of optics models for a wide range of spatially rich three-dimensional scenes. They can also be used to evaluate the impact of nearby visual occlusion, the information available to binocular vision, or the retinal images expected from near-field and augmented reality displays.
View details for DOI 10.1167/19.12.23
View details for PubMedID 31658357
-
Diagnosing the Neural Circuitry of Reading
NEURON
2017; 96 (2): 298–311
Abstract
We summarize the current state of knowledge of the brain's reading circuits, and then we describe opportunities to use quantitative and reproducible methods for diagnosing these circuits. Neural circuit diagnostics-by which we mean identifying the locations and responses in an individual that differ significantly from measurements in good readers-can help parents and educators select the best remediation strategy. A sustained effort to develop and share diagnostic methods can support the societal goal of improving literacy.
View details for PubMedID 29024656
-
Computational neuroimaging and population receptive fields.
Trends in cognitive sciences
2015; 19 (6): 349-357
Abstract
Functional magnetic resonance imaging (fMRI) noninvasively measures human brain activity at millimeter resolution. Scientists use different approaches to take advantage of the remarkable opportunities presented by fMRI. Here, we describe progress using the computational neuroimaging approach in human visual cortex, which aims to build models that predict the neural responses from the stimulus and task. We focus on a particularly active area of research, the use of population receptive field (pRF) models to characterize human visual cortex responses to a range of stimuli, in a variety of tasks and different subject populations.
View details for DOI 10.1016/j.tics.2015.03.009
View details for PubMedID 25850730
View details for PubMedCentralID PMC4484758
-
The vertical occipital fasciculus: A century of controversy resolved by in vivo measurements
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA
2014; 111 (48): E5214-E5223
Abstract
The vertical occipital fasciculus (VOF) is the only major fiber bundle connecting dorsolateral and ventrolateral visual cortex. Only a handful of studies have examined the anatomy of the VOF or its role in cognition in the living human brain. Here, we trace the contentious history of the VOF, beginning with its original discovery in monkey by Wernicke (1881) and in human by Obersteiner (1888), to its disappearance from the literature, and recent reemergence a century later. We introduce an algorithm to identify the VOF in vivo using diffusion-weighted imaging and tractography, and show that the VOF can be found in every hemisphere (n = 74). Quantitative T1 measurements demonstrate that tissue properties, such as myelination, in the VOF differ from neighboring white-matter tracts. The terminations of the VOF are in consistent positions relative to cortical folding patterns in the dorsal and ventral visual streams. Recent findings demonstrate that these same anatomical locations also mark cytoarchitectonic and functional transitions in dorsal and ventral visual cortex. We conclude that the VOF is likely to serve a unique role in the communication of signals between regions on the ventral surface that are important for the perception of visual categories (e.g., words, faces, bodies, etc.) and regions on the dorsal surface involved in the control of eye movements, attention, and motion perception.
View details for DOI 10.1073/pnas.1418503111
View details for Web of Science ID 000345920800011
View details for PubMedID 25404310
View details for PubMedCentralID PMC4260539
-
Evaluation and statistical inference for human connectomes
NATURE METHODS
2014; 11 (10): 1058-1063
Abstract
Diffusion-weighted imaging coupled with tractography is currently the only method for in vivo mapping of human white-matter fascicles. Tractography takes diffusion measurements as input and produces the connectome, a large collection of white-matter fascicles, as output. We introduce a method to evaluate the evidence supporting connectomes. Linear fascicle evaluation (LiFE) takes any connectome as input and predicts diffusion measurements as output, using the difference between the measured and predicted diffusion signals to quantify the prediction error. We use the prediction error to evaluate the evidence that supports the properties of the connectome, to compare tractography algorithms and to test hypotheses about tracts and connections.
View details for Web of Science ID 000342719100026
View details for PubMedCentralID PMC4180802
-
Lifespan maturation and degeneration of human brain white matter
NATURE COMMUNICATIONS
2014; 5
Abstract
Properties of human brain tissue change across the lifespan. Here we model these changes in the living human brain by combining quantitative magnetic resonance imaging (MRI) measurements of R1 (1/T1) with diffusion MRI and tractography (N=102, ages 7-85). The amount of R1 change during development differs between white-matter fascicles, but in each fascicle the rate of development and decline are mirror-symmetric; the rate of R1 development as the brain approaches maturity predicts the rate of R1 degeneration in aging. Quantitative measurements of macromolecule tissue volume (MTV) confirm that R1 is an accurate index of the growth of new brain tissue. In contrast to R1, diffusion development follows an asymmetric time-course with rapid childhood changes but a slow rate of decline in old age. Together, the time-courses of R1 and diffusion changes demonstrate that multiple biological processes drive changes in white-matter tissue properties over the lifespan.
View details for DOI 10.1038/ncomms5932
View details for Web of Science ID 000209869600001
View details for PubMedCentralID PMC4238904
-
Reproducible Tract Profiles 2 (RTP2) suite, from diffusion MRI acquisition to clinical practice and research.
Scientific reports
2023; 13 (1): 6010
Abstract
Diffusion MRI is a complex technique, where new discoveries and implementations occur at a fast pace. The expertise needed for data analyses and accurate and reproducible results is increasingly demanding and requires multidisciplinary collaborations. In the present work we introduce Reproducible Tract Profiles 2 (RTP2), a set of flexible and automated methods to analyze anatomical MRI and diffusion weighted imaging (DWI) data for reproducible tractography. RTP2 reads structural MRI data and processes them through a succession of serialized containerized analyses. We describe the DWI algorithms used to identify white-matter tracts and their summary metrics, the flexible architecture of the platform, and the tools to programmatically access and control the computations. The combination of these three components provides an easy-to-use automatized tool developed and tested over 20 years, to obtain usable and reliable state-of-the-art diffusion metrics at the individual and group levels for basic research and clinical practice.
View details for DOI 10.1038/s41598-023-32924-7
View details for PubMedID 37045891
View details for PubMedCentralID 5480810
-
Ray-transfer functions for camera simulation of 3D scenes with hidden lens design
OPTICS EXPRESS
2022; 30 (13): 24031-24047
View details for DOI 10.1364/OE.457496
View details for Web of Science ID 000813479600143
-
Simulations of fluorescence imaging in the oral cavity
BIOMEDICAL OPTICS EXPRESS
2021; 12 (7): 4276-4292
View details for DOI 10.1364/BOE.429995
View details for Web of Science ID 000670305800003
-
Population receptive field shapes in early visual cortex are nearly circular.
The Journal of neuroscience : the official journal of the Society for Neuroscience
2021
Abstract
The visual field region where a stimulus evokes a neural response is called the receptive field (RF). Analytical tools combined with functional MRI can estimate the receptive field of the population of neurons within a voxel. Circular population RF (pRF) methods accurately specify the central position of the pRF and provide some information about the spatial extent (diameter) of the receptive field. A number of investigators developed methods to further estimate the shape of the pRF, for example whether the shape is more circular or elliptical. There is a report that there are many pRFs with highly elliptical pRFs in early visual cortex (V1-V3; Silson et al., 2018). Large aspect ratios (>2) are difficult to reconcile with the spatial scale of orientation columns or visual field map properties in early visual cortex. We started to replicate the experiments and found that the software used in the publication does not accurately estimate RF shape: it produces elliptical fits to circular ground-truth data. We analyzed an independent data set with a different software package that was validated over a specific range of measurement conditions, to show that in early visual cortex the aspect ratios are less than 2. Furthermore, current empirical and theoretical methods do not have enough precision to discriminate ellipses with aspect ratios of 1.5 from circles. Through simulation we identify methods for improving sensitivity that may estimate ellipses with smaller aspect ratios. The results we present are quantitatively consistent with prior assessments using other methodologies.SIGNIFICANCE STATEMENT:We evaluated whether the shape of many population receptive fields in early visual cortex is elliptical and differs substantially from circular. We evaluated two tools for estimating elliptical models of the pRF; one tool was valid over the measured compliance range. Using the validated tool, we found no evidence that confidently rejects circular fits to the pRF in visual field maps V1, V2 and V3. The new measurements and analyses are consistent with prior theoretical and experimental assessments in the literature.
View details for DOI 10.1523/JNEUROSCI.3052-20.2021
View details for PubMedID 33531414
-
ISETAuto: Detecting Vehicles With Depth and Radiance Information
IEEE ACCESS
2021; 9: 41799–808
View details for DOI 10.1109/ACCESS.2021.3063692
View details for Web of Science ID 000633618900001
-
Data-science ready, multisite, human diffusion MRI white-matter-tract statistics.
Scientific data
2020; 7 (1): 422
Abstract
The white matter tracts in the living human brain are critical for healthy function, and the diffusion MRI measured in these tracts is correlated with diverse behavioral measures. The technical skills required to analyze diffusion MRI data are complex: data acquisition requires MRI sequence development and acquisition expertise, analyzing raw-data into meaningful summary statistics requires computational neuroimaging and neuroanatomy expertise. The human white matter study field will advance faster if the tract summaries are available in plain data-science-ready format for non-diffusion MRI experts, such as statisticians, computer graphic researchers or data scientists in general. Here, we share a curated and processed dataset from three different MRI centers in a format that is data-science ready. The multisite data we share include measures of within and between MRI center variation in white-matter-tract diffusion measurements. Along with the dataset description and summary statistics, we describe the state-of-the-art computational system that guarantees reproducibility and provenance from the original scanner output.
View details for DOI 10.1038/s41597-020-00760-3
View details for PubMedID 33257659
-
V1 Projection Zone Signals in Human Macular Degeneration Depend on Task Despite Absence of Visual Stimulus.
Current biology : CB
2020
Abstract
Identifying the plastic and stable components of the visual cortex after retinal loss is an important topic in visual neuroscience and neuro-ophthalmology.1-5 Humans with juvenile macular degeneration (JMD) show significant blood-oxygen-level-dependent (BOLD) responses in the primary visual area (V1) lesion projection zone (LPZ),6 despite the absence of the feedforward signals from the degenerated retina. Our previous study7 reported that V1 LPZ responds to full-field visual stimuli during the one-back task (OBT), not during passive viewing, suggesting the involvement of task-related feedback signals. Aiming to clarify whether visual inputs to the intact retina are necessary for the LPZ responses, here, we measured BOLD responses to tactile and auditory stimuli for both JMD patients and control participants with and without OBT. Participants were instructed to close their eyes during the experiment for the purpose of eliminating retinal inputs. Without OBT, no V1 responses were detected in both groups of participants. With OBT, to the contrary, both stimuli caused substantial V1 responses in JMD patients, but not controls. Furthermore, we also found that the task-dependent activity in V1 LPZ became less pronounced when JMD patients opened their eyes, suggesting that task-related feedback signals can be partially suppressed by residual feedforward signals. Modality-independent V1 LPZ responses only in the task condition suggest that V1 LPZ responses reflect task-related feedback signals rather than reorganized feedforward visual inputs.
View details for DOI 10.1016/j.cub.2020.10.034
View details for PubMedID 33157025
-
The human connectome project for disordered emotional states: Protocol and rationale for a research domain criteria study of brain connectivity in young adult anxiety and depression.
NeuroImage
2020: 116715
Abstract
Through the Human Connectome Project (HCP) our understanding of the functional connectome of the healthy brain has been dramatically accelerated. Given the pressing public health need, we must increase our understanding of how connectome dysfunctions give rise to disordered mental states. Mental disorders arising from high levels of negative emotion or from the loss of positive emotional experience affect over 400 million people globally. Such states of disordered emotion cut across multiple diagnostic categories of mood and anxiety disorders and are compounded by accompanying disruptions in cognitive function. Not surprisingly, these forms of psychopathology are the leading cause of disability worldwide. The Research Domain Criteria (RDoC) initiative spearheaded by NIMH offers a framework for characterizing the relations among connectome dysfunctions, anchored in neural circuits and phenotypic profiles of behavior and self-reported symptoms. Here, we report on our Connectomes Related to Human Disease protocol for integrating an RDoC framework with HCP protocols to characterize connectome dysfunctions in disordered emotional states, and present quality control data from a representative sample of participants. We focus on three RDoC domains and constructs most relevant to depression and anxiety: 1) loss and acute threat within the Negative Valence System (NVS) domain; 2) reward valuation and responsiveness within the Positive Valence System (PVS) domain; and 3) working memory and cognitive control within the Cognitive System (CS) domain. For 29 healthy controls, we present preliminary imaging data: functional magnetic resonance imaging collected in the resting state and in tasks matching our constructs of interest ("Emotion", "Gambling" and "Continuous Performance" tasks), as well as diffusion-weighted imaging. All functional scans demonstrated good signal-to-noise ratio. Established neural networks were robustly identified in the resting state condition by independent component analysis. Processing of negative emotional faces significantly activated the bilateral dorsolateral prefrontal and occipital cortices, fusiform gyrus and amygdalae. Reward elicited a response in the bilateral dorsolateral prefrontal, parietal and occipital cortices, and in the striatum. Working memory was associated with activation in the dorsolateral prefrontal, parietal, motor, temporal and insular cortices, in the striatum and cerebellum. Diffusion tractography showed consistent profiles of fractional anisotropy along known white matter tracts. We also show that results are comparable to those in a matched sample from the HCP Healthy Young Adult data release. These preliminary data provide the foundation for acquisition of 250 subjects who are experiencing disordered emotional states. When complete, these data will be used to develop a neurobiological model that maps connectome dysfunctions to specific behaviors and symptoms.
View details for DOI 10.1016/j.neuroimage.2020.116715
View details for PubMedID 32147367
-
Simultaneous Surface Reflectance and Fluorescence Spectra Estimation
IEEE TRANSACTIONS ON IMAGE PROCESSING
2020; 29: 8791–8804
Abstract
There is widespread interest in estimating the fluorescence properties of natural materials in an image. However, the separation between reflected and fluoresced components is difficult, because it is impossible to distinguish reflected and fluoresced photons without controlling the illuminant spectrum. We show how to jointly estimate the reflectance and fluorescence from a single set of images acquired under multiple illuminants. We present a framework based on a linear approximation to the physical equations describing image formation in terms of surface spectral reflectance and fluorescence due to multiple fluorophores. We relax the non-convex, inverse estimation problem in order to jointly estimate the reflectance and fluorescence properties in a single optimization step. We provide a software implementation of the solver for our method and prior methods. We evaluate the accuracy and reliability of the method using both simulations and experimental data. To evaluate the methods experimentally we built a custom imaging system using a monochrome camera, a filter wheel with bandpass transmissive filters and a small number of light emitting diodes. We compared the methods based upon our framework with the ground truth as well as with prior methods.
View details for DOI 10.1109/TIP.2020.2973810
View details for Web of Science ID 000568672100004
View details for PubMedID 32112682
-
A Convolutional Neural Network Reaches Optimal Sensitivity for Detecting Some, but Not All, Patterns
IEEE ACCESS
2020; 8: 213522–30
View details for DOI 10.1109/ACCESS.2020.3040235
View details for Web of Science ID 000597201000001
-
ISETBIO: Software for the Foundations Of Vision Science
SAGE PUBLICATIONS LTD. 2019: 5–6
View details for Web of Science ID 000490535400006
-
Replication and generalization in applied neuroimaging.
NeuroImage
2019: 116048
Abstract
There is much interest in translating neuroimaging findings into meaningful clinical diagnostics. The goal of scientific discoveries differs from clinical diagnostics. Scientific discoveries must replicate under a specific set of conditions; to translate to the clinic we must show that findings using purpose-built scientific instruments will be observable in clinical populations and instruments. Here we describe and evaluate data and computational methods designed to translate a scientific observation to a clinical setting. Using diffusion weighted imaging (DWI), Wahl et al. (2010) observed that across subjects the mean fractional anisotropy (FA) of homologous pairs of tracts is highly correlated. We hypothesize that this is a fundamental biological trait that should be present in most healthy participants, and deviations from this assessment may be a useful diagnostic metric. Using this metric as an illustration of our methods, we analyzed six pairs of homologous white matter tracts in nine different DWI datasets with 44 subjects each. Considering the original FA measurement as a baseline, we show that the new metric is between 2 and 4 times more precise when used in a clinical context. Our framework to translate research findings into clinical practice can be applied, in principle, to other neuroimaging results.
View details for DOI 10.1016/j.neuroimage.2019.116048
View details for PubMedID 31356879
-
A Conversation with Jacob Nachmias.
Annual review of vision science
2019
Abstract
We are sad to report that Professor Jacob (Jack) Nachmias passed away on March 2, 2019. Nachmias was born in Athens, Greece on June 9, 1928. To escape the Nazis, he and his family came to the United States in 1939. He received his undergraduate degree from Cornell University and then an MA from Swarthmore College, where he worked with Hans Wallach and Wolfgang Kohler; his PhD in Psychology was from Harvard University. Nachmias spent the majority of his career as a Professor of Psychology at the University of Pennsylvania. He made fundamental contributions to our understanding of vision, most notably through the study of eye movements, the development of signal detection theory and forced-choice psychophysical methods, and the psychophysical characterization of spatial-frequency-selective visual channels. Nachmias' work was recognized by his election to the National Academy of Sciences and receipt of the Optical Society's Tillyer Award. Expected final online publication date for the Annual Review of Vision Science Volume 5 is September 16, 2019. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.
View details for DOI 10.1146/annurev-vision-011019-111539
View details for PubMedID 31283448
-
iEEG-BIDS, extending the Brain Imaging Data Structure specification to human intracranial electrophysiology.
Scientific data
2019; 6 (1): 102
View details for DOI 10.1038/s41597-019-0105-7
View details for PubMedID 31239438
-
A computational-observer model of spatial contrast sensitivity: Effects of wave-front-based optics, cone-mosaic structure, and inference engine
JOURNAL OF VISION
2019; 19 (4)
View details for DOI 10.1167/19.4.8
View details for Web of Science ID 000469495700008
-
Soft Prototyping Camera Designs for Car Detection Based on a Convolutional Neural Network
IEEE COMPUTER SOC. 2019: 2383–92
View details for DOI 10.1109/ICCVW.2019.00292
View details for Web of Science ID 000554591602054
-
Computational-observer analysis of illumination discrimination.
Journal of vision
2019; 19 (7): 11
Abstract
The spectral properties of the ambient illumination provide useful information about time of day and weather. We study the perceptual representation of illumination by analyzing measurements of how well people discriminate between illuminations across scene configurations. More specifically, we compare human performance to a computational-observer analysis that evaluates the information available in the isomerizations of cone photopigment in a model human photoreceptor mosaic. The performance of such an observer is limited by the Poisson variability of the number of isomerizations in each cone. The overall level of Poisson-limited computational-observer sensitivity exceeded that of human observers. This was modeled by increasing the amount of noise in the number of isomerizations of each cone. The additional noise brought the overall level of performance of the computational observer into the same range as that of human observers, allowing us to compare the pattern of sensitivity across stimulus manipulations. Key patterns of human performance were not accounted for by the computational observer. In particular, neither the elevation of illumination-discrimination thresholds for illuminant changes in a blue color direction (when thresholds are expressed in CIELUV ΔE units), nor the effects of varying the ensemble of surfaces in the scenes being viewed, could be accounted for by variation in the information available in the cone isomerizations.
View details for DOI 10.1167/19.7.11
View details for PubMedID 31323097
-
Simulation of visual perception and learning with a retinal prosthesis.
Journal of neural engineering
2018
Abstract
The nature of artificial vision with a retinal prosthesis, and the degree to which the brain can adapt to the unnatural input from such a device, are poorly understood. Therefore, the development of current and future devices may be aided by theory and simulations that help to infer and understand what prosthesis patients see. A biologically-informed, extensible computational framework is presented here to predict visual perception and the potential effect of learning with a subretinal prosthesis. The framework relies on linear reconstruction of the stimulus from retinal responses to infer the visual information available to the patient. A simulation of the physiological optics of the eye and light responses of the major retinal neurons was used to calculate the optimal linear transformation for reconstructing natural images from retinal activity. The result was then used to reconstruct the visual stimulus during the artificial activation expected from a subretinal prosthesis in a degenerated retina, as a proxy for inferred visual perception. Several simple observations reveal the potential utility of such a simulation framework. The inferred perception obtained with prosthesis activation was substantially degraded compared to the inferred perception obtained with normal retinal responses, as expected given the limited resolution and lack of cell type specificity of the prosthesis. Consistent with clinical findings and the importance of cell type specificity, reconstruction using only ON cells, and not OFF cells, was substantially more accurate. Finally, when reconstruction was re-optimized for prosthesis stimulation, simulating idealized learning by the patient, the accuracy of inferred perception was much closer to that of healthy vision. The reconstruction approach thus provides a more complete method for exploring the potential for treating blindness with retinal prostheses than has been available previously. It may also be useful for interpreting patient data in clinical trials, and for improving prosthesis design.
View details for PubMedID 30523985
-
The ENGAGE study: Integrating neuroimaging, virtual reality and smartphone sensing to understand self-regulation for managing depression and obesity in a precision medicine model.
Behaviour research and therapy
2018; 101: 58–70
Abstract
Precision medicine models for personalizing achieving sustained behavior change are largely outside of current clinical practice. Yet, changing self-regulatory behaviors is fundamental to the self-management of complex lifestyle-related chronic conditions such as depression and obesity - two top contributors to the global burden of disease and disability. To optimize treatments and address these burdens, behavior change and self-regulation must be better understood in relation to their neurobiological underpinnings. Here, we present the conceptual framework and protocol for a novel study, "Engaging self-regulation targets to understand the mechanisms of behavior change and improve mood and weight outcomes (ENGAGE)". The ENGAGE study integrates neuroscience with behavioral science to better understand the self-regulation related mechanisms of behavior change for improving mood and weight outcomes among adults with comorbid depression and obesity. We collect assays of three self-regulation targets (emotion, cognition, and self-reflection) in multiple settings: neuroimaging and behavioral lab-based measures, virtual reality, and passive smartphone sampling. By connecting human neuroscience and behavioral science in this manner within the ENGAGE study, we develop a prototype for elucidating the underlying self-regulation mechanisms of behavior change outcomes and their application in optimizing intervention strategies for multiple chronic diseases.
View details for PubMedID 29074231
-
Occipital White Matter Tracts in Human and Macaque.
Cerebral cortex (New York, N.Y. : 1991)
2017; 27 (6): 3346-3359
Abstract
We compare several major white-matter tracts in human and macaque occipital lobe using diffusion magnetic resonance imaging. The comparison suggests similarities but also significant differences in the tracts. There are several apparently homologous tracts in the 2 species, including the vertical occipital fasciculus (VOF), optic radiation, forceps major, and inferior longitudinal fasciculus (ILF). There is one large human tract, the inferior fronto-occipital fasciculus, with no corresponding fasciculus in macaque. We could identify the macaque VOF (mVOF), which has been little studied. Its position is consistent with classical invasive anatomical studies by Wernicke. VOF homology is supported by similarity of the endpoints in V3A and ventral V4 across species. The mVOF fibers intertwine with the dorsal segment of the ILF, but the human VOF appears to be lateral to the ILF. These similarities and differences between the occipital lobe tracts will be useful in establishing which circuitry in the macaque can serve as an accurate model for human visual cortex.
View details for DOI 10.1093/cercor/bhx070
View details for PubMedID 28369290
-
Science in the cloud (SIC): A use case in MRI connectomics.
GigaScience
2017; 6 (5): 1-10
Abstract
Modern technologies are enabling scientists to collect extraordinary amounts of complex and sophisticated data across a huge range of scales like never before. With this onslaught of data, we can allow the focal point to shift from data collection to data analysis. Unfortunately, lack of standardized sharing mechanisms and practices often make reproducing or extending scientific results very difficult. With the creation of data organization structures and tools that drastically improve code portability, we now have the opportunity to design such a framework for communicating extensible scientific discoveries. Our proposed solution leverages these existing technologies and standards, and provides an accessible and extensible model for reproducible research, called 'science in the cloud' (SIC). Exploiting scientific containers, cloud computing, and cloud data services, we show the capability to compute in the cloud and run a web service that enables intimate interaction with the tools and data presented. We hope this model will inspire the community to produce reproducible and, importantly, extensible results that will enable us to collectively accelerate the rate at which scientific breakthroughs are discovered, replicated, and extended.
View details for DOI 10.1093/gigascience/gix013
View details for PubMedID 28327935
-
In vivo evidence of functional and anatomical stripe-based subdivisions in human V2 and V3
SCIENTIFIC REPORTS
2017; 7
Abstract
Visual cortex contains a hierarchy of visual areas. The earliest cortical area (V1) contains neurons responding to colour, form and motion. Later areas specialize on processing of specific features. The second visual area (V2) in non-human primates contains a stripe-based anatomical organization, initially defined using cytochrome-oxidase staining of post-mortem tissue. Neurons in these stripes have been proposed to serve distinct functional specializations, e.g. processing of color, form and motion. These stripes represent an intermediate stage in visual hierarchy and serve a key role in the increasing functional specialization of visual areas. Using sub-millimeter high-field functional and anatomical MRI (7T), we provide in vivo evidence for stripe-based subdivisions in humans. Using functional MRI, we contrasted responses elicited by stimuli alternating at slow and fast temporal frequencies. We revealed stripe-based subdivisions in V2 ending at the V1/V2 border. The human stripes reach into V3. Using anatomical MRI optimized for myelin contrast within gray matter, we also observe a stripe pattern. Stripe subdivisions preferentially responding to fast temporal frequencies are more myelinated. As such, functional and anatomical measures provide independent and converging evidence for functional organization into striped-based subdivisions in human V2 and V3.
View details for DOI 10.1038/s41598-017-00634-6
View details for Web of Science ID 000398548100015
View details for PubMedID 28389654
-
The field of view available to the ventral occipito-temporal reading circuitry
JOURNAL OF VISION
2017; 17 (4)
Abstract
Skilled reading requires rapidly recognizing letters and word forms; people learn this skill best for words presented in the central visual field. Measurements over the last decade have shown that when children learn to read, responses within ventral occipito-temporal cortex (VOT) become increasingly selective to word forms. We call these regions the VOT reading circuitry (VOTRC). The portion of the visual field that evokes a response in the VOTRC is called the field of view (FOV). We measured the FOV of the VOTRC and found that it is a small subset of the entire field of view available to the human visual system. For the typical subject, the FOV of the VOTRC in each hemisphere is contralaterally and foveally biased. The FOV of the left VOTRC extends ∼9° into the right visual field and ∼4° into the left visual field along the horizontal meridian. The FOV of the right VOTRC is roughly mirror symmetric to that of the left VOTRC. The size and shape of the FOV covers the region of the visual field that contains relevant information for reading English. It may be that the size and shape of the FOV, which varies between subjects, will prove useful in predicting behavioral aspects of reading.
View details for DOI 10.1167/17.4.6
View details for Web of Science ID 000400647300006
View details for PubMedID 28418457
-
The visual white matter: The application of diffusion MRI and fiber tractography to vision science
JOURNAL OF VISION
2017; 17 (2)
Abstract
Visual neuroscience has traditionally focused much of its attention on understanding the response properties of single neurons or neuronal ensembles. The visual white matter and the long-range neuronal connections it supports are fundamental in establishing such neuronal response properties and visual function. This review article provides an introduction to measurements and methods to study the human visual white matter using diffusion MRI. These methods allow us to measure the microstructural and macrostructural properties of the white matter in living human individuals; they allow us to trace long-range connections between neurons in different parts of the visual system and to measure the biophysical properties of these connections. We also review a range of findings from recent studies on connections between different visual field maps, the effects of visual impairment on the white matter, and the properties underlying networks that process visual information supporting visual face recognition. Finally, we discuss a few promising directions for future studies. These include new methods for analysis of MRI data, open datasets that are becoming available to study brain connectivity and white matter properties, and open source software for the analysis of these data.
View details for DOI 10.1167/17.2.4
View details for Web of Science ID 000397220000004
View details for PubMedID 28196374
-
Designing illuminant spectral power distributions for surface classification
IEEE. 2017: 2682–91
View details for DOI 10.1109/CVPR.2017.287
View details for Web of Science ID 000418371402079
-
Characterization of visual stimuli using the standard display model
HANDBOOK OF VISUAL OPTICS: FUNDAMENTALS AND EYE OPTICS, VOL I
2017: 93–102
View details for Web of Science ID 000438026900008
-
Evaluating quantitative proton-density-mapping methods
HUMAN BRAIN MAPPING
2016; 37 (10): 3623-3635
Abstract
Quantitative magnetic resonance imaging (qMRI) aims to quantify tissue parameters by eliminating instrumental bias. We describe qMRI theory, simulations, and software designed to estimate proton density (PD), the apparent local concentration of water protons in the living human brain. First, we show that, in the absence of noise, multichannel coil data contain enough information to separate PD and coil sensitivity, a limiting instrumental bias. Second, we show that, in the presence of noise, regularization by a constraint on the relationship between T1 and PD produces accurate coil sensitivity and PD maps. The ability to measure PD quantitatively has applications in the analysis of in-vivo human brain tissue and enables multisite comparisons between individuals and across instruments. Hum Brain Mapp 37:3623-3635, 2016. © 2016 Wiley Periodicals, Inc.
View details for DOI 10.1002/hbm.23264
View details for Web of Science ID 000383864500018
View details for PubMedID 27273015
-
A Major Human White Matter Pathway Between Dorsal and Ventral Visual Cortex.
Cerebral cortex
2016; 26 (5): 2205-2214
Abstract
Human visual cortex comprises many visual field maps organized into clusters. A standard organization separates visual maps into 2 distinct clusters within ventral and dorsal cortex. We combined fMRI, diffusion MRI, and fiber tractography to identify a major white matter pathway, the vertical occipital fasciculus (VOF), connecting maps within the dorsal and ventral visual cortex. We use a model-based method to assess the statistical evidence supporting several aspects of the VOF wiring pattern. There is strong evidence supporting the hypothesis that dorsal and ventral visual maps communicate through the VOF. The cortical projection zones of the VOF suggest that human ventral (hV4/VO-1) and dorsal (V3A/B) maps exchange substantial information. The VOF appears to be crucial for transmitting signals between regions that encode object properties including form, identity, and color and regions that map spatial information.
View details for DOI 10.1093/cercor/bhv064
View details for PubMedID 25828567
View details for PubMedCentralID PMC4830295
-
A Predominantly Visual Subdivision of The Right Temporo-Parietal Junction (vTPJ).
Cerebral cortex
2016; 26 (2): 639-646
Abstract
A multiplicity of sensory and cognitive functions has been attributed to the large cortical region at the temporo-parietal junction (TPJ). Using functional MRI, we report that a small region lateralized within the right TPJ responds robustly to certain simple visual stimuli ("vTPJ"). The vTPJ was found in all right hemispheres (n = 7), posterior to the auditory cortex. To manipulate stimuli and attention, subjects were presented with a mixture of visual and auditory stimuli in a concurrent block design in 2 experiments: (1) A simple visual stimulus (a grating pattern modulating in mean luminance) elicited robust responses in the vTPJ, whether or not the subject attended to vision and(2) a drifting low-contrast dartboard pattern of constant mean luminance evoked robust responses in the vTPJ when it was task-relevant (visual task), and smaller responses when it was not (auditory task). The results suggest a focal, visually responsive region within the right TPJ that is powerfully driven by certain visual stimuli (luminance fluctuations), and that can be driven by other visual stimuli when the subject is attending. The precise localization of this visually responsive region is helpful in segmenting the TPJ and to better understand its role in visual awareness and related disorders such as extinction and neglect.
View details for DOI 10.1093/cercor/bhu226
View details for PubMedID 25267856
View details for PubMedCentralID PMC4712797
-
Ensemble Tractography.
PLoS computational biology
2016; 12 (2)
Abstract
Tractography uses diffusion MRI to estimate the trajectory and cortical projection zones of white matter fascicles in the living human brain. There are many different tractography algorithms and each requires the user to set several parameters, such as curvature threshold. Choosing a single algorithm with specific parameters poses two challenges. First, different algorithms and parameter values produce different results. Second, the optimal choice of algorithm and parameter value may differ between different white matter regions or different fascicles, subjects, and acquisition parameters. We propose using ensemble methods to reduce algorithm and parameter dependencies. To do so we separate the processes of fascicle generation and evaluation. Specifically, we analyze the value of creating optimized connectomes by systematically combining candidate streamlines from an ensemble of algorithms (deterministic and probabilistic) and systematically varying parameters (curvature and stopping criterion). The ensemble approach leads to optimized connectomes that provide better cross-validated prediction error of the diffusion MRI data than optimized connectomes generated using a single-algorithm or parameter set. Furthermore, the ensemble approach produces connectomes that contain both short- and long-range fascicles, whereas single-parameter connectomes are biased towards one or the other. In summary, a systematic ensemble tractography approach can produce connectomes that are superior to standard single parameter estimates both for predicting the diffusion measurements and estimating white matter fascicles.
View details for DOI 10.1371/journal.pcbi.1004692
View details for PubMedID 26845558
View details for PubMedCentralID PMC4742469
-
Clarifying Human White Matter
ANNUAL REVIEW OF NEUROSCIENCE, VOL 39
2016; 39: 103-128
Abstract
Progress in magnetic resonance imaging (MRI) now makes it possible to identify the major white matter tracts in the living human brain. These tracts are important because they carry many of the signals communicated between different brain regions. MRI methods coupled with biophysical modeling can measure the tissue properties and structural features of the tracts that impact our ability to think, feel, and perceive. This review describes the fundamental ideas of the MRI methods used to identify the major white matter tracts in the living human brain.
View details for DOI 10.1146/annurev-neuro-070815-013815
View details for Web of Science ID 000381633400006
View details for PubMedID 27050319
-
The posterior arcuate fasciculus and the vertical occipital fasciculus.
Cortex; a journal devoted to the study of the nervous system and behavior
2016
View details for PubMedID 27132243
-
Stimulus Dependence of Gamma Oscillations in Human Visual Cortex.
Cerebral cortex
2015; 25 (9): 2951-2959
Abstract
A striking feature of some field potential recordings in visual cortex is a rhythmic oscillation within the gamma band (30-80 Hz). These oscillations have been proposed to underlie computations in perception, attention, and information transmission. Recent studies of cortical field potentials, including human electrocorticography (ECoG), have emphasized another signal within the gamma band, a nonoscillatory, broadband signal, spanning 80-200 Hz. It remains unclear under what conditions gamma oscillations are elicited in visual cortex, whether they are necessary and ubiquitous in visual encoding, and what relationship they have to nonoscillatory, broadband field potentials. We demonstrate that ECoG responses in human visual cortex (V1/V2/V3) can include robust narrowband gamma oscillations, and that these oscillations are reliably elicited by some spatial contrast patterns (luminance gratings) but not by others (noise patterns and many natural images). The gamma oscillations can be conspicuous and robust, but because they are absent for many stimuli, which observers can see and recognize, the oscillations are not necessary for seeing. In contrast, all visual stimuli induced broadband spectral changes in ECoG responses. Asynchronous neural signals in visual cortex, reflected in the broadband ECoG response, can support transmission of information for perception and recognition in the absence of pronounced gamma oscillations.
View details for DOI 10.1093/cercor/bhu091
View details for PubMedID 24855114
View details for PubMedCentralID PMC4537439
-
Sex differences in the corpus callosum in preschool-aged children with autism spectrum disorder (vol 6, pg 26, 2015)
MOLECULAR AUTISM
2015; 6: 39
Abstract
[This corrects the article DOI: 10.1186/s13229-015-0005-4.].
View details for PubMedID 26097676
-
Sex differences in the corpus callosum in preschool-aged children with autism spectrum disorder
MOLECULAR AUTISM
2015; 6
Abstract
Abnormalities in the corpus callosum have been reported in individuals with autism spectrum disorder (ASD), but few studies have evaluated young children. Sex differences in callosal organization and diffusion characteristics have also not been evaluated fully in ASD.Structural and diffusion-weighted images were acquired in 139 preschool-aged children with ASD (112 males/27 females) and 82 typically developing (TD) controls (53 males/29 females). Longitudinal scanning at two additional annual time points was carried out in a subset of these participants. Callosal organization was evaluated using two approaches: 1) diffusion tensor imaging (DTI) tractography to define subregions based on cortical projection zones and 2) as a comparison to previous studies, midsagittal area analysis using Witelson subdivisions. Diffusion measures of callosal fibers were also evaluated.Analyses of cortical projection zone subregions revealed sex differences in the patterns of altered callosal organization. Relative to their sex-specific TD counterparts, both males and females with ASD had smaller regions dedicated to fibers projecting to superior frontal cortex, but patterns differed in callosal subregions projecting to other parts of frontal cortex. While males with ASD had a smaller callosal region dedicated to the orbitofrontal cortex, females with ASD had a smaller callosal region dedicated to the anterior frontal cortex. There were also sex differences in diffusion properties of callosal fibers. While no alterations were observed in males with ASD relative to TD males, mean diffusivity (MD), axial diffusivity (AD), and radial diffusivity (RD) were all increased in females with ASD relative to TD females. Analyses of Witelson subdivisions revealed a decrease in midsagittal area of the corpus callosum in both males and females with ASD but no regional differences in specific subdivisions. Longitudinal analyses revealed no diagnostic or sex differences in the growth rate or change in diffusion measures of the corpus callosum from 3 to 5 years of age.There are sex differences in the pattern of altered corpus callosum neuroanatomy in preschool-aged children with ASD.
View details for DOI 10.1186/s13229-015-0005-4
View details for PubMedID 25973163
-
Disrupted fornix integrity in children with chromosome 22q11.2 deletion syndrome
PSYCHIATRY RESEARCH-NEUROIMAGING
2015; 232 (1): 106-114
Abstract
The fornix is the primary subcortical output fiber system of the hippocampal formation. In children with 22q11.2 deletion syndrome (22q11.2DS), hippocampal volume reduction has been commonly reported, but few studies as yet have evaluated the integrity of the fornix. Therefore, we investigated the fornix of 45 school-aged children with 22q11.2DS and 38 matched typically developing (TD) children. Probabilistic diffusion tensor imaging (DTI) tractography was used to reconstruct the body of the fornix in each child׳s brain native space. Compared with children, significantly lower fractional anisotropy (FA) and higher radial diffusivity (RD) was observed bilaterally in the body of the fornix in children with 22q11.2DS. Irregularities were especially prominent in the posterior aspect of the fornix where it emerges from the hippocampus. Smaller volumes of the hippocampal formations were also found in the 22q11.2DS group. The reduced hippocampal volumes were correlated with lower fornix FA and higher fornix RD in the right hemisphere. Our findings provide neuroanatomical evidence of disrupted hippocampal connectivity in children with 22q11.2DS, which may help to further understand the biological basis of spatial impairments, affective regulation, and other factors related to the ultra-high risk for schizophrenia in this population.
View details for DOI 10.1016/j.pscychresns.2015.02.002
View details for PubMedID 25748884
-
Evaluating the Accuracy of Diffusion MRI Models in White Matter
PLOS ONE
2015; 10 (4)
Abstract
Models of diffusion MRI within a voxel are useful for making inferences about the properties of the tissue and inferring fiber orientation distribution used by tractography algorithms. A useful model must fit the data accurately. However, evaluations of model-accuracy of commonly used models have not been published before. Here, we evaluate model-accuracy of the two main classes of diffusion MRI models. The diffusion tensor model (DTM) summarizes diffusion as a 3-dimensional Gaussian distribution. Sparse fascicle models (SFM) summarize the signal as a sum of signals originating from a collection of fascicles oriented in different directions. We use cross-validation to assess model-accuracy at different gradient amplitudes (b-values) throughout the white matter. Specifically, we fit each model to all the white matter voxels in one data set and then use the model to predict a second, independent data set. This is the first evaluation of model-accuracy of these models. In most of the white matter the DTM predicts the data more accurately than test-retest reliability; SFM model-accuracy is higher than test-retest reliability and also higher than the DTM model-accuracy, particularly for measurements with (a) a b-value above 1000 in locations containing fiber crossings, and (b) in the regions of the brain surrounding the optic radiations. The SFM also has better parameter-validity: it more accurately estimates the fiber orientation distribution function (fODF) in each voxel, which is useful for fiber tracking.
View details for DOI 10.1371/journal.pone.0123272
View details for Web of Science ID 000353016500045
View details for PubMedID 25879933
View details for PubMedCentralID PMC4400066
-
A Lack of Experience-Dependent Plasticity After More Than a Decade of Recovered Sight
PSYCHOLOGICAL SCIENCE
2015; 26 (4): 393-401
Abstract
In 2000, monocular vision was restored to M. M., who had been blind between the ages of 3 and 46 years. Tests carried out over 2 years following the surgery revealed impairments of 3-D form, object, and face processing and an absence of object- and face-selective blood-oxygen-level-dependent responses in ventral visual cortex. In the present research, we reexamined M. M. to test for experience-dependent recovery of visual function. Behaviorally, M. M. remains impaired in 3-D form, object, and face processing. Accordingly, we found little to no evidence of the category-selective organization within ventral visual cortex typically associated with face, body, scene, or object processing. We did observe remarkably normal object selectivity within lateral occipital cortex, consistent with M. M.'s previously reported shape-discrimination performance. Together, these findings provide little evidence for recovery of high-level visual function after more than a decade of visual experience in adulthood.
View details for DOI 10.1177/0956797614563957
View details for Web of Science ID 000352986600004
View details for PubMedID 25740284
View details for PubMedCentralID PMC4500636
-
Gamma oscillations in visual cortex: the stimulus matters.
Trends in cognitive sciences
2015; 19 (2): 57-8
View details for DOI 10.1016/j.tics.2014.12.009
View details for PubMedID 25575448
View details for PubMedCentralID PMC4395850
-
Automatically designing an image processing pipeline for a five-band camera prototype using the Local, Linear, Learned (L-3) method
Conference on Digital Photography XI
SPIE-INT SOC OPTICAL ENGINEERING. 2015
View details for DOI 10.1117/12.2083435
View details for Web of Science ID 000353135300002
-
Efficient illuminant correction in the Local, Linear, Learned (L-3) method
Conference on Digital Photography XI
SPIE-INT SOC OPTICAL ENGINEERING. 2015
View details for DOI 10.1117/12.2083277
View details for Web of Science ID 000353135300003
-
Speed discrimination predicts word but not pseudo-word reading rate in adults and children
BRAIN AND LANGUAGE
2014; 138: 27-37
Abstract
Visual processing in the magnocellular pathway is a reputed influence on word recognition and reading performance. However, the mechanisms behind this relationship are still unclear. To explore this concept, we measured reading rate, speed-discrimination, and contrast detection thresholds in adults and children with a wide range of reading abilities. We found that speed discrimination thresholds are higher in children than in adults and are correlated with age. Speed discrimination thresholds are also correlated with reading rates but only for real words, not pseudo-words. Conversely, we found no correlations between contrast detection thresholds and the reading rates. We also found no correlations between speed discrimination or contrast detection and WASI subtest scores. These findings indicate that familiarity is a factor in magnocellular operations that may influence reading rate. We suggest this effect supports the idea that the magnocellular pathway contributes to word reading through an analysis of letter position.
View details for DOI 10.1016/j.bandl.2014.09.003
View details for Web of Science ID 000345949700004
View details for PubMedID 25278418
View details for PubMedCentralID PMC4300234
-
Evaluation and statistical inference for human connectomes.
Nature methods
2014; 11 (10): 1058-1063
Abstract
Diffusion-weighted imaging coupled with tractography is currently the only method for in vivo mapping of human white-matter fascicles. Tractography takes diffusion measurements as input and produces the connectome, a large collection of white-matter fascicles, as output. We introduce a method to evaluate the evidence supporting connectomes. Linear fascicle evaluation (LiFE) takes any connectome as input and predicts diffusion measurements as output, using the difference between the measured and predicted diffusion signals to quantify the prediction error. We use the prediction error to evaluate the evidence that supports the properties of the connectome, to compare tractography algorithms and to test hypotheses about tracts and connections.
View details for DOI 10.1038/nmeth.3098
View details for PubMedID 25194848
View details for PubMedCentralID PMC4180802
-
White matter consequences of retinal receptor and ganglion cell damage.
Investigative ophthalmology & visual science
2014; 55 (10): 6976-6986
Abstract
Patients with Leber hereditary optic neuropathy (LHON) and cone-rod dystrophy (CRD) have central vision loss; but CRD damages the retinal photoreceptor layer, and LHON damages the retinal ganglion cell (RGC) layer. Using diffusion MRI, we measured how these two types of retinal damage affect the optic tract (ganglion cell axons) and optic radiation (geniculo-striate axons).Adult onset CRD (n = 5), LHON (n = 6), and healthy controls (n = 14) participated in the study. We used probabilistic fiber tractography to identify the optic tract and the optic radiation. We compared axial and radial diffusivity at many positions along the optic tract and the optic radiation.In both types of patients, diffusion measures within the optic tract and the optic radiation differ from controls. The optic tract change is principally a decrease in axial diffusivity; the optic radiation change is principally an increase in radial diffusivity.Both photoreceptor layer (CRD) and retinal ganglion cell (LHON) retinal disease causes substantial change in the visual white matter. These changes can be measured using diffusion MRI. The diffusion changes measured in the optic tract and the optic radiation differ, suggesting that they are caused by different biological mechanisms.
View details for DOI 10.1167/iovs.14-14737
View details for PubMedID 25257055
View details for PubMedCentralID PMC4215745
-
White Matter Consequences of Retinal Receptor and Ganglion Cell Damage
INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE
2014; 55 (10)
Abstract
Patients with Leber hereditary optic neuropathy (LHON) and cone-rod dystrophy (CRD) have central vision loss; but CRD damages the retinal photoreceptor layer, and LHON damages the retinal ganglion cell (RGC) layer. Using diffusion MRI, we measured how these two types of retinal damage affect the optic tract (ganglion cell axons) and optic radiation (geniculo-striate axons).Adult onset CRD (n = 5), LHON (n = 6), and healthy controls (n = 14) participated in the study. We used probabilistic fiber tractography to identify the optic tract and the optic radiation. We compared axial and radial diffusivity at many positions along the optic tract and the optic radiation.In both types of patients, diffusion measures within the optic tract and the optic radiation differ from controls. The optic tract change is principally a decrease in axial diffusivity; the optic radiation change is principally an increase in radial diffusivity.Both photoreceptor layer (CRD) and retinal ganglion cell (LHON) retinal disease causes substantial change in the visual white matter. These changes can be measured using diffusion MRI. The diffusion changes measured in the optic tract and the optic radiation differ, suggesting that they are caused by different biological mechanisms.
View details for DOI 10.1167/iovs.14-14737
View details for Web of Science ID 000344730500047
View details for PubMedCentralID PMC4215745
-
Diffusion properties of major white matter tracts in young, typically developing children.
NeuroImage
2014; 88: 143-54
Abstract
Brain development occurs rapidly during the first few years of life involving region-specific changes in both gray matter and white matter. Due to the inherent difficulties in acquiring magnetic resonance imaging data in young children, little is known about the properties of white matter in typically developing toddlers. In the context of an ongoing study of young children with autism spectrum disorder, we collected diffusion-weighted imaging data during natural nocturnal sleep in a sample of young (mean age=35months) typically developing male and female (n=41 and 25, respectively) children. Axial diffusivity, radial diffusivity, mean diffusivity and fractional anisotropy were measured at 99 points along the length of 18 major brain tracts. Influences of hemisphere, age, sex, and handedness were examined. We find that diffusion properties vary significantly along the length of the majority of tracks. We also identify hemispheric and sex differences in diffusion properties in several tracts. Finally, we find the relationship between age and diffusion parameters changes along the tract length illustrating variability in age-related white-matter development at the tract level.
View details for DOI 10.1016/j.neuroimage.2013.11.025
View details for PubMedID 24269274
View details for PubMedCentralID PMC4029877
-
Diffusion properties of major white matter tracts in young, typically developing children
NEUROIMAGE
2014; 88: 143-154
Abstract
Brain development occurs rapidly during the first few years of life involving region-specific changes in both gray matter and white matter. Due to the inherent difficulties in acquiring magnetic resonance imaging data in young children, little is known about the properties of white matter in typically developing toddlers. In the context of an ongoing study of young children with autism spectrum disorder, we collected diffusion-weighted imaging data during natural nocturnal sleep in a sample of young (mean age=35months) typically developing male and female (n=41 and 25, respectively) children. Axial diffusivity, radial diffusivity, mean diffusivity and fractional anisotropy were measured at 99 points along the length of 18 major brain tracts. Influences of hemisphere, age, sex, and handedness were examined. We find that diffusion properties vary significantly along the length of the majority of tracks. We also identify hemispheric and sex differences in diffusion properties in several tracts. Finally, we find the relationship between age and diffusion parameters changes along the tract length illustrating variability in age-related white-matter development at the tract level.
View details for DOI 10.1016/j.neuroimage.2013.11.025
View details for Web of Science ID 000332052000016
View details for PubMedCentralID PMC4029877
-
Automating the design of image processing pipelines for novel color filter arrays: Local, Linear, Learned (L-3) method
Conference on Digital Photography X
SPIE-INT SOC OPTICAL ENGINEERING. 2014
View details for DOI 10.1117/12.2042565
View details for Web of Science ID 000336250800019
-
Quantifying the local tissue volume and composition in individual brains with magnetic resonance imaging
NATURE MEDICINE
2013; 19 (12): 1667-1672
Abstract
Here, we describe a quantitative neuroimaging method to estimate the macromolecular tissue volume (MTV), a fundamental measure of brain anatomy. By making measurements over a range of field strengths and scan parameters, we tested the key assumptions and the robustness of the method. The measurements confirm that a consistent quantitative estimate of MTV can be obtained across a range of scanners. MTV estimates are sufficiently precise to enable a comparison between data obtained from an individual subject with control population data. We describe two applications. First, we show that MTV estimates can be combined with T1 and diffusion measurements to augment our understanding of the tissue properties. Second, we show that MTV provides a sensitive measure of disease status in individual patients with multiple sclerosis. The MTV maps are obtained using short clinically appropriate scans that can reveal how tissue changes influence behavior and cognition.
View details for DOI 10.1038/nm.3390
View details for Web of Science ID 000328181400038
View details for PubMedID 24185694
View details for PubMedCentralID PMC3855886
-
Asynchronous Broadband Signals Are the Principal Source of the BOLD Response in Human Visual Cortex
CURRENT BIOLOGY
2013; 23 (13): 1145-1153
Abstract
Activity in the living human brain can be studied using multiple methods, spanning a wide range of spatial and temporal resolutions. We investigated the relationship between electric field potentials measured with electrocorticography (ECoG) and the blood oxygen level-dependent (BOLD) response measured with functional magnetic resonance imaging (fMRI). We set out to explain the full set of measurements by modeling the underlying neural circuits.ECoG responses in visual cortex can be separated into two visually driven components. One component is a specific temporal response that follows each stimulus contrast reversal ("stimulus locked"); the other component is an increase in the response variance ("asynchronous"). For electrodes in visual cortex (V1, V2, V3), the two measures respond to stimuli in the same region of visual space, but they have different spatial summation properties. The stimulus-locked ECoG component sums contrast approximately linearly across space; spatial summation in the asynchronous ECoG component is subadditive. Spatial summation measured using BOLD closely matches the asynchronous component. We created a neural simulation that accurately captures the main features of the ECoG time series; in the simulation, the stimulus-locked and asynchronous components arise from different neural circuits.These observations suggest that the two ECoG components arise from different neural sources within the same cortical region. The spatial summation measurements and simulations suggest that the BOLD response arises primarily from neural sources that generate the asynchronous broadband ECoG component.
View details for DOI 10.1016/j.cub.2013.05.001
View details for Web of Science ID 000321605600015
View details for PubMedID 23770184
View details for PubMedCentralID PMC3710543
-
Compressive spatial summation in human visual cortex
JOURNAL OF NEUROPHYSIOLOGY
2013; 110 (2): 481-494
Abstract
Neurons within a small (few mm(3)) region of visual cortex respond to stimuli within a restricted region of the visual field. Previous studies have characterized the population response of such neurons using a model that sums contrast linearly across the visual field. In this study we test linear spatial summation of population responses using blood oxygenation level dependent (BOLD) fMRI. We measure BOLD responses to a systematic set of contrast patterns and discover systematic deviation from linearity: the data are more accurately explained by a model in which a compressive static nonlinearity is applied after linear spatial summation. We find that the nonlinearity is present in early visual areas (e.g., V1, V2) and grows more pronounced in relatively anterior extrastriate areas (e.g., LO-2, VO-2). We then analyze the effect of compressive spatial summation in terms of changes in the position and size of a viewed object. Compressive spatial summation is consistent with tolerance to changes in position and size, an important characteristic of object representation.
View details for DOI 10.1152/jn.00105.2013
View details for Web of Science ID 000321843800019
View details for PubMedID 23615546
-
Anatomy of the visual word form area: Adjacent cortical circuits and long-range white matter connections.
Brain and language
2013; 125 (2): 146-155
Abstract
Circuitry in ventral occipital-temporal cortex is essential for seeing words. We analyze the circuitry within a specific ventral-occipital region, the visual word form area (VWFA). The VWFA is immediately adjacent to the retinotopically organized VO-1 and VO-2 visual field maps and lies medial and inferior to visual field maps within motion selective human cortex. Three distinct white matter fascicles pass within close proximity to the VWFA: (1) the inferior longitudinal fasciculus, (2) the inferior frontal occipital fasciculus, and (3) the vertical occipital fasciculus. The vertical occipital fasciculus terminates in or adjacent to the functionally defined VWFA voxels in every individual. The vertical occipital fasciculus projects dorsally to language and reading related cortex. The combination of functional responses from cortex and anatomical measures in the white matter provides an overview of how the written word is encoded and communicated along the ventral occipital-temporal circuitry for seeing words.
View details for DOI 10.1016/j.bandl.2012.04.010
View details for PubMedID 22632810
View details for PubMedCentralID PMC3432298
-
A Two-Stage Cascade Model of BOLD Responses in Human Visual Cortex.
PLoS computational biology
2013; 9 (5)
View details for DOI 10.1371/journal.pcbi.1003079
View details for PubMedID 23737741
-
Biological development of reading circuits.
Current opinion in neurobiology
2013; 23 (2): 261-268
Abstract
Human neuroimaging is expanding our understanding of the biological processes that are essential for healthy brain function. Methods such as diffusion weighted imaging provide insights into white matter fascicles, growth and pruning of dendritic arbors and axons, and properties of glia. This review focuses on what we have learned from diffusion imaging about these processes and the development of reading circuitry in the human brain. Understanding reading circuitry development may suggest ways to improve how we teach children to read.
View details for DOI 10.1016/j.conb.2012.12.005
View details for PubMedID 23312307
View details for PubMedCentralID PMC3622751
-
Connective field modeling
NEUROIMAGE
2013; 66: 376-384
Abstract
The traditional way to study the properties of visual neurons is to measure their responses to visually presented stimuli. A second way to understand visual neurons is to characterize their responses in terms of activity elsewhere in the brain. Understanding the relationships between responses in distinct locations in the visual system is essential to clarify this network of cortical signaling pathways. Here, we describe and validate connective field modeling, a model-based analysis for estimating the dependence between signals in distinct cortical regions using functional magnetic resonance imaging (fMRI). Just as the receptive field of a visual neuron predicts its response as a function of stimulus position, the connective field of a neuron predicts its response as a function of activity in another part of the brain. Connective field modeling opens up a wide range of research opportunities to study information processing in the visual system and other topographically organized cortices.
View details for DOI 10.1016/j.neuroimage.2012.10.037
View details for Web of Science ID 000322355800041
View details for PubMedID 23110879
-
Human trichromacy revisited
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA
2013; 110 (3): E260-E269
Abstract
The presence of a photopigment (melanopsin) within certain retinal ganglion cells was a surprising and significant discovery. This pigment is routinely described as "nonvisual" to highlight its signaling role in pupil dilation and circadian rhythms. Here we asked whether light absorbed by melanopsin can be seen by healthy human subjects. To answer this requires delivering intense (above rod saturation), well-controlled lights using four independent primaries. We collected detection thresholds to many four-primary stimuli. Threshold measurements in the fovea are explained by trichromatic theory, with no need to invoke a fourth photopigment. In the periphery, where melanopsin is present, threshold measurements deviate from trichromatic theory; at high photopic levels, sensitivity is explained by absorptions in four, not three, photopigment classes. We consider a series of hypotheses to explain the tetrasensitivity at high photopic levels in the human peripheral field. The most likely hypothesis is that in healthy human subjects melanopsin absorptions influence visibility.
View details for DOI 10.1073/pnas.1214240110
View details for Web of Science ID 000313909100013
View details for PubMedID 23256158
View details for PubMedCentralID PMC3549098
-
A two-stage cascade model of BOLD responses in human visual cortex.
PLoS computational biology
2013; 9 (5)
Abstract
Visual neuroscientists have discovered fundamental properties of neural representation through careful analysis of responses to controlled stimuli. Typically, different properties are studied and modeled separately. To integrate our knowledge, it is necessary to build general models that begin with an input image and predict responses to a wide range of stimuli. In this study, we develop a model that accepts an arbitrary band-pass grayscale image as input and predicts blood oxygenation level dependent (BOLD) responses in early visual cortex as output. The model has a cascade architecture, consisting of two stages of linear and nonlinear operations. The first stage involves well-established computations-local oriented filters and divisive normalization-whereas the second stage involves novel computations-compressive spatial summation (a form of normalization) and a variance-like nonlinearity that generates selectivity for second-order contrast. The parameters of the model, which are estimated from BOLD data, vary systematically across visual field maps: compared to primary visual cortex, extrastriate maps generally have larger receptive field size, stronger levels of normalization, and increased selectivity for second-order contrast. Our results provide insight into how stimuli are encoded and transformed in successive stages of visual processing.
View details for DOI 10.1371/journal.pcbi.1003079
View details for PubMedID 23737741
View details for PubMedCentralID PMC3667759
-
GLMdenoise: a fast, automated technique for denoising task-based fMRI data
FRONTIERS IN NEUROSCIENCE
2013; 7
View details for DOI 10.3389/fnins.2013.00247
View details for Web of Science ID 000346567300243
-
GLMdenoise: a fast, automated technique for denoising task-based fMRI data.
Frontiers in neuroscience
2013; 7: 247-?
Abstract
In task-based functional magnetic resonance imaging (fMRI), researchers seek to measure fMRI signals related to a given task or condition. In many circumstances, measuring this signal of interest is limited by noise. In this study, we present GLMdenoise, a technique that improves signal-to-noise ratio (SNR) by entering noise regressors into a general linear model (GLM) analysis of fMRI data. The noise regressors are derived by conducting an initial model fit to determine voxels unrelated to the experimental paradigm, performing principal components analysis (PCA) on the time-series of these voxels, and using cross-validation to select the optimal number of principal components to use as noise regressors. Due to the use of data resampling, GLMdenoise requires and is best suited for datasets involving multiple runs (where conditions repeat across runs). We show that GLMdenoise consistently improves cross-validation accuracy of GLM estimates on a variety of event-related experimental datasets and is accompanied by substantial gains in SNR. To promote practical application of methods, we provide MATLAB code implementing GLMdenoise. Furthermore, to help compare GLMdenoise to other denoising methods, we present the Denoise Benchmark (DNB), a public database and architecture for evaluating denoising methods. The DNB consists of the datasets described in this paper, a code framework that enables automatic evaluation of a denoising method, and implementations of several denoising methods, including GLMdenoise, the use of motion parameters as noise regressors, ICA-based denoising, and RETROICOR/RVHRCOR. Using the DNB, we find that GLMdenoise performs best out of all of the denoising methods we tested.
View details for DOI 10.3389/fnins.2013.00247
View details for PubMedID 24381539
View details for PubMedCentralID PMC3865440
-
Tract Profiles of White Matter Properties: Automating Fiber-Tract Quantification
PLOS ONE
2012; 7 (11)
Abstract
Tractography based on diffusion weighted imaging (DWI) data is a method for identifying the major white matter fascicles (tracts) in the living human brain. The health of these tracts is an important factor underlying many cognitive and neurological disorders. In vivo, tissue properties may vary systematically along each tract for several reasons: different populations of axons enter and exit the tract, and disease can strike at local positions within the tract. Hence quantifying and understanding diffusion measures along each fiber tract (Tract Profile) may reveal new insights into white matter development, function, and disease that are not obvious from mean measures of that tract. We demonstrate several novel findings related to Tract Profiles in the brains of typically developing children and children at risk for white matter injury secondary to preterm birth. First, fractional anisotropy (FA) values vary substantially within a tract but the Tract FA Profile is consistent across subjects. Thus, Tract Profiles contain far more information than mean diffusion measures. Second, developmental changes in FA occur at specific positions within the Tract Profile, rather than along the entire tract. Third, Tract Profiles can be used to compare white matter properties of individual patients to standardized Tract Profiles of a healthy population to elucidate unique features of that patient's clinical condition. Fourth, Tract Profiles can be used to evaluate the association between white matter properties and behavioral outcomes. Specifically, in the preterm group reading ability is positively correlated with FA measured at specific locations on the left arcuate and left superior longitudinal fasciculus and the magnitude of the correlation varies significantly along the Tract Profiles. We introduce open source software for automated fiber-tract quantification (AFQ) that measures Tract Profiles of MRI parameters for 18 white matter tracts. With further validation, AFQ Tract Profiles have potential for informing clinical management and decision-making.
View details for DOI 10.1371/journal.pone.0049790
View details for PubMedID 23166771
-
Development of white matter and reading skills
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA
2012; 109 (44): E3045-E3053
Abstract
White matter tissue properties are highly correlated with reading proficiency; we would like to have a model that relates the dynamics of an individual's white matter development to their acquisition of skilled reading. The development of cerebral white matter involves multiple biological processes, and the balance between these processes differs between individuals. Cross-sectional measures of white matter mask the interplay between these processes and their connection to an individual's cognitive development. Hence, we performed a longitudinal study to measure white-matter development (diffusion-weighted imaging) and reading development (behavioral testing) in individual children (age 7-15 y). The pattern of white-matter development differed significantly among children. In the left arcuate and left inferior longitudinal fasciculus, children with above-average reading skills initially had low fractional anisotropy (FA) that increased over the 3-y period, whereas children with below-average reading skills had higher initial FA that declined over time. We describe a dual-process model of white matter development comprising biological processes with opposing effects on FA, such as axonal myelination and pruning, to explain the pattern of results.
View details for DOI 10.1073/pnas.1206792109
View details for Web of Science ID 000311149900014
View details for PubMedID 23045658
View details for PubMedCentralID PMC3497768
-
Plasticity and Stability of the Visual System in Human Achiasma
NEURON
2012; 75 (3): 393-401
Abstract
The absence of the optic chiasm is an extraordinary and extreme abnormality in the nervous system. The abnormality produces highly atypical functional responses in the cortex, including overlapping hemifield representations and bilateral population receptive fields in both striate and extrastriate visual cortex. Even in the presence of these large functional abnormalities, the effect on visual perception and daily life is not easily detected. Here, we demonstrate that in two achiasmic humans the gross topography of the geniculostriate and occipital callosal connections remains largely unaltered. We conclude that visual function is preserved by reorganization of intracortical connections instead of large-scale reorganizations of the visual cortex. Thus, developmental mechanisms of local wiring within cortical maps compensate for the improper gross wiring to preserve function in human achiasma.
View details for DOI 10.1016/j.neuron.2012.05.026
View details for Web of Science ID 000307417700007
View details for PubMedID 22884323
View details for PubMedCentralID PMC3427398
-
Position sensitivity in the visual word form area
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA
2012; 109 (24): E1568-E1577
Abstract
Seeing words involves the activity of neural circuitry within a small region in human ventral temporal cortex known as the visual word form area (VWFA). It is widely asserted that VWFA responses, which are essential for skilled reading, do not depend on the visual field position of the writing (position invariant). Such position invariance supports the hypothesis that the VWFA analyzes word forms at an abstract level, far removed from specific stimulus features. Using functional MRI pattern-classification techniques, we show that position information is encoded in the spatial pattern of VWFA responses. A right-hemisphere homolog (rVWFA) shows similarly position-sensitive responses. Furthermore, electrophysiological recordings in the human brain show position-sensitive VWFA response latencies. These findings show that position-sensitive information is present in the neural circuitry that conveys visual word form information to language areas. The presence of position sensitivity in the VWFA has implications for how word forms might be learned and stored within the reading circuitry.
View details for DOI 10.1073/pnas.1121304109
View details for Web of Science ID 000305511300011
View details for PubMedID 22570498
View details for PubMedCentralID PMC3386120
-
Squaring cortex with color
NATURE NEUROSCIENCE
2012; 15 (6): 809-810
View details for Web of Science ID 000304546700004
View details for PubMedID 22627792
-
Digital camera simulation
APPLIED OPTICS
2012; 51 (4): A80-A90
Abstract
We describe a simulation of the complete image processing pipeline of a digital camera, beginning with a radiometric description of the scene captured by the camera and ending with a radiometric description of the image rendered on a display. We show that there is a good correspondence between measured and simulated sensor performance. Through the use of simulation, we can quantify the effects of individual digital camera components on system performance and image quality. This computational approach can be helpful for both camera design and image quality assessment.
View details for Web of Science ID 000300408400010
View details for PubMedID 22307132
-
Learning to See Words
ANNUAL REVIEW OF PSYCHOLOGY, VOL 63
2012; 63: 31-53
Abstract
Skilled reading requires recognizing written words rapidly; functional neuroimaging research has clarified how the written word initiates a series of responses in visual cortex. These responses are communicated to circuits in ventral occipitotemporal (VOT) cortex that learn to identify words rapidly. Structural neuroimaging has further clarified aspects of the white matter pathways that communicate reading signals between VOT and language systems. We review this circuitry, its development, and its deficiencies in poor readers. This review emphasizes data that measure the cortical responses and white matter pathways in individual subjects rather than group differences. Such methods have the potential to clarify why a child has difficulty learning to read and to offer guidance about the interventions that may be useful for that child.
View details for DOI 10.1146/annurev-psych-120710-100434
View details for Web of Science ID 000299709900002
View details for PubMedID 21801018
View details for PubMedCentralID PMC3228885
-
Anatomical Properties of the Arcuate Fasciculus Predict Phonological and Reading Skills in Children
JOURNAL OF COGNITIVE NEUROSCIENCE
2011; 23 (11): 3304-3317
Abstract
For more than a century, neurologists have hypothesized that the arcuate fasciculus carries signals that are essential for language function; however, the relevance of the pathway for particular behaviors is highly controversial. The primary objective of this study was to use diffusion tensor imaging to examine the relationship between individual variation in the microstructural properties of arcuate fibers and behavioral measures of language and reading skills. A second objective was to use novel fiber-tracking methods to reassess estimates of arcuate lateralization. In a sample of 55 children, we found that measurements of diffusivity in the left arcuate correlate with phonological awareness skills and arcuate volume lateralization correlates with phonological memory and reading skills. Contrary to previous investigations that report the absence of the right arcuate in some subjects, we demonstrate that new techniques can identify the pathway in every individual. Our results provide empirical support for the role of the arcuate fasciculus in the development of reading skills.
View details for Web of Science ID 000295869500011
View details for PubMedID 21568636
-
Problem of signal contamination in interhemispheric dual-sided subdural electrodes
EPILEPSIA
2011; 52 (11): E176-E180
Abstract
Dual-sided subdural electrodes are used in the localization and lateralization of seizure-onset zones when the area of interest is within the interhemispheric fissure. We designed the current study to test the validity of the assumption that each side of the dual-sided electrodes records from the hemisphere it faces. We recorded with dual-sided strip and grid electrodes implanted in the occipital interhemispheric space in two patients with nonoccipital epilepsy during two visual stimulation tasks in which subjects were presented with visual stimuli in the ipsilateral or contralateral visual hemifields. Our findings show substantial contamination of recordings from the opposite hemisphere. Although, as expected, electrodes recording through the falx record faintly from the contralateral cortical surface, they unexpectedly pick up strong signals from the cortex behind them. Therefore, we conclude that these electrodes should not be used for lateralization of the origin of epileptic activity or evoked responses.
View details for DOI 10.1111/j.1528-1167.2011.03284.x
View details for Web of Science ID 000297049700004
View details for PubMedID 21973215
View details for PubMedCentralID PMC3644859
-
Visual Feature-Tolerance in the Reading Network
NEURON
2011; 71 (5): 941-953
Abstract
A century of neurology and neuroscience shows that seeing words depends on ventral occipital-temporal (VOT) circuitry. Typically, reading is learned using high-contrast line-contour words. We explored whether a specific VOT region, the visual word form area (VWFA), learns to see only these words or recognizes words independent of the specific shape-defining visual features. Word forms were created using atypical features (motion-dots, luminance-dots) whose statistical properties control word-visibility. We measured fMRI responses as word form visibility varied, and we used TMS to interfere with neural processing in specific cortical circuits, while subjects performed a lexical decision task. For all features, VWFA responses increased with word-visibility and correlated with performance. TMS applied to motion-specialized area hMT+ disrupted reading performance for motion-dots, but not line-contours or luminance-dots. A quantitative model describes feature-convergence in the VWFA and relates VWFA responses to behavioral performance. These findings suggest how visual feature-tolerance in the reading network arises through signal convergence from feature-specialized cortical areas.
View details for DOI 10.1016/j.neuron.2011.06.036
View details for Web of Science ID 000294877900017
View details for PubMedID 21903085
View details for PubMedCentralID PMC3180962
-
The Development of Cortical Sensitivity to Visual Word Forms
JOURNAL OF COGNITIVE NEUROSCIENCE
2011; 23 (9): 2387-2399
Abstract
The ability to extract visual word forms quickly and efficiently is essential for using reading as a tool for learning. We describe the first longitudinal fMRI study to chart individual changes in cortical sensitivity to written words as reading develops. We conducted four annual measurements of brain function and reading skills in a heterogeneous group of children, initially 7-12 years old. The results show age-related increase in children's cortical sensitivity to word visibility in posterior left occipito-temporal sulcus (LOTS), nearby the anatomical location of the visual word form area. Moreover, the rate of increase in LOTS word sensitivity specifically correlates with the rate of improvement in sight word efficiency, a measure of speeded overt word reading. Other cortical regions, including V1, posterior parietal cortex, and the right homologue of LOTS, did not demonstrate such developmental changes. These results provide developmental support for the hypothesis that LOTS is part of the cortical circuitry that extracts visual word forms quickly and efficiently and highlight the importance of developing cortical sensitivity to word visibility in reading acquisition.
View details for Web of Science ID 000292508900024
View details for PubMedID 21261451
-
Optimizing subpixel rendering using a perceptual metric
JOURNAL OF THE SOCIETY FOR INFORMATION DISPLAY
2011; 19 (8): 513-519
View details for DOI 10.1889/JSID19.8.513
View details for Web of Science ID 000292862200001
-
Imaging retinotopic maps in the human brain
VISION RESEARCH
2011; 51 (7): 718-737
Abstract
A quarter-century ago visual neuroscientists had little information about the number and organization of retinotopic maps in human visual cortex. The advent of functional magnetic resonance imaging (MRI), a non-invasive, spatially-resolved technique for measuring brain activity, provided a wealth of data about human retinotopic maps. Just as there are differences amongst non-human primate maps, the human maps have their own unique properties. Many human maps can be measured reliably in individual subjects during experimental sessions lasting less than an hour. The efficiency of the measurements and the relatively large amplitude of functional MRI signals in visual cortex make it possible to develop quantitative models of functional responses within specific maps in individual subjects. During this last quarter-century, there has also been significant progress in measuring properties of the human brain at a range of length and time scales, including white matter pathways, macroscopic properties of gray and white matter, and cellular and molecular tissue properties. We hope the next 25years will see a great deal of work that aims to integrate these data by modeling the network of visual signals. We do not know what such theories will look like, but the characterization of human retinotopic maps from the last 25years is likely to be an important part of future ideas about visual computations.
View details for DOI 10.1016/j.visres.2010.08.004
View details for Web of Science ID 000290061300008
View details for PubMedID 20692278
View details for PubMedCentralID PMC3030662
-
The neurobiological basis of seeing words.
Annals of the New York Academy of Sciences
2011; 1224: 63-80
Abstract
This review summarizes recent ideas about the cortical circuits for seeing words, an important part of the brain system for reading. Historically, the link between the visual cortex and reading has been contentious. One influential position is that the visual cortex plays a minimal role, limited to identifying contours, and that information about these contours is delivered to cortical regions specialized for reading and language. An alternative position is that specializations for seeing words develop within the visual cortex itself. Modern neuroimaging measurements-including both functional magnetic resonance imaging (fMRI) and diffusion weighted imaging with tractography (DTI) data-support the position that circuitry for seeing the statistical regularities of word forms develops within the ventral occipitotemporal cortex, which also contains important circuitry for seeing faces, colors, and forms. This review explains new findings about the visual pathways, including visual field maps, as well as new findings about how we see words. The measurements from the two fields are in close cortical proximity, and there are good opportunities for coordinating theoretical ideas about function in the ventral occipitotemporal cortex.
View details for DOI 10.1111/j.1749-6632.2010.05954.x
View details for PubMedID 21486296
View details for PubMedCentralID PMC3077883
-
Bound pool fractions complement diffusion measures to describe white matter micro and macrostructure
NEUROIMAGE
2011; 54 (2): 1112-1121
Abstract
Diffusion imaging and bound pool fraction (BPF) mapping are two quantitative magnetic resonance imaging techniques that measure microstructural features of the white matter of the brain. Diffusion imaging provides a quantitative measure of the diffusivity of water in tissue. BPF mapping is a quantitative magnetization transfer (qMT) technique that estimates the proportion of exchanging protons bound to macromolecules, such as those found in myelin, and is thus a more direct measure of myelin content than diffusion. In this work, we combined BPF estimates of macromolecular content with measurements of diffusivity within human white matter tracts. Within the white matter, the correlation between BPFs and diffusivity measures such as fractional anisotropy and radial diffusivity was modest, suggesting that diffusion tensor imaging and bound pool fractions are complementary techniques. We found that several major tracts have high BPF, suggesting a higher density of myelin in these tracts. We interpret these results in the context of a quantitative tissue model.
View details for DOI 10.1016/j.neuroimage.2010.08.068
View details for Web of Science ID 000285486000036
View details for PubMedID 20828622
View details for PubMedCentralID PMC2997845
-
Task-Dependent V1 Responses in Human Retinitis Pigmentosa
INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE
2010; 51 (10): 5356-5364
Abstract
During measurement with functional MRI (fMRI) during passive viewing, subjects with macular degeneration (MD) have a large unresponsive lesion projection zone (LPZ) in V1. fMRI responses can be evoked from the LPZ when subjects engage in a stimulus-related task. The authors report fMRI measurements on a different class of subjects, those with retinitis pigmentosa (RP), who have intact foveal vision but peripheral visual field loss.The authors measured three RP subjects and two control subjects. fMRI was performed while the subjects viewed drifting contrast pattern stimuli. The subjects passively viewed the stimuli or performed a stimulus-related task.During passive viewing, the BOLD response in the posterior calcarine cortex of all RP subjects was in phase with the stimulus. A bordering, anterior LPZ could be identified by responses that were in opposite phase to the stimulus. When the RP subjects made stimulus-related judgments, however, the LPZ responses changed: the responses modulated in phase with the stimulus and task. In control subjects, the responses in a simulated V1 LPZ were unchanged between the passive and the stimulus-related judgment conditions.Task-dependent LPZ responses are present in RP subjects, similar to responses measured in MD subjects. The results are consistent with the hypothesis that deleting the retinal input to the LPZ unmasks preexisting extrastriate feedback signals that are present across V1. The authors discuss the implications of this hypothesis for visual therapy designed to replace the missing V1 LPZ inputs and to restore vision.
View details for DOI 10.1167/iovs.09-4775
View details for Web of Science ID 000282275500065
View details for PubMedID 20445118
-
Congenital Achiasma and See-Saw Nystagmus in VACTERL Syndrome
JOURNAL OF NEURO-OPHTHALMOLOGY
2010; 30 (1): 45-48
Abstract
A 29-year-old man with vertebral defects, anal atresia, cardiac defects, tracheoesophageal fistula, renal defects, and limb defects (VACTERL) presented with headache, photophobia, and worsening nystagmus. He had near-normal visual acuity and visual fields, absent stereopsis, and see-saw nystagmus. Brain MRI revealed a thin remnant of the optic chiasm but normal-sized optic nerves. Functional MRI during monocular visual stimulation demonstrated non-crossing of the visual evoked responses in the occipital cortex, confirming achiasma. These findings have not previously been reported in VACTERL.
View details for DOI 10.1097/WNO.0b013e3181c28fc0
View details for Web of Science ID 000275061500012
View details for PubMedID 20182207
View details for PubMedCentralID PMC3550004
-
Cortical Maps and White Matter Tracts following Long Period of Visual Deprivation and Retinal Image Restoration
NEURON
2010; 65 (1): 21-31
Abstract
Abnormal visual input during development has dramatic effects on the visual system. How does the adult visual system respond when input is corrected? MM lost his left eye and became blind in the right due to corneal damage at the age of 3. At age 46, MM regained his retinal image, but his visual abilities, even seven years following the surgery, remain severely limited, and he does not rely on vision for daily life. Neuroimaging measurements reveal several differences among MM, sighted controls, sighted monocular, and early blind subjects. We speculate that these differences stem from damage during the critical period in development of retinal neurons with small, foveal receptive fields. In this case, restoration of functional vision requires more than improving retinal image contrast. In general, visual restoration will require accounting for the developmental trajectory of the individual and the consequences of the early deprivation on cortical circuitry.
View details for DOI 10.1016/j.neuron.2009.12.006
View details for Web of Science ID 000273791200005
View details for PubMedID 20152110
View details for PubMedCentralID PMC2948651
-
Mapping hV4 and ventral occipital cortex: The venous eclipse
JOURNAL OF VISION
2010; 10 (5)
Abstract
While the fourth human visual field map (hV4) has been studied for two decades, there remain uncertainties about its spatial organization. In analyzing fMRI measurements designed to resolve these issues, we discovered a significant problem that afflicts measurements from ventral occipital cortex, and particularly measurements near hV4. In most hemispheres the fMRI hV4 data are contaminated by artifacts from the transverse sinus (TS). We created a model of the TS artifact and showed that the model predicts the locations of anomalous fMRI responses to simple large-field on-off stimuli. In many subjects, and particularly the left hemisphere, the TS artifact masks fMRI responses specifically in the region of cortex that distinguishes the two main hV4 models. By selecting subjects with a TS displaced from the lateral edge of hV4, we were able to see around the vein. In these subjects, the visual field coverage extends to the lower meridian, or nearly so, consistent with a model in which hV4 is located on the ventral surface and responds to signals throughout the full contralateral hemifield.
View details for DOI 10.1167/10.5.1
View details for Web of Science ID 000278503100001
View details for PubMedID 20616143
View details for PubMedCentralID PMC3033222
-
Using visible SNR (vSNR) to compare the image quality of pixel binning and digital resizing
Conference on Digital Photography VI
SPIE-INT SOC OPTICAL ENGINEERING. 2010
View details for DOI 10.1117/12.839149
View details for Web of Science ID 000285777000012
-
High-speed Document Sensing and Misprint Detection in Digital Presses
Conference on Sensors, Cameras, and Systems for Industrial/Scientific Applications XI
SPIE-INT SOC OPTICAL ENGINEERING. 2010
View details for DOI 10.1117/12.840325
View details for Web of Science ID 000283486300009
-
Frontoparietal white matter diffusion properties predict mental arithmetic skills in children
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA
2009; 106 (52): 22546-22551
Abstract
Functional MRI studies of mental arithmetic consistently report blood oxygen level-dependent signals in the parietal and frontal regions. We tested whether white matter pathways connecting these regions are related to mental arithmetic ability by using diffusion tensor imaging (DTI) to measure these pathways in 28 children (age 10-15 years, 14 girls) and assessing their mental arithmetic skills. For each child, we identified anatomically the anterior portion of the superior longitudinal fasciculus (aSLF), a pathway connecting parietal and frontal cortex. We measured fractional anisotropy in a core region centered along the length of the aSLF. Fractional anisotropy in the left aSLF positively correlates with arithmetic approximation skill, as measured by a mental addition task with approximate answer choices. The correlation is stable in adjacent core aSLF regions but lower toward the pathway endpoints. The correlation is not explained by shared variance with other cognitive abilities and did not pass significance in the right aSLF. These measurements used DTI, a structural method, to test a specific functional model of mental arithmetic.
View details for DOI 10.1073/pnas.0906094106
View details for Web of Science ID 000273178700090
View details for PubMedID 19948963
View details for PubMedCentralID PMC2799736
-
Plasticity and stability of visual field maps in adult primary visual cortex
NATURE REVIEWS NEUROSCIENCE
2009; 10 (12): 873-884
Abstract
It is important to understand the balance between cortical plasticity and stability in various systems and across spatial scales in the adult brain. Here we review studies of adult plasticity in primary visual cortex (V1), which has a key role in distributing visual information. There are claims of plasticity at multiple spatial scales in adult V1, but a number of inconsistencies in the supporting data raise questions about the extent and nature of such plasticity. Our understanding of the extent of plasticity in V1 is further limited by a lack of quantitative models to guide the interpretation of the data. These problems limit efforts to translate research findings about adult cortical plasticity into significant clinical, educational and policy applications.
View details for DOI 10.1038/nrn2741
View details for Web of Science ID 000271962500012
View details for PubMedID 19904279
View details for PubMedCentralID PMC2895763
-
Visual Field Maps, Population Receptive Field Sizes, and Visual Field Coverage in the Human MT plus Complex
JOURNAL OF NEUROPHYSIOLOGY
2009; 102 (5): 2704-2718
Abstract
Human neuroimaging experiments typically localize motion-selective cortex (MT+) by contrasting responses to stationary and moving stimuli. It has long been suspected that MT+, located on the lateral surface at the temporal-occipital (TO) boundary, contains several distinct visual field maps, although only one coarse map has been measured. Using a novel functional MRI model-based method we identified two maps-TO-1 and TO-2-and measured population receptive field (pRF) sizes within these maps. The angular representation of the first map, TO-1, has a lower vertical meridian on its posterior side at the boundary with the lateral-occipital cortex (i.e., the LO-2 portion). The angular representation continues through horizontal to the upper vertical meridian at the boundary with the second map, TO-2. The TO-2 angle map reverses from upper to lower visual field at increasingly anterior positions. The TO maps share a parallel eccentricity map in which center-to-periphery is represented in the ventral-to-dorsal direction; both maps have an expanded foveal representation. There is a progressive increase in the pRF size from V1/2/3 to LO-1/2 and TO-1/2, with the largest pRF sizes in TO-2. Further, within each map the pRF size increases as a function of eccentricity. The visual field coverage of both maps extends into the ipsilateral visual field, with larger sensitivity to peripheral ipsilateral stimuli in TO-2 than that in TO-1. The TO maps provide a functional segmentation of human motion-sensitive cortex that enables a more complete characterization of processing in human motion-selective cortex.
View details for DOI 10.1152/jn.00102.2009
View details for Web of Science ID 000271467300012
View details for PubMedID 19587323
-
Two temporal channels in human V1 identified using fMRI
NEUROIMAGE
2009; 47 (1): 273-280
Abstract
Human visual sensitivity to a fairly broad class of dynamic stimuli can be modeled accurately using two temporal channels. Here, we analyze fMRI measurements of the temporal step response to spatially uniform stimuli to estimate these channels in human primary visual cortex (V1). In agreement with the psychophysical literature, the V1 fMRI temporal responses are modeled accurately as a mixture of two (transient and sustained) channels. We derive estimates of the relative contributions from these two channels at a range of eccentricities. We find that all portions of V1 contain a significant transient response. The central visual field representation includes a significant sustained response, but the amplitude of the sustained channel signal declines with eccentricity. The sustained signals may reflect the emphasis on pattern recognition and color in the central visual field; the dominant transient response in the visual periphery may reflect responses in the human visual attention system.
View details for DOI 10.1016/j.neuroimage.2009.03.078
View details for Web of Science ID 000266975300030
View details for PubMedID 19361561
View details for PubMedCentralID PMC2743398
-
Visual Preference for ClearType Technology
47th Annual Symposium of the Society-for-Information-Display
SOC INFORMATION DISPLAY. 2009: 702–705
View details for Web of Science ID 000272997600180
-
Dictionaries for sparse representation and recovery of reflectances
Conference on Computational Imaging VII
SPIE-INT SOC OPTICAL ENGINEERING. 2009
View details for DOI 10.1117/12.813769
View details for Web of Science ID 000291439400007
-
Think Global, Act Local; Projectome Estimation with BlueMatter
12th International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI2009)
SPRINGER-VERLAG BERLIN. 2009: 861–868
View details for Web of Science ID 000273617300106
-
Think global, act local; projectome estimation with BlueMatter.
Medical image computing and computer-assisted intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention
2009; 12: 861-868
Abstract
Estimating the complete set of white matter fascicles (the projectome) from diffusion data requires evaluating an enormous number of potential pathways; consequently, most algorithms use computationally efficient greedy methods to search for pathways. The limitation of this approach is that critical global parameters--such as data prediction error and white matter volume conservation--are not taken into account. We describe BlueMatter, a parallel algorithm for global projectome evaluation, which uniquely accounts for global prediction error and volume conservation. Leveraging the BlueGene/L supercomputing architecture, BlueMatter explores a massive database of 180 billion candidate fascicles. The candidates are derived from several sources, including atlases and multiple tractography algorithms. Using BlueMatter we created the highest resolution, volume-conserved projectome of the human brain.
View details for PubMedID 20426069
View details for PubMedCentralID PMC3076280
-
V1 Projection Zone Signals in Human Macular Degeneration Depend on Task, not Stimulus
CEREBRAL CORTEX
2008; 18 (11): 2483-2493
Abstract
We used functional magnetic resonance imaging to assess abnormal cortical signals in humans with juvenile macular degeneration (JMD). These signals have been interpreted as indicating large-scale cortical reorganization. Subjects viewed a stimulus passively or performed a task; the task was either related or unrelated to the stimulus. During passive viewing, or while performing tasks unrelated to the stimulus, there were large unresponsive V1 regions. These regions included the foveal projection zone, and we refer to them as the lesion projection zone (LPZ). In 3 JMD subjects, we observed highly significant responses in the LPZ while they performed stimulus-related judgments. In control subjects, where we presented the stimulus only within the peripheral visual field, there was no V1 response in the foveal projection zone in any condition. The difference between JMD and control responses can be explained by hypotheses that have very different implications for V1 reorganization. In controls retinal afferents carry signals indicating the presence of a uniform (zero-contrast) region of the visual field. Deletion of retinal input may 1) spur the formation of new cortical pathways that carry task-dependent signals (reorganization), or 2) unmask preexisting task-dependent cortical signals that ordinarily are suppressed by the deleted signals (no reorganization).
View details for DOI 10.1093/cercor/bhm256
View details for Web of Science ID 000260135700002
View details for PubMedID 18250083
View details for PubMedCentralID PMC2733314
-
A Display Simulation Toolbox for image quality evaluation
JOURNAL OF DISPLAY TECHNOLOGY
2008; 4 (2): 262-270
View details for DOI 10.1109/JDT.2007.913963
View details for Web of Science ID 000259552500023
-
Full-brain coverage and high-resolution Imaging capabilities of passband b-SSFP fMRI at 3T
MAGNETIC RESONANCE IN MEDICINE
2008; 59 (5): 1099-1110
Abstract
Passband balanced-steady-state free precession (b-SSFP) fMRI is a recently developed method that utilizes the passband (flat portion) of the b-SSFP off-resonance response to measure MR signal changes elicited by changes in tissue oxygenation following increases in neuronal activity. Rapid refocusing and short readout durations of b-SSFP, combined with the relatively large flat portion of the b-SSFP off-resonance spectrum allows distortion-free full-brain coverage with only two acquisitions. This allows for high-resolution functional imaging, without the spatial distortion frequently encountered in conventional high-resolution functional images. Finally, the 3D imaging compatibility of the b-SSFP acquisitions permits isotropic-voxel-size high-resolution acquisitions. In this study we address some of the major technical issues involved in obtaining passband b-SSFP-based functional brain images with practical imaging parameters and demonstrate the advantages through breath-holding and visual field mapping experiments.
View details for DOI 10.1002/mrm.21576
View details for Web of Science ID 000255230700020
View details for PubMedID 18421687
View details for PubMedCentralID PMC2694041
-
What's in your mind?
NATURE NEUROSCIENCE
2008; 11 (4): 384-385
View details for DOI 10.1038/nn0408-384
View details for Web of Science ID 000254359300005
View details for PubMedID 18368043
-
Colour vision: Cortical circuitry for appearance
CURRENT BIOLOGY
2008; 18 (6): R250-R251
Abstract
Directly stimulating certain cortical neurons can produce a color sensation; a case is reported in which the color perceived by stimulation is the same as the color that most effectively excites the cortical circuitry.
View details for DOI 10.1016/j.cub.2008.01.045
View details for Web of Science ID 000254503300015
View details for PubMedID 18364228
-
Population receptive field estimates in human visual cortex
NEUROIMAGE
2008; 39 (2): 647-660
Abstract
We introduce functional MRI methods for estimating the neuronal population receptive field (pRF). These methods build on conventional visual field mapping that measures responses to ring and wedge patterns shown at a series of visual field locations and estimates the single position in the visual field that produces the largest response. The new method computes a model of the population receptive field from responses to a wide range of stimuli and estimates the visual field map as well as other neuronal population properties, such as receptive field size and laterality. The visual field maps obtained with the pRF method are more accurate than those obtained using conventional visual field mapping, and we trace with high precision the visual field maps to the center of the foveal representation. We report quantitative estimates of pRF size in medial, lateral and ventral occipital regions of human visual cortex. Also, we quantify the amount of input from ipsi- and contralateral visual fields. The human pRF size estimates in V1-V3 agree well with electrophysiological receptive field measurements at a range of eccentricities in corresponding locations within monkey and human visual field maps. The pRF method is non-invasive and can be applied to a wide range of conditions when it is useful to link fMRI signals in the visual pathways to neuronal receptive fields.
View details for DOI 10.1016/j.neuroimage.2007.09.034
View details for Web of Science ID 000251634400011
View details for PubMedID 17977024
View details for PubMedCentralID PMC3073038
-
ConTrack: Finding the most likely pathways between brain regions using diffusion tractography
JOURNAL OF VISION
2008; 8 (9)
Abstract
Magnetic resonance diffusion-weighted imaging coupled with fiber tractography (DFT) is the only non-invasive method for measuring white matter pathways in the living human brain. DFT is often used to discover new pathways. But there are also many applications, particularly in visual neuroscience, in which we are confident that two brain regions are connected, and we wish to find the most likely pathway forming the connection. In several cases, current DFT algorithms fail to find these candidate pathways. To overcome this limitation, we have developed a probabilistic DFT algorithm (ConTrack) that identifies the most likely pathways between two regions. We introduce the algorithm in three parts: a sampler to generate a large set of potential pathways, a scoring algorithm that measures the likelihood of a pathway, and an inferential step to identify the most likely pathways connecting two regions. In a series of experiments using human data, we show that ConTrack estimates known pathways at positions that are consistent with those found using a high quality deterministic algorithm. Further we show that separating sampling and scoring enables ConTrack to identify valid pathways, known to exist, that are missed by other deterministic and probabilistic DFT algorithms.
View details for DOI 10.1167/8.9.15
View details for Web of Science ID 000258709300015
View details for PubMedID 18831651
View details for PubMedCentralID PMC2696074
-
SPATIO-SPECTRAL RECONSTRUCTION OF THE MULTISPECTRAL DATACUBE USING SPARSE RECOVERY
15th IEEE International Conference on Image Processing (ICIP 2008)
IEEE. 2008: 473–476
View details for Web of Science ID 000265921400119
-
PREDICTION OF PREFERRED CLEARTYPE FILTERS USING THE S-CIELAB METRIC
15th IEEE International Conference on Image Processing (ICIP 2008)
IEEE. 2008: 361–364
View details for Web of Science ID 000265921400091
-
PREDICTION OF PREFERRED CLEARTYPE FILTERS USING THE S-CIELAB METRIC
15th IEEE International Conference on Image Processing (ICIP 2008)
IEEE. 2008: 361–364
View details for Web of Science ID 000262505000091
-
Invited paper: A Display Simulation Toolbox
International Symposium of the Society-for-Information-Display (SID 2008)
SOC INFORMATION DISPLAY. 2008: 896–899
View details for Web of Science ID 000258530100227
-
SPATIO-SPECTRAL RECONSTRUCTION OF THE MULTISPECTRAL DATACUBE USING SPARSE RECOVERY
15th IEEE International Conference on Image Processing (ICIP 2008)
IEEE. 2008: 473–476
View details for Web of Science ID 000262505000119
-
fMRI measurements of color in macaque and human
JOURNAL OF VISION
2008; 8 (10)
Abstract
We have used fMRI to measure responses to chromatic and achromatic contrast in retinotopically defined regions of macaque and human visual cortex. We make four observations. Firstly, the relative amplitudes of responses to color and luminance stimuli in macaque area V1 are similar to those previously observed in human fMRI experiments. Secondly, the dorsal and ventral subdivisions of macaque area V4 respond in a similar way to opponent (L--M)-cone chromatic contrast suggesting that they are part of a single functional area. Thirdly, we find that macaque area V4, like area V1, responds preferentially to chromatic contrast compared to luminance contrast and the degree of preference is strongly influenced by the temporal frequency of the stimulus. Finally, we observe that while macaque V4d is a region on the dorsal surface of the macaque visual cortex that responds robustly to chromatic stimuli, human chromatic responses to identical stimuli are largely confined to the ventral surface suggesting a fundamental difference in the topographical organization of higher visual areas between humans and macaques.
View details for DOI 10.1167/8.10.6
View details for Web of Science ID 000262231200007
View details for PubMedID 19146348
View details for PubMedCentralID PMC3045694
-
Identifying the human optic radiation using diffusion imaging and fiber tractography
JOURNAL OF VISION
2008; 8 (10)
Abstract
Measuring the properties of the white matter pathways from retina to cortex in the living human brain will have many uses for understanding visual performance and guiding clinical treatment. For example, identifying the Meyer's loop portion of the optic radiation (OR) has clinical significance because of the large number of temporal lobe resections. We use diffusion tensor imaging and fiber tractography (DTI-FT) to identify the most likely pathway between the lateral geniculate nucleus (LGN) and the calcarine sulcus in sixteen hemispheres of eight healthy volunteers. Quantitative population comparisons between DTI-FT estimates and published postmortem dissections match with a spatial precision of about 1 mm. The OR can be divided into three bundles that are segmented based on the direction of the fibers as they leave the LGN: Meyer's loop, central, and direct. The longitudinal and radial diffusivities of the three bundles do not differ within the measurement noise; there is a small difference in the radial diffusivity between the right and left hemispheres. We find that the anterior tip of Meyer's loop is 28 +/- 3 mm posterior to the temporal pole, and the population range is 1 cm. Hence, it is important to identify the location of this bundle in individual subjects or patients.
View details for DOI 10.1167/8.10.12
View details for Web of Science ID 000262231200013
View details for PubMedID 19146354
View details for PubMedCentralID PMC2759943
-
Visual field maps in human cortex
NEURON
2007; 56 (2): 366-383
Abstract
Much of the visual cortex is organized into visual field maps: nearby neurons have receptive fields at nearby locations in the image. Mammalian species generally have multiple visual field maps with each species having similar, but not identical, maps. The introduction of functional magnetic resonance imaging made it possible to identify visual field maps in human cortex, including several near (1) medial occipital (V1,V2,V3), (2) lateral occipital (LO-1,LO-2, hMT+), (3) ventral occipital (hV4, VO-1, VO-2), (4) dorsal occipital (V3A, V3B), and (5) posterior parietal cortex (IPS-0 to IPS-4). Evidence is accumulating for additional maps, including some in the frontal lobe. Cortical maps are arranged into clusters in which several maps have parallel eccentricity representations, while the angular representations within a cluster alternate in visual field sign. Visual field maps have been linked to functional and perceptual properties of the visual system at various spatial scales, ranging from the level of individual maps to map clusters to dorsal-ventral streams. We survey recent measurements of human visual field maps, describe hypotheses about the function and relationships between maps, and consider methods to improve map measurements and characterize the response properties of neurons comprising these maps.
View details for DOI 10.1016/j.neuron.2007.10.012
View details for Web of Science ID 000250740700013
View details for PubMedID 17964252
-
Contrast responsivity in MT plus correlates with phonological awareness and reading measures in children
NEUROIMAGE
2007; 37 (4): 1396-1406
Abstract
There are several independent sets of findings concerning the neural basis of reading. One set demonstrates a powerful relationship between phonological processing and reading skills. Another set reveals a relationship between visual responses in the motion pathways and reading skills. It is widely assumed that these two findings are unrelated. We tested the hypothesis that phonological awareness is related to motion responsivity in children's MT+. We measured BOLD signals to drifting gratings as a function of contrast. Subjects were 35 children ages 7-12 years with a wide range of reading skills. Contrast responsivity in MT+, but not V1, was correlated with phonological awareness and to a lesser extent with two other measures of reading. No correlation was found between MT+ signals and rapid naming, age or general IQ measures. These results establish an important link between visual and phonological processing in children and suggest that MT+ responsivity is a marker for healthy reading development.
View details for DOI 10.1016/j.neuroimage.2007.05.060
View details for Web of Science ID 000249773600043
View details for PubMedID 17689981
View details for PubMedCentralID PMC2034404
-
Differential sensitivity to words and shapes in ventral occipito-temporal cortex
CEREBRAL CORTEX
2007; 17 (7): 1604-1611
Abstract
Efficient extraction of shape information is essential for proficient reading but the role of cortical mechanisms of shape analysis in word reading is not well understood. We studied cortical responses to written words while parametrically varying the amount of visual noise applied to the word stimuli. In only a few regions along the ventral surface, cortical responses increased with word visibility. We found consistently increasing responses in bilateral posterior occipito-temporal sulcus (pOTS), at an anatomical location that closely matches the "visual word form area". In other cortical regions, such as V1, responses remained constant regardless of the noise level. We performed 3 additional tests to assess the functional specialization of pOTS responses for written word processing. We asked whether pOTS responses are 1) left lateralized, 2) more sensitive to words than to line drawings or false fonts, and 3) invariant for visual hemifield of words but not other stimuli. We found that left and right pOTS response functions both had highest sensitivity for words, intermediate for line drawings, and lowest for false fonts. Visual hemifield invariance was similar for words and line drawings. These results suggest that left and right pOTS are both involved in shape processing, with enhanced efficiency for processing visual word forms.
View details for DOI 10.1093/cercor/bhl071
View details for Web of Science ID 000247349000011
View details for PubMedID 16956978
-
Temporal-callosal pathway diffusivity predicts phonological skills in children
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA
2007; 104 (20): 8556-8561
Abstract
The development of skilled reading requires efficient communication between distributed brain regions. By using diffusion tensor imaging, we assessed the interhemispheric connections in a group of children with a wide range of reading abilities. We segmented the callosal fibers into regions based on their likely cortical projection zones, and we measured diffusion properties in these segmented regions. Phonological awareness (a key factor in reading acquisition) was positively correlated with diffusivity perpendicular to the main axis of the callosal fibers that connect the temporal lobes. These results could be explained by several physiological properties. For example, good readers may have fewer but larger axons connecting left and right temporal lobes, or their axon membranes in these regions may be more permeable than the membranes of poor readers. These measurements are consistent with previous work suggesting that good readers have reduced interhemispheric connectivity and are better at processing rapidly changing visual and auditory stimuli.
View details for DOI 10.1073/pnas.0608961104
View details for Web of Science ID 000246599900065
View details for PubMedID 17483487
View details for PubMedCentralID PMC1895988
-
White matter pathways in reading
CURRENT OPINION IN NEUROBIOLOGY
2007; 17 (2): 258-270
Abstract
Skilled reading requires mapping of visual text to sound and meaning. Because reading relies on neural systems spread across the brain, a full understanding of this cognitive ability involves the identification of pathways that communicate information between these processing regions. In the past few years, diffusion tensor imaging has been used to identify correlations between white matter properties and reading skills in adults and children. White matter differences have been found in left temporo-parietal areas and in posterior callosal tracts. We review these findings and relate them to possible pathways that are important for various aspects of reading. We describe how the results from diffusion tensor imaging can be integrated with functional results in good and poor readers.
View details for DOI 10.1016/j.conb.2007.03.006
View details for Web of Science ID 000246324300018
View details for PubMedID 17379499
-
Laminar profiles of functional activity in the human brain
NEUROIMAGE
2007; 34 (1): 74-84
Abstract
Functional magnetic resonance imaging (fMRI) data were obtained in human visual cortex using sub-millimeter voxels at a field strength of 3 T. Reliable functional signals were largely confined to the gray matter and these responses measure the retinotopic organization of visual cortex. Functional signals were further characterized with respect to their laminar position within the cortical gray matter. The laminar response profiles during our visuospatial attention task, normalized for cortical thickness, had a stereotypical shape, with a peak in the superficial gray matter and declining in the deeper layers. The thickness of the sheet producing functional signals was in excellent agreement with the estimated structural thickness of the gray matter throughout early visual cortex (error < 0.5 mm). Thickness measurements were highly repeatable from session-to-session (error < 0.4 mm). Hence, it is feasible and useful to use high-resolution fMRI to measure laminar activity profiles. The ability to distinguish signals arising in different lamina has significant potential scientific and clinical applications.
View details for DOI 10.1016/j.neuroimage.2006.08.020
View details for Web of Science ID 000242735300008
View details for PubMedID 17011213
-
Assessment of stimulus-induced changes in human V1 visual field maps
JOURNAL OF NEUROPHYSIOLOGY
2006; 96 (6): 3398-3408
Abstract
Visual cortex contains a set of field maps in which nearby scene points are represented in the responses of nearby neurons. We tested a recent hypothesis that the visual field map in primary visual cortex (V1) is dynamic, changing in response to stimulus motion direction. The original experimental report replicates, but further experimental and analytical investigations do not support, the interpretation of the results. The V1 map remains invariant when measured using stimuli moving in different directions. The measurements can be explained by small and systematic response amplitude differences that arise when probing with stimuli moving in different directions.
View details for DOI 10.1152/jn.00556.2006
View details for Web of Science ID 000242177800056
View details for PubMedID 17005617
-
No functional magnetic resonance imaging evidence for brightness and color filling-in in early human visual cortex
JOURNAL OF NEUROSCIENCE
2006; 26 (14): 3634-3641
Abstract
The brightness and color of a surface depends on its contrast with nearby surfaces. For example, a gray surface can appear very light when surrounded by a black surface or dark when surrounded by a white surface. Some theories suggest that perceived surface brightness and color is represented explicitly by neural signals in cortical visual field maps; these neural signals are not initiated by the stimulus itself but rather by the contrast signals at the borders. Here, we use functional magnetic resonance imaging (fMRI) to search for such neural "filling-in" signals. Although we find the usual strong relationship between local contrast and fMRI response, when perceived brightness or color changes are induced by modulating a surrounding field, rather than the surface itself, we find there is no corresponding local modulation in primary visual cortex or other nearby retinotopic maps. Moreover, when we model the obtained fMRI responses, we find strong evidence for contributions of both local and long-range edge responses. We argue that such extended edge responses may be caused by neurons previously identified in neurophysiological studies as being brightness responsive, a characterization that may therefore need to be revised. We conclude that the visual field maps of human V1 and V2 do not contain filled-in, topographical representations of surface brightness and color.
View details for DOI 10.1523/JNEUROSCI.4382-05.2006
View details for Web of Science ID 000236552400004
View details for PubMedID 16597716
-
Optical interaction of space and wavelength in high-resolution digital imagers
Conference on Digital Photography II
SPIE-INT SOC OPTICAL ENGINEERING. 2006
View details for Web of Science ID 000236912000004
-
Computational neuroimaging: Maps and tracts in the human brain
Conference on Human Vision and Electronic Imaging XI
SPIE-INT SOC OPTICAL ENGINEERING. 2006
View details for Web of Science ID 000237083200001
-
Visual field maps and stimulus selectivity in human ventral occipital cortex
NATURE NEUROSCIENCE
2005; 8 (8): 1102-1109
Abstract
Human visual cortex is organized into distinct visual field maps whose locations and properties provide important information about visual computations. There are two conflicting models of the organization and computational role of ventral occipital visual field maps. We report new functional MRI measurements that test these models. We also present the first coordinated measurements of visual field maps and stimulus responsivity to color, objects and faces in ventral occipital cortex. These measurements support a model that includes a hemifield map, hV4, adjacent to the central field representation of ventral V3. In addition, the measurements demonstrate a cluster of visual field maps in ventral occipital cortex (VO cluster) anterior to hV4. We describe the organization and stimulus responsivity of two new hemifield maps, VO-1 and VO-2, within this cluster. The maps and stimulus responsivity support a general organization of visual cortex based on clusters of maps that serve distinct computational functions.
View details for DOI 10.1038/nn1507
View details for Web of Science ID 000230760200023
View details for PubMedID 16025108
-
Exploring connectivity of the brain's white matter with dynamic queries
IEEE Visualization 2004 Conference
IEEE COMPUTER SOC. 2005: 419–30
Abstract
Diffusion Tensor Imaging (DTI) is a magnetic resonance imaging method that can be used to measure local information about the structure of white matter within the human brain. Combining DTI data with the computational methods of MR tractography, neuroscientists can estimate the locations and sizes of nerve bundles (white matter pathways) that course through the human brain. Neuroscientists have used visualization techniques to better understand tractography data, but they often struggle with the abundance and complexity of the pathways. In this paper, we describe a novel set of interaction techniques that make it easier to explore and interpret such pathways. Specifically, our application allows neuroscientists to place and interactively manipulate box or ellipsoid-shaped regions to selectively display pathways that pass through specific anatomical areas. These regions can be used in coordination with a simple and flexible query language which allows for arbitrary combinations of these queries using Boolean logic operators. A representation of the cortical surface is provided for specifying queries of pathways that may be relevant to gray matter structures and for displaying activation information obtained from functional magnetic resonance imaging. By precomputing the pathways and their statistical properties, we obtain the speed necessary for interactive question-and-answer sessions with brain researchers. We survey some questions that researchers have been asking about tractography data and show how our system can be used to answer these questions efficiently.
View details for Web of Science ID 000228988200007
View details for PubMedID 16138552
-
Children's reading performance is correlated with white matter structure measured by diffusion tensor imaging
CORTEX
2005; 41 (3): 354-363
Abstract
We investigated the white matter structure in children (n = 14) with a wide range of reading performance levels using diffusion tensor imaging (DTI), a form of magnetic resonance imaging. White matter structure in a left temporo-parietal region that had been previously described as covarying with reading skill in adult readers also differs between children who are normal and poor readers. Specifically, the white matter structure measured using fractional anisotropy (FA) and coherence index (CI) significantly correlated with behavioral measurements of reading, spelling, and rapid naming performance. In general, lower anisotropy and lower coherence were associated with lower performance scores. Although the magnitude of the differences in children are smaller than those in adults, the results support the hypothesis that the structure of left temporoparietal neural pathways is a significant component of the neural system needed to develop fluent reading.
View details for Web of Science ID 000228941100008
View details for PubMedID 15871600
-
Lack of long-term cortical reorganization after macaque retinal lesions
NATURE
2005; 435 (7040): 300-307
Abstract
Several aspects of cortical organization are thought to remain plastic into adulthood, allowing cortical sensorimotor maps to be modified continuously by experience. This dynamic nature of cortical circuitry is important for learning, as well as for repair after injury to the nervous system. Electrophysiology studies suggest that adult macaque primary visual cortex (V1) undergoes large-scale reorganization within a few months after retinal lesioning, but this issue has not been conclusively settled. Here we applied the technique of functional magnetic resonance imaging (fMRI) to detect changes in the cortical topography of macaque area V1 after binocular retinal lesions. fMRI allows non-invasive, in vivo, long-term monitoring of cortical activity with a wide field of view, sampling signals from multiple neurons per unit cortical area. We show that, in contrast with previous studies, adult macaque V1 does not approach normal responsivity during 7.5 months of follow-up after retinal lesions, and its topography does not change. Electrophysiology experiments corroborated the fMRI results. This indicates that adult macaque V1 has limited potential for reorganization in the months following retinal injury.
View details for DOI 10.1038/nature03495
View details for Web of Science ID 000229185000036
View details for PubMedID 15902248
-
Functional organization of human occipital-callosal fiber tracts
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA
2005; 102 (20): 7350-7355
Abstract
Diffusion tensor imaging (DTI) and fiber tracking (FT) were used to measure the occipital lobe fiber tracts connecting the two hemispheres in individual human subjects. These tracts are important for normal vision. Also, damage to portions of these tracts is associated with alexia. To assess the reliability of the DTI-FT measurements, occipital-callosal projections were estimated from each subject's left and right hemispheres independently. The left and right estimates converged onto the same positions within the splenium. We further characterized the properties of the estimated occipital-callosal fiber tracts by combining them with functional MRI. We used functional MRI to identify visual field maps in cortex and labeled fibers by the cortical functional response at the fiber endpoint. This labeling reveals a regular organization of the fibers within the splenium. The dorsal visual maps (dorsal V3, V3A, V3B, V7) send projections through a large band in the middle of the splenium, whereas ventral visual maps (ventral V3, V4) send projections through the inferior-anterior corner of the splenium. The agreement between the independent left/right estimates, further supported by previous descriptions of homologous tracts in macaque, validates the DTI-FT methods. However, a principal limitation of these methods is low sensitivity: a large number of fiber tracts that connect homotopic regions of ventral and lateral visual cortex were undetected. We conclude that most of the estimated tracts are real and can be localized with a precision of 1-2 mm, but many tracts are missed because of data and algorithm limitations.
View details for DOI 10.1073/pnas.0500003102
View details for Web of Science ID 000229292200053
View details for PubMedID 15883384
View details for PubMedCentralID PMC1129102
-
Visual field map clusters in human cortex
PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY B-BIOLOGICAL SCIENCES
2005; 360 (1456): 693-707
Abstract
We describe the location and general properties of nine human visual field maps. The cortical location of each map, as well as many examples of the eccentricity and angular representations within these maps, are shown in a series of images that summarize a large set of functional MRI data. The organization and properties of these maps are compared and contrasted with descriptions by other investigators. We hypothesize that the human visual field maps are arranged in several clusters, each comprising a group of maps that share a common foveal representation and semicircular eccentricity map. The spatial organization of these clusters suggests that the perceptual processing within each cluster serves related functions.
View details for DOI 10.1098/rstb.2005.1628
View details for Web of Science ID 000229929100004
View details for PubMedID 15937008
View details for PubMedCentralID PMC1569486
-
Specializations for chromatic and temporal signals in human visual cortex
JOURNAL OF NEUROSCIENCE
2005; 25 (13): 3459-3468
Abstract
Neurological case studies and qualitative measurements suggest that regions within human extrastriate cortex are specialized for different perceptual functions, including color. However, there are few quantitative measurements of human extrastriate color specializations. We studied the chromatic and temporal responses in several different clusters of human visual field maps using functional magnetic resonance imaging. Contrast response functions were measured for luminance [(L + M)-cone], red-green [(L - M)-cone] and blue-yellow (S-cone) modulations at various temporal frequencies. In primary visual cortex (V1), temporal responsivities to luminance and red-green modulations are approximately constant up to 10 Hz, but responsivities to blue-yellow modulations decrease significantly. In ventral occipital cortex (VO), all colors elicit strong responses, and, for each color, low temporal frequency modulations are more effective than high temporal frequency modulations. Hence, VO represents the full range of color information but does not respond well to rapid modulations. Conversely, in human motion-selective cortex (MT+) and V3A, blue-yellow modulations elicit very weak responses, whereas luminance and red-green high temporal frequency modulations are equally or more effective than low temporal frequency modulations. Hence, these dorsal occipital regions respond well to rapid modulations, but not all color information is represented. Similar to human motion perception, MT+ and V3A respond powerfully to all temporal frequencies but only to some colors. Similar to human color perception, VO responds powerfully to all colors but only to relatively low temporal frequencies.
View details for DOI 10.1523/JNEUROSCI-4206-04.2005
View details for Web of Science ID 000228038200023
View details for PubMedID 15800201
-
Predominantly extra-retinotopic cortical response to pattern symmetry
NEUROIMAGE
2005; 24 (2): 306-314
Abstract
Symmetry along one or more axes is a key property of objects and biological organisms. We report on a bilateral visual region of occipital cortex that responds strongly to the presence of multiple symmetries in the viewed image. The stimuli consisted of random dots organized in fourfold and onefold mirror-symmetric patterns, against random control stimuli. The contrast between symmetric and random patterns produced negligible or inconsistent activation of the primary visual projection area V1 or of other medial occipital projection areas. However, there was strong symmetry-specific activation in extra-retinotopic lateral occipital cortex. The high level of activation in this region of cortex may represent part of a general class of computations that require integration of information across a large span of the visual field.
View details for DOI 10.1016/j.neuroimage.2004.09.018
View details for Web of Science ID 000226454500004
View details for PubMedID 15627573
-
Cone signal interactions in direction-selective neurons in the middle temporal visual area (MT)
JOURNAL OF VISION
2005; 5 (7): 603-621
Abstract
Many experimental measurements support the hypothesis that the middle temporal visual area (MT) of the rhesus monkey has a central role in processing visual motion. Most of these studies were performed using luminance stimuli, leaving open the question of how color information is used during motion processing. We investigated the specific question of how S-cone signals, an important source of color information, interact with L,M-cone signals, the dominant source of luminance information. In MT, S-cone-initiated signals combine synergistically with L,M-cone (luminance) signals over most of the stimulus range, regardless of whether the stimuli are added or subtracted. A quantitative analysis of the responses to the combination of S- and L,M-cone signals shows that for a significant minority of cells, these S-cone signals are carried to MT by a color-opponent ("blue-yellow") pathway, such that in certain limited contrast ranges, a small amount of S- and L,M-cone cancellation is observed. Both S- and L,M-cone responses are direction-selective, suggesting that MT processes a wide range of motion signals, including those carried by luminance and color. To investigate this possibility further, we measured MT responses while monkeys discriminated the direction of motion of luminance and S-cone-initiated gratings. The sensitivity of single MT neurons and the correlation between trial-to-trial variations in single neuron firing and perception are similar for S- and L,M-cone stimuli, further supporting a role for MT in processing chromatic motion.
View details for DOI 10.1167/5.7.1
View details for Web of Science ID 000232320700001
View details for PubMedID 16231996
-
Roadmap for CMOS image sensors: Moore meets Planck and Sommerfeld
Conference on Digital Photography
SPIE-INT SOC OPTICAL ENGINEERING. 2005: 1–13
View details for Web of Science ID 000228691700001
-
Integrating lens design with digital camera simulation
Conference on Digital Photography
SPIE-INT SOC OPTICAL ENGINEERING. 2005: 48–58
View details for Web of Science ID 000228691700005
-
Psychophysical thresholds and digital camera sensitivity: the thousand photon limit
Conference on Digital Photography
SPIE-INT SOC OPTICAL ENGINEERING. 2005: 75–84
View details for Web of Science ID 000228691700007
-
Occipital-callosal pathways in children - Validation and atlas development
Workshop on White Matter in the Cognitive Neurosciences
NEW YORK ACAD SCIENCES. 2005: 98-?
Abstract
Diffusion tensor imaging and fiber tracking were used to measure fiber bundles connecting the two occipital lobes in 53 children of 7-12 years of age. Independent fiber bundle estimates originating from the two hemispheres converge onto the lower half of the splenium. This observation validates the basic methodology and suggests that most occipital-callosal fibers connect the two occipital lobes. Within the splenium, fiber bundles are organized in a regular pattern with respect to their cortical projection zones. Visual cortex dorsal to calcarine projects through a large band that fills much of the inferior half of the splenium, while cortex ventral to calcarine sends projections through a band at the anterior inferior edge of the splenium. Pathways projecting to the occipital pole and lateral-occipital regions overlap the dorsal and ventral groups slightly anterior to the center of the splenium. To visualize these pathways in a typical brain, we combined the data into an atlas. The estimated occipital-callosal fiber paths from the atlas form the walls of the occipital horn of the lateral ventricle, with dorsal paths forming the medial wall and the ventral paths bifurcating into a medial tract to form the inferior-medial wall and a superior tract that joins the lateral-occipital paths to form the superior wall of the ventricle. The properties of these fiber bundles match those of the hypothetical pathways described in the neurological literature on alexia.
View details for DOI 10.1196/annals.1340.017
View details for Web of Science ID 000235430200008
View details for PubMedID 16394151
-
The behavioral and neural effects of long-term deprivation
Annual Meeting of the Association-for-Research-in-Vision-and-Ophthalmology
ASSOC RESEARCH VISION OPHTHALMOLOGY INC. 2004: U473–U473
View details for Web of Science ID 000223338201760
-
Introduction
Conference of the Summer-Institute-in-Cognitive-Neuroscience
MIT PRESS. 2004: 185–186
View details for Web of Science ID 000279844100014
-
Exploration of the brain's white matter pathways with dynamic queries
IEEE Visualization 2004 Conference
IEEE. 2004: 377–384
View details for Web of Science ID 000225187500048
-
A simulation tool for evaluating digital camera image quality
Conference on Image Quality and System Performance
SPIE-INT SOC OPTICAL ENGINEERING. 2004: 124–131
View details for Web of Science ID 000189424400016
-
Interpreting the BOLD signal
ANNUAL REVIEW OF PHYSIOLOGY
2004; 66: 735-769
Abstract
The development of functional magnetic resonance imaging (fMRI) has brought together a broad community of scientists interested in measuring the neural basis of the human mind. Because fMRI signals are an indirect measure of neural activity, interpreting these signals to make deductions about the nervous system requires some understanding of the signaling mechanisms. We describe our current understanding of the causal relationships between neural activity and the blood-oxygen-level-dependent (BOLD) signal, and we review how these analyses have challenged some basic assumptions that have guided neuroscience. We conclude with a discussion of how to use the BOLD signal to make inferences about the neural signal.
View details for DOI 10.1146/annurev.physiol.66.082602.092845
View details for Web of Science ID 000220827800028
View details for PubMedID 14977420
-
Integrated color pixels in 0.18-mu m complementary metal oxide semiconductor technology
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION
2003; 20 (12): 2293-2306
Abstract
Following the trend of increased integration in complementary metal oxide semiconductor (CMOS) image sensors, we have explored the potential of implementing light filters by using patterned metal layers placed on top of each pixel's photodetector. To demonstrate wavelength selectivity, we designed and prototyped integrated color pixels in a standard 0.18-microm CMOS technology. Transmittance of several one-dimensional (1D) and two-dimensional (2D) patterned metal layers was measured under various illumination conditions and found to exhibit wavelength selectivity in the visible range. We performed (a) wave optics simulations to predict the spectral responsivity of an uncovered reference pixel and (b) numerical electromagnetic simulations with a 2D finite-difference time-domain method to predict transmittances through 1D patterned metal layers. We found good agreement in both cases. Finally, we used simulations to predict the transmittance for more elaborate designs.
View details for Web of Science ID 000187024300010
View details for PubMedID 14686508
-
Long-term deprivation affects visual perception and cortex
NATURE NEUROSCIENCE
2003; 6 (9): 915-916
View details for DOI 10.1038/nn1102
View details for Web of Science ID 000184970400008
View details for PubMedID 12937420
-
Spectral estimation theory: beyond linear but before Bayesian
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION
2003; 20 (7): 1261-1270
Abstract
Most color-acquisition devices capture spectral signals by acquiring only three samples, critically undersampling the spectral information. We analyze the problem of estimating high-dimensional spectral signals from low-dimensional device responses. We begin with the theory and geometry of linear estimation methods. These methods use linear models to characterize the likely input signals and reduce the number of estimation parameters. Next, we introduce two submanifold estimation methods. These methods are based on the observation that for many data sets the deviation between the signal and the linear estimate is systematic; the methods incorporate knowledge of these systematic deviations to improve upon linear estimation methods. We describe the geometric intuition of these methods and evaluate the submanifold method on hyperspectral image data.
View details for Web of Science ID 000183784000012
View details for PubMedID 12868632
-
Functional imaging of the visual pathways
NEUROLOGIC CLINICS
2003; 21 (2): 417-?
Abstract
Functional neuroimaging has provided a new view of activity in human visual cortex. There have been a series of interesting developments in understanding the relationship between the functional signals, particularly functional MRI, and basic measurements of action potentials and local field potentials. The new human neuro-imaging measurements have clarified some of the similarities and differences between the general organization of visual areas in human and macaque visual cortex, and there have been some interesting new results concerning cortical visual plasticity and dysfunction. The new fMRI focus on measurements of the human brain will drive new relationships between neurology and visual neuroscience that should help us learn much more about the neural basis of perception.
View details for DOI 10.1016/S0733-8619(03)00003-3
View details for Web of Science ID 000183127800004
View details for PubMedID 12916486
-
Cognitive neuroscience - Overview
CURRENT OPINION IN NEUROBIOLOGY
2003; 13 (2): 141-143
View details for DOI 10.1016/S0959-4388(03)00049-7
View details for Web of Science ID 000183092700001
View details for PubMedID 12744965
-
Visual field representations and locations of visual areas V1/2/3 in human visual cortex
JOURNAL OF VISION
2003; 3 (10): 586-598
Abstract
The position, surface area and visual field representation of human visual areas V1, V2 and V3 were measured using fMRI in 7 subjects (14 hemispheres). Cortical visual field maps of the central 12 deg were measured using rotating wedge and expanding ring stimuli. The boundaries between areas were identified using an automated procedure to fit an atlas of the expected visual field map to the data. All position and surface area measurements were made along the boundary between white matter and gray matter. The representation of the central 2 deg of visual field in areas V1, V2, V3 and hV4 spans about 2100 mm2 and is centered on the lateral-ventral aspect of the occipital lobes at Talairach coordinates -29, -78, -11 and 25, -80, -9. The mean area between the 2-deg and 12-deg eccentricities for the primary visual areas was: V1: 1470 mm2; V2: 1115 mm2; and V3: 819 mm2. The sizes of areas V1, V2 and V3 varied by about a factor of 2.5 across individuals; the sizes of V1 and V2 are significantly correlated within individuals, but there is a very low correlation between V1 and V3. These in vivo measurements of normal human retinotopic visual areas can be used as a reference for comparison to unusual cases involving developmental plasticity, recovery from injury, identifying homology with animal models, or analyzing the computational resources available within the visual pathways.
View details for DOI 10.1167/3.10.1
View details for Web of Science ID 000223082000001
View details for PubMedID 14640882
-
Preferred color spaces for white balancing
Conference on Sensors and Camera Systems for Scientific, Industrial, and Digital Photography Applications IV
SPIE-INT SOC OPTICAL ENGINEERING. 2003: 342–350
View details for Web of Science ID 000183702400036
-
Color estimation error trade-offs
Conference on Sensors and Camera Systems for Scientific, Industrial, and Digital Photography Applications IV
SPIE-INT SOC OPTICAL ENGINEERING. 2003: 263–273
View details for Web of Science ID 000183702400028
-
Visual areas in macaque cortex measured using functional magnetic resonance imaging
JOURNAL OF NEUROSCIENCE
2002; 22 (23): 10416-10426
Abstract
We describe the first systematic functional magnetic resonance imaging (fMRI) measurements of visual field maps in macaque visual cortex. The boundaries of visual areas V1, V2, V3, V3A, V4, MT/V5, and TEO/V4A were identified using stimuli that create traveling waves of activity in retinotopically organized areas of the visual cortex. Furthermore, these stimuli were used to measure the dimensions of the representations of the central 11 degrees in V1-V3, quantitative visual field eccentricity functions for V1-V3 and MT, and the distribution of foveal and peripheral signals within the occipital lobe. Within areas V1, V2, MT, and portions of V4, the fMRI signals were 5-10 times the noise level (3 mm3 volumes of interest). Signals were weaker but still significant in other cortical regions, including V3, V3A, and TEO. There is good agreement between the fMRI maps and the visual area maps discovered using local anatomical and physiological measurements. The fMRI measurements allow one to obtain a broad view of the distribution of cortical signals, spanning multiple visual areas at a single point in time. The combination of scale and sensitivity demonstrated here create a good foundation for measuring how localized signals and lesions influence the responses and reorganization in widely separated cortical regions. The ability to measure human and macaque maps using the same technology will make it possible to define computational homologies between the two species.
View details for Web of Science ID 000179458100037
View details for PubMedID 12451141
-
Chromatic light adaptation measured using functional magnetic resonance imaging
JOURNAL OF NEUROSCIENCE
2002; 22 (18): 8148-8157
Abstract
Sensitivity changes, beginning at the first stages of visual transduction, permit neurons with modest dynamic range to respond to contrast variations across an enormous range of mean illumination. We have used functional magnetic resonance imaging (fMRI) to investigate how these sensitivity changes are controlled within the visual pathways. We measured responses in human visual area V1 to a constant-amplitude, contrast-reversing probe presented on a range of mean backgrounds. We found that signals from probes initiated in the L and M cones were affected by backgrounds that changed the mean absorption rates in the L and M cones, but not by background changes seen only by the S cones. Similarly, signals from S cone-initiated probes were altered by background changes in the S cones, but not by background changes in the L and M cones. Performance in psychophysical tests under similar conditions closely mirrored the changes in V1 fMRI signals. We compare our data with simulations of the visual pathway from photon catch rates to cortical blood-oxygen level-dependent signals and show that the quantitative fMRI signals are consistent with a simple model of mean-field adaptation based on Naka-Rushton (Naka and Rushton, 1966) adaptation mechanisms within cone photoreceptor classes.
View details for Web of Science ID 000177916000036
View details for PubMedID 12223569
-
Functional measurements of human ventral occipital cortex: retinotopy and colour
Discussion Meeting on the Physiology of Cognitive Processes
ROYAL SOC. 2002: 963–73
Abstract
Human colour vision originates in the cone photoreceptors, whose spatial density peaks in the fovea and declines rapidly into the periphery. For this reason, one expects to find a large representation of the cone-rich fovea in those cortical locations that support colour perception. Human occipital cortex contains several distinct foveal representations including at least two that extend onto the ventral surface: a region thought to be critical for colour vision. To learn more about these ventral signals, we used functional magnetic resonance imaging to identify visual field maps and colour responsivity on the ventral surface. We found a visual map of the complete contralateral hemifield in a 4 cm(2) region adjacent to ventral V3; the foveal representation of this map is confluent with that of areas V1/2/3. Additionally, a distinct foveal representation is present on the ventral surface situated 3-5 cm anterior from the confluent V1/2/3 foveal representations. This organization is not consistent with the definition of area V8, which assumes the presence of a quarter field representation adjacent to V3v. Comparisons of responses to luminance-matched coloured and achromatic patterns show increased activity to the coloured stimuli beginning in area V1 and extending through the new hemifield representation and further anterior in the ventral occipital lobe.
View details for DOI 10.1098/rstb.2002.1108
View details for Web of Science ID 000177902600002
View details for PubMedID 12217168
View details for PubMedCentralID PMC1693014
-
Optical efficiency of image sensor pixels
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION
2002; 19 (8): 1610-1620
Abstract
The ability to reproduce a high-quality image depends strongly on the image sensor light sensitivity. This sensitivity depends, in turn, on the materials, the circuitry, and the optical properties of the pixel. We calculate the optical efficiency of a complementary metal oxide semiconductor (CMOS) image sensor pixel by using a geometrical-optics phase-space approach. We compare the theoretical predictions with measurements made by using a CMOS digital pixel sensor, and we find them to be in agreement within 3%. Finally, we show how to use these optical efficiency calculations to trade off image sensor pixel sensitivity and functionality as CMOS process technology scales.
View details for Web of Science ID 000177021500017
View details for PubMedID 12152702
-
Object-based illumination classification
PATTERN RECOGNITION
2002; 35 (8): 1723-1732
View details for Web of Science ID 000175784300007
-
Reorganization of human cortical maps caused by inherited photoreceptor abnormalities
NATURE NEUROSCIENCE
2002; 5 (4): 364-370
Abstract
We describe a compelling demonstration of large-scale developmental reorganization in the human visual pathways. The developmental reorganization was observed in rod monochromats, a rare group of congenitally colorblind individuals who virtually lack cone photoreceptor function. Normal controls had a cortical region, spanning several square centimeters, that responded to signals initiated in the all-cone foveola but was inactive under rod viewing conditions; in rod monochromats this cortical region responded powerfully to rod-initiated signals. The measurements trace a causal pathway that begins with a genetic anomaly that directly influences sensory cells and ultimately results in a substantial central reorganization.
View details for DOI 10.1038/nn817
View details for Web of Science ID 000174606900017
View details for PubMedID 11914722
-
The complex functional Magnetic Resonance Imaging signal
MIT PRESS. 2002: 38–39
View details for Web of Science ID 000174072000109
-
Illuminant estimation of natural scene using the sensor correlation method
9th Congress of the International-Colour-Association (AIC)
SPIE-INT SOC OPTICAL ENGINEERING. 2002: 918–921
View details for Web of Science ID 000177509400223
-
Common principles of image acquisition systems and biological vision
PROCEEDINGS OF THE IEEE
2002; 90 (1): 5-17
View details for Web of Science ID 000173741200002
-
Natural scene-illuminant estimation using the sensor correlation
PROCEEDINGS OF THE IEEE
2002; 90 (1): 42-56
View details for Web of Science ID 000173741200005
-
Abnormal retinotopic representations in human visual cortex revealed by fMRI
ACTA PSYCHOLOGICA
2001; 107 (1-3): 229-247
Abstract
The representation of the visual field in early visual areas is retinotopic. The point-to-point relationship on the retina is therefore maintained on the convoluted cortical surface. Functional magnetic resonance imaging (fMRI) has been able to demonstrate the retinotopic representation of the visual field in occipital cortex of normal subjects. Furthermore, visual areas that are retinotopic can be identified on computationally flattened cortical maps on the basis of positions of the vertical and horizontal meridians. Here, we investigate abnormal retinotopic representations in human visual cortex with fMRI. We present three case studies in which patients with visual disorders are investigated. We have tested a subject who only possesses operating rod photoreceptors. We find in this case that the cortex undergoes a remapping whereby regions that would normally represent central field locations now map more peripheral positions in the visual field: In a human albino we also find abnormal visual cortical activity. Monocular stimulation of each hemifield resulted in activations in the hemisphere contralateral to the stimulated eye. This is consistent with abnormal decussation at the optic chiasm in albinism. Finally, we report a case where a lesion to white matter has resulted in a lack of measurable activity in occipital cortex. The activity was absent for a small region of the visual field, which was found to correspond to the subject's field defect. The cases selected have been chosen to demonstrate the power of fMRI in identifying abnormalities in the cortical representations of the visual field in patients with visual dysfunction. Furthermore, the experiments are able to show how the cortex is capable of modifying the visual field representation in response to abnormal input.
View details for Web of Science ID 000168792700010
View details for PubMedID 11388137
-
Visual areas and spatial summation in human visual cortex
VISION RESEARCH
2001; 41 (10-11): 1321-1332
Abstract
Functional MRI measurements can securely partition the human posterior occipital lobe into retinotopically organized visual areas (V1, V2 and V3) with experiments that last only 30 min. Methods for identifying functional areas in the dorsal and ventral aspect of the human occipital cortex, however, have not achieved this level of precision; in fact, different laboratories have produced inconsistent reports concerning the visual areas in dorsal and ventral occipital lobe. We report four findings concerning the visual representation in dorsal regions of occipital cortex. First, cortex near area V3A contains a central field representation that is distinct from the foveal representation at the confluence of areas V1, V2 and V3. Second, adjacent to V3A there is a second visual area, V3B, which represents both the upper and lower quadrants. The central representation in V3B appears to merge with that of V3A, much as the central representations of V1/2/3 come together on the lateral margin of the posterior pole. Third, there is yet another dorsal representation of the central visual field. This representation falls in area V7, which includes a representation of both the upper and lower quadrants of the visual field. Fourth, based on visual field and spatial summation measurements, it appears that the receptive field properties of neurons in area V7 differ from those in areas V3A and V3B.
View details for Web of Science ID 000168565200010
View details for PubMedID 11322977
-
Image analysis using modulated light sources
Symposium on Sugarcane and Society
SPIE-INT SOC OPTICAL ENGINEERING. 2001: 22–30
View details for Web of Science ID 000170428700003
-
Illuminating illumination
9th Annual Color Imaging Conference
SOCIETY IMAGING SCIENCE TECHNOLOGY. 2001: 27–34
View details for Web of Science ID 000183987000006
-
Scene illuminant classification: brighter is better
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION
2001; 18 (1): 55-64
Abstract
Knowledge of the scene illuminant spectral power distribution is useful for many imaging applications, such as color image reproduction and automatic algorithms for image database applications. In many applications accurate spectral characterization of the illuminant is impossible because the input device acquires only three spectral samples. In such applications it is sensible to set a more limited objective of classifying the illuminant as belonging to one of several likely types. We describe a data set of natural images with measured illuminants for testing illuminant classification algorithms. One simple type of algorithm is described and evaluated by using the new data set. The empirical measurements show that illuminant information is more reliable in bright regions than in dark regions. Theoretical predictions of the algorithm's classification performance with respect to scene illuminant blackbody color temperature are tested and confirmed by using the natural-image data set.
View details for Web of Science ID 000166042500005
View details for PubMedID 11152004
-
Visualization and measurement of the cortical surface
JOURNAL OF COGNITIVE NEUROSCIENCE
2000; 12 (5): 739-752
Abstract
Much of the human cortical surface is obscured from view by the complex pattern of folds, making the spatial relationship between different surface locations hard to interpret. Methods for viewing large portions of the brain's surface in a single flattened representation are described. The flattened representation preserves several key spatial relationships between regions on the cortical surface. The principles used in the implementations and evaluations of these implementations using artificial test surfaces are provided. Results of applying the methods to structural magnetic resonance measurements of the human brain are also shown. The implementation details are available in the source code, which is freely available on the Internet.
View details for Web of Science ID 000089817500004
View details for PubMedID 11054917
-
Illuminant estimation: Beyond the bases
8th Annual Color Imaging Conference
SOCIETY IMAGING SCIENCE TECHNOLOGY. 2000: 91–96
View details for Web of Science ID 000183988000018
-
Rendering high dynamic range images
Conference on Sensors and Camera Systems for Scientific, Industrial, and Digital Photography Applications
SPIE-INT SOC OPTICAL ENGINEERING. 2000: 392–401
View details for Web of Science ID 000087919300043
-
Further research on the sensor correlation method for scene illuminant classification
8th Annual Color Imaging Conference
SOCIETY IMAGING SCIENCE TECHNOLOGY. 2000: 189–194
View details for Web of Science ID 000183988000035
-
How small should pixel size be?
Conference on Sensors and Camera Systems for Scientific, Industrial, and Digital Photography Applications
SPIE-INT SOC OPTICAL ENGINEERING. 2000: 451–459
View details for Web of Science ID 000087919300049
-
Color signals in human motion-selective cortex
NEURON
1999; 24 (4): 901-909
Abstract
The neural basis for the effects of color and contrast on perceived speed was examined using functional magnetic resonance imaging (fMRI). Responses to S cone (blue-yellow) and L + M cone (luminance) patterns were measured in area V1 and in the motion area MT+. The MT+ responses were quantitatively similar to perceptual speed judgments of color patterns but not to color detection measures. We also measured cortical motion responses in individuals lacking L and M cone function (S cone monochromats). The S cone monochromats have clear motion-responsive regions in the conventional MT+ position, and their contrast-response functions there have twice the responsivity of S cone contrast-response functions in normal controls. But, their responsivity is far lower than the normals' responsivity to luminance contrast. Thus, the powerful magnocellular input to MT+ is either weak or silent during photopic vision in S cone monochromats.
View details for Web of Science ID 000084495300018
View details for PubMedID 10624953
-
Perceived speed of colored stimuli
NEURON
1999; 24 (4): 893-899
Abstract
The influence of contrast and color on perceived motion was measured using a speed-matching task. Observers adjusted the speed of an L cone contrast pattern to match that of a variety of colored test patterns. The dependence of speed on test contrast was the same for all test colors measured, differing only by a sensitivity factor. This result suggests that the reduced apparent speed of low contrast targets and certain colored targets is caused by a common cortical mechanism. The cone contrast levels that equate perceived speed differ substantially from those that equate visibility. This result suggests that the neural mechanisms governing speed perception and visibility differ. Perceived speed differences caused by variations in color can be explained by color responses that are characteristic of motion-selective cortex.
View details for Web of Science ID 000084495300017
View details for PubMedID 10624952
-
Color signals in area MT of the macaque monkey
NEURON
1999; 24 (4): 911-917
Abstract
The relationship between the neural processing of color and motion information has been a contentious issue in visual neuroscience. We examined this relationship directly by measuring neural responses to isoluminant S cone signals in extrastriate area MT of the macaque monkey. S cone stimuli produced robust, direction-selective responses at most recording sites, indicating that color signals are present in MT. While these responses were unequivocal, S cone contrast sensitivity was, on average, 1.0-1.3 log units lower than luminance contrast sensitivity. The presence of S cone responses and the relative sensitivity of MT neurons to S cone and luminance signals agree with functional magnetic resonance imaging (fMRI) measurements in human MT+. The results are consistent with the hypothesis that color signals in MT influence behavior in speed judgment tasks.
View details for Web of Science ID 000084495300019
View details for PubMedID 10624954
-
Trichromatic opponent color classification
VISION RESEARCH
1999; 39 (20): 3444-3458
Abstract
Stimuli varying in intensity and chromaticity, presented on numerous backgrounds, were classified into red/green, blue/yellow and white/black opponent color categories. These measurements revealed the shapes of the boundaries that separate opponent colors in three-dimensional color space. Opponent color classification boundaries were generally not planar, but their shapes could be summarized by a piecewise linear model in which increment and decrement color signals are combined with different weights at two stages to produce opponent color sensations. The effect of background light on classification was largely explained by separate gain changes in increment and decrement cone signals.
View details for Web of Science ID 000081693700011
View details for PubMedID 10615508
-
Topographic organization of human visual areas in the absence of input from primary cortex
JOURNAL OF NEUROSCIENCE
1999; 19 (7): 2619-2627
Abstract
Recently, there has been evidence for considerable plasticity in primary sensory areas of adult cortex. In this study, we asked to what extent topographical maps in human extrastriate areas reorganize after damage to a portion of primary visual (striate) cortex, V1. Functional magnetic resonance imaging signals were measured in a subject (G.Y.) with a large calcarine lesion that includes most of primary visual cortex but spares the foveal representation. When foveal stimulation was present, intact cortex in the lesioned occipital lobe exhibited conventional retinotopic organization. Several visual areas could be identified (V1, V2, V3, V3 accessory, and V4 ventral). However, when stimuli were restricted to the blind portion of the visual field, responses were found primarily in dorsal extrastriate areas. Furthermore, cortex that had formerly shown normal topography now represented only the visual field around the lower vertical meridian. Several possible sources for this reorganized activity are considered, including transcallosal connections, direct subcortical projections to extrastriate cortex, and residual inputs from V1 near the margin of the lesion. A scheme is described to explain how the reorganized signals could occur based on changes in the local neural connections.
View details for Web of Science ID 000079344400020
View details for PubMedID 10087075
-
Adaptive cluster dot dithering
JOURNAL OF ELECTRONIC IMAGING
1999; 8 (2): 133-144
View details for Web of Science ID 000085103600001
-
Computational neuroimaging of human visual cortex
ANNUAL REVIEW OF NEUROSCIENCE
1999; 22: 145-?
Abstract
Functional magnetic resonance imaging is a new neuroimaging method for probing the intact, alert, human brain. With this tool, brain activity that has been hidden can now be measured. Recent advances in measuring and understanding human neural responses underlying motion, color, and pattern perception are reviewed. In individual human brain, we can now identify the positions of several retinotopically organized visual areas; measure retinotopic organization within these areas; identify the location of a motion-sensitive region in individual brains; measure responses associated with contrast, color, and motion; and measure effects of attentional modulation on visually evoked responses. By framing experiments and analyses as questions about visual computation, these neuroimaging measurements can be coupled closely with those from other basic vision-science methods.
View details for Web of Science ID 000079267400007
View details for PubMedID 10202535
-
Anisotropic smoothing of posterior probabilities
Mathematical Theory on Networks and Systems Symposium (MTNS-98)
BIRKHAUSER VERLAG AG. 1999: 419–432
View details for Web of Science ID 000084109400020
-
Comparative analysis of color architectures for image sensors
Conference on Sensors, Cameras, and Applications for Digital Photography
SPIE - INT SOC OPTICAL ENGINEERING. 1999: 26–35
View details for Web of Science ID 000079968600003
-
Color temperature estimation of scene illumination
7th Annual Color Imaging Conference
SOCIETY IMAGING SCIENCE TECHNOLOGY. 1999: 42–47
View details for Web of Science ID 000175967300009
-
Color image fidelity metrics evaluated using image distortion maps
SIGNAL PROCESSING
1998; 70 (3): 201-214
View details for Web of Science ID 000077217500004
-
Segmenting cortical gray matter for functional MRI visualization
6th International Conference on Computer Vision
NAROSA PUBLISHING HOUSE. 1998: 292–297
View details for Web of Science ID 000075656000040
-
Creating connected representations of cortical gray matter for functional MRI visualization
IEEE TRANSACTIONS ON MEDICAL IMAGING
1997; 16 (6): 852-863
Abstract
We describe a system that is being used to segment gray matter from magnetic resonance imaging (MRI) and to create connected cortical representations for functional MRI visualization (fMRI). The method exploits knowledge of the anatomy of the cortex and incorporates structural constraints into the segmentation. First, the white matter and cerebral spinal fluid (CSF) regions in the MR volume are segmented using a novel techniques of posterior anisotropic diffusion. Then, the user selects the cortical white matter component of interest, and its structure is verified by checking for cavities and handles. After this, a connected representation of the gray matter is created by a constrained growing-out from the white matter boundary. Because the connectivity is computed, the segmentation can be used as input to several methods of visualizing the spatial pattern of cortical activity within gray matter. In our case, the connected representation of gray matter is used to create a flattened representation of the cortex. Then, fMRI measurements are overlaid on the flattened representation, yielding a representation of the volumetric data within a single image. The software is freely available to the research community.
View details for Web of Science ID 000072458500015
View details for PubMedID 9533585
-
Colour tuning in human visual cortex measured with functional magnetic resonance imaging
NATURE
1997; 388 (6637): 68-71
Abstract
The primate retina contains three classes of cones, the L, M and S cones, which respond preferentially to long-, middle- and short-wavelength visible light, respectively. Colour appearance results from neural processing of these cone signals within the retina and the brain. Perceptual experiments have identified three types of neural pathways that represent colour: a red-green pathway that signals differences between L- and M-cone responses; a blue-yellow pathway that signals differences between S-cone responses and a sum of L- and M-cone responses; and a luminance pathway that signals a sum of L- and M-cone responses. It might be expected that there are neurons in the primary visual cortex with response properties that resemble these three perceptual pathways, but attempts to find them have led to inconsistent results. We have therefore used functional magnetic resonance imaging (fMRI) to examine responses in the human brain to a large number of colours. In visual cortical areas V1 and V2, the strongest response is to red-green stimuli, and much of this activity is from neurons receiving opposing inputs from L and M cones. A strong response is also seen with blue-yellow stimuli, and this response declines rapidly as the temporal frequency of the stimulus is increased. These responses resemble psychophysical measurements, suggesting that colour signals relevant for perception are encoded in a large population of neurons in areas V1 and V2.
View details for Web of Science ID A1997XJ14300051
View details for PubMedID 9214503
-
Retinotopic organization in human visual cortex and the spatial precision of functional MRI
CEREBRAL CORTEX
1997; 7 (2): 181-192
Abstract
A method of using functional magnetic resonance imaging (fMRI) to measure retinotopic organization within human cortex is described. The method is based on a visual stimulus that creates a traveling wave of neural activity within retinotopically organized visual areas. We measured the fMRI signal caused by this stimulus in visual cortex and represented the results on images of the flattened cortical sheet. We used the method to locate visual areas and to evaluate the spatial precision of fMRI. Specifically, we: (i) identified the borders between several retinotopically organized visual areas in the posterior occipital lobe; (ii) measured the function relating cortical position to visual field eccentricity within area V1; (iii) localized activity to within 1.1 mm of visual cortex; and (iv) estimated the spatial resolution of the fMRI signal and found that signal amplitude falls to 60% at a spatial frequency of 1 cycle per 9 mm of visual cortex. This spatial resolution is consistent with a linespread whose full width at half maximum spreads across 3.5 mm of visual cortex.
View details for Web of Science ID A1997WJ36100009
View details for PubMedID 9087826
-
Anisotropic smoothing of posterior probabilities
International Conference on Image Processing
IEEE COMPUTER SOC. 1997: 675–678
View details for Web of Science ID A1997BJ90C00171
-
Color image quality metric S-CIELAB and its application on halftone texture visibility
42nd IEEE-Computer-Society International Conference (CompCon 97)
I E E E, COMPUTER SOC PRESS. 1997: 44–48
View details for Web of Science ID A1997BH45F00007
-
Applications of a spatial extension to CIELAB
Very High Resolution and Quality Imaging II Conference
SPIE-INT SOC OPTICAL ENGINEERING. 1997: 154–157
View details for Web of Science ID A1997BH60W00017
-
Color appearance of mixture gratings
VISION RESEARCH
1996; 36 (18): 2849-2864
Abstract
We have examined how color appearance varies with spatial pattern. Subjects set color-matches between a uniform, 2 deg matching field and bars within squarewave patterns (1,2 and 4 c/deg) or the superposition of these squarewaves. The matches were set using squarewaves and squarewave mixtures with many different colors and contrasts. The color-matches satisfied the basic properties of a linear system to within a tolerance of twice the precision of repeated matches. Matches satisfied contrast-homogeneity: the contrast of the matching field was proportional to the contrast of the squarewave pattern or the mixture of squarewave patterns. Matches also satisfied pattern-superposition: if a bar in one squarewave matched one uniform field, and a bar in a second squarewave matched a second uniform field, the superposition of the two squarewave bars matched the superposition of the uniform matching fields. Matches are predicted by a model in which the color at a location is predicted by the responses of three linear, pattern-color separable mechanisms. As the individual mechanisms are pattern-color separable, meaningful pattern and color-responsivity functions can be estimated for each of the mechanisms. The estimated color-responsivity functions, based only on asymmetric color-matches, have an opponent-colors organization.
View details for Web of Science ID A1996VK58400006
View details for PubMedID 8917788
-
Seeing gray through the ON and OFF pathways
VISUAL NEUROSCIENCE
1996; 13 (3): 591-596
Abstract
Color appearance judgments revealed fundamental differences in visual processing of incremental and decremental lights. First, the balance of cone activation required for a light to appear achromatic was different for increments and decrements (Judd, 1940; Helson & Michels, 1948). Second, adaptation--the visual system's adjustment to background light--affected achromatic decrements more than increments. Third, the regulation of adaptation for incremental and decremental stimuli depended differently on background signals from the three cone types. We interpret these asymmetries as differences in mechanisms of adaptation in the ON and OFF pathways, and suggest that they evolved to accommodate the range and physical sources of color signals in the two pathways.
View details for Web of Science ID A1996UH52800020
View details for PubMedID 8782387
-
Effects of patterned backgrounds on color appearance
ASSOC RESEARCH VISION OPHTHALMOLOGY INC. 1996: 4890–90
View details for Web of Science ID A1996TX39704883
-
Pattern-color separable pathways predict sensitivity to simple colored patterns
VISION RESEARCH
1996; 36 (4): 515-526
Abstract
We have studied how contrast threshold sensitivity depends jointly on pattern and color. We measured sensitivity to colored Gabor patches from 0.5 to 8 c/deg. At each spatial frequency, we measured in many different color directions. We analyze the sensitivity measurements using a series of nested models. We conclude that a model consisting of three pattern-color separable mechanisms predicts detection performance nearly as well as fitting psychometric functions independently. We derive the pattern and color sensitivities of the separable mechanisms from the experimental data. Two derived mechanisms are spatially lowpass and spectrally color-opponent. The third mechanism is spatially bandpass and spectrally broadband.
View details for Web of Science ID A1996TU02400003
View details for PubMedID 8854997
-
PHOTORECEPTOR SENSITIVITY CHANGES EXPLAIN COLOR APPEARANCE SHIFTS INDUCED BY LARGE UNIFORM BACKGROUNDS IN DICHOPTIC MATCHING
VISION RESEARCH
1995; 35 (2): 239-254
Abstract
Photoreceptor sensitivity changes explained the effect of large uniform backgrounds on the color appearance of small targets in a dichoptic asymmetric color matching experiment. Subjects viewed in each eye a target superimposed on a large background. The backgrounds presented to the two eyes had different spectral compositions. Subjects adjusted the target seen by the right eye to match the appearance of the target seen by the left eye. Receptor sensitivity changes explained the effect of numerous adapting backgrounds on the color appearance of many targets with high precision. Post-receptoral sensitivity changes provided a poorer account of the data. The apparent sensitivity of each receptor class varied inversely with changes in background light absorbed by that receptor class, but did not depend on background light absorbed by the other two receptor classes.
View details for Web of Science ID A1995QA11800005
View details for PubMedID 7839619
-
MATCHING COLOR IMAGES - THE EFFECTS OF AXIAL CHROMATIC ABERRATION
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION
1994; 11 (12): 3113-3122
View details for Web of Science ID A1994PX50900001
-
FMRI OF HUMAN VISUAL-CORTEX
NATURE
1994; 369 (6481): 525-525
View details for Web of Science ID A1994NR29400030
View details for PubMedID 8031403
-
Color appearance in images - Measurements and musings
2nd IS&T/SID Color Imaging Conference on Color Science, Systems and Applications
SOC IMAGING SCIENCE & TECHNOLOGY. 1994: 1–4
View details for Web of Science ID A1994BD85G00001
-
HOW TO TURN YOUR SCANNER INTO A COLORIMETER
10th International Congress on Advances in Non-Impact Printing Technologies
SOC IMAGING SCIENCE & TECHNOLOGY. 1994: 579–581
View details for Web of Science ID A1994BC92P00154
-
APPEARANCE OF COLORED PATTERNS - PATTERN COLOR SEPARABILITY
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION
1993; 10 (12): 2458-2470
Abstract
We have measured how color appearance of square-wave bars varies with stimulus strength and spatial frequency. Observers adjusted the color of a uniform patch to match the color appearance of the bars in square-wave patterns. We used low-to-moderate square-wave patterns, from 1 to 8 cycles per degree (c/deg). The matches are not photoreceptor matches but rather are established at more central neural sites. The signals at the putative central sites obey several simple regularities. The cone contrast of the uniform patch is proportional to square-wave stimulus strength (color homogeneity) and additive with respect to the superposition of equal-frequency square waves containing different colors (color superposition). We use the asymmetric matches to derive, from first principles, three pattern-color-separable appearance pathways. The matches are explained by two spectrally opponent, spatially low-pass mechanisms and one spectrally positive, spatially bandpass mechanism. The spectral mechanisms that we derive are similar to luminance and opponent mechanisms that are derived with entirely different experimental methods.
View details for Web of Science ID A1993MN61100004
View details for PubMedID 8301401
-
COLOR APPEARANCE - THE EFFECTS OF ILLUMINATION AND SPATIAL PATTERN
COLLOQUIUM ON IMAGES OF SCIENCE : SCIENCE OF IMAGES
NATL ACAD SCIENCES. 1993: 9778–84
Abstract
The color we perceive at each point in an image depends on information spread across the three spatial arrays of cone photoreceptors. I describe experiments aimed at clarifying how information is integrated across the spatial arrays to yield a color experience. We have found that changes of color appearance due to changes of the ambient illumination and the pattern's spatial frequency can be described by using a simple set of optical and neural transformations. Each transformation can be thought of as having two parts. First, the transformation converts the color representation into a new coordinate frame that is independent of the image contents. Second, the transformation scales the neural responses in the new coordinate frame by a gain factor that depends on the image contents.
View details for Web of Science ID A1993MF29600009
View details for PubMedID 8234314
-
FUNCTIONAL SEGREGATION OF COLOR AND MOTION PERCEPTION EXAMINED IN MOTION NULLING
VISION RESEARCH
1993; 33 (15): 2113-2125
Abstract
We examine two hypotheses about the functional segregation of color and motion perception, using a motion nulling task. The most common interpretation of functional segregation, that motion perception depends only on one of the three dimensions of color, is rejected. We propose and test an alternative formulation of functional segregation: that motion perception depends on a univariate motion signal driven by all three color dimensions, and that the motion signal is determined by the product of the stimulus contrast and a term that depends only on the relative cone excitations. Two predictions of this model are confirmed. First, motion nulling is transitive: when two stimuli null a third they also null another. Second, motion nulling is homogeneous: if two stimuli null one another, they continue to null one another when their contrasts are scaled equally. We describe how to apply our formulation of functional segregation to other behavioral and physiological measurements.
View details for Web of Science ID A1993LQ40900010
View details for PubMedID 8266653
-
WATER INTO WINE - CONVERTING SCANNER RGB TO TRISTIMULUS XYZ
CONF ON DEVICE-INDEPENDENT COLOR IMAGING AND IMAGING SYSTEMS INTEGRATION
SPIE - INT SOC OPTICAL ENGINEERING. 1993: 92–101
View details for Web of Science ID A1993BY85L00011
-
RETHINKING THE WHITE POINT
IS&T/SID Color Imaging Conference: Transforms and Transportability of Color
SOC IMAGING SCIENCE & TECHNOLOGY. 1993: 65–67
View details for Web of Science ID A1993BA06Q00015
-
LINEAR-MODELS OF SURFACE AND ILLUMINANT SPECTRA
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION
1992; 9 (11): 1905-1913
Abstract
We describe procedures for creating efficient spectral representations for color. The representations generalize conventional tristimulus representations, which are based on the peripheral encoding by the human eye. We use low-dimensional linear models to approximate the spectral properties of surfaces and illuminants with respect to a collection of sensing devices. We choose the linear-model basis functions by minimizing the error in approximating sensor responses for collections of surfaces and illuminants. These linear models offer some conceptual simplifications for applications such as printer calibration; they also perform substantially better than principal-components approximations for computer-graphics applications.
View details for Web of Science ID A1992JU86800004
View details for PubMedID 1432341
-
ASYMMETRIC COLOR MATCHING - HOW COLOR APPEARANCE DEPENDS ON THE ILLUMINANT
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION
1992; 9 (9): 1433-1448
Abstract
We report the results of matching experiments designed to study the color appearance of objects rendered under different simulated illuminants on a CRT monitor. Subjects set asymmetric color matches between a standard object and a test object that were rendered under illuminants with different spectral power distributions. For any illuminant change, we found that the mapping between the cone coordinates of matching standard and test objects was well approximated by a diagonal linear transformation. In this sense, our results are consistent with von Kries's hypothesis [Handb. Physiol. Menschen 3, 109 (1905) [in Sources of Color Vision, D. L. MacAdam, ed. (MIT Press, Cambridge, Mass., 1970)]] that adaptation simply changes the relative sensitivity of the different cone classes. In addition, we examined the dependence of the diagonal transformation on the illuminant change. For the range of illuminants tested, we found that the change in the diagonal elements of the linear transformation was a linear function of the illuminant change.
View details for Web of Science ID A1992JK70100001
View details for PubMedID 1527647
-
SOURCES OF SCANNER CALIBRATION ERRORS
8TH INTERNATIONAL CONGRESS ON ADVANCES IN NON-IMPACT PRINTING TECHNOLOGIES
SOC IMAGING SCIENCE & TECHNOLOGY. 1992: 491–495
View details for Web of Science ID A1992BZ19M00121
-
VISUAL-PERCEPTION - THE NEUROPHYSIOLOGICAL FOUNDATIONS - SPILLMANN,L, WERNER,JS (Book Review)
CONTEMPORARY PSYCHOLOGY
1991; 36 (6): 476-477
View details for Web of Science ID A1991FP58500003
-
CALIBRATED PROCESSING OF IMAGE COLOR
COLOR RESEARCH AND APPLICATION
1990; 15 (5): 266-271
View details for Web of Science ID A1990EF07100003
-
SURFACE CHARACTERIZATIONS OF COLOR THRESHOLDS
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION
1990; 7 (4): 783-789
Abstract
We evaluate how well three different parametric shapes, ellipsoids, rectangles, and parallelograms, serve as models of three-dimensional detection contours. We describe how the procedures for deriving the best-fitting shapes constrain inferences about the theoretical visual detection mechanisms. The ellipsoidal shape, commonly assumed by vector-length theories, is related to a class of visual mechanisms that are unique only up to orthogonal transformations. The rectangle shape is related to a unique set of visual mechanisms, but since the rectangle is not invariant with respect to linear transformations the estimated visual mechanisms are dependent on the stimulus coordinate frame. The parallelogram is related to a unique set of visual mechanisms and can be derived by methods that are independent of the stimulus coordinate frame. We evaluate how well these shapes approximate detection contours, using 2-deg test fields with a long (1-sec) Gaussian time course. Two statistical tests suggest that the parallelogram model is too strong. First, we find that the ellipsoid and rectangle shapes fit the data with the same precision as the variance in repeated threshold measurements. The parallelogram model, which has more free parameters, fits the data with more precision than the variance in repeated threshold measurements. Second, although the parallelogram model provides a slightly better fit of our data than the other two shapes, it does not serve as a better guide than the ellipsoidal model for interpolating from the measurements to thresholds in novel color directions.
View details for Web of Science ID A1990CZ95900027
View details for PubMedID 2338599
-
TASK-DEPENDENT COLOR DISCRIMINATION
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION
1990; 7 (4): 776-782
Abstract
When an observer's ability to discriminate colored objects is estimated from the variability in color matches, the observer inspects adjacent visual fields carefully and makes considered judgments. Color discrimination does not always take place under such viewing conditions. When color video displays are used in time-critical applications (e.g., head-up displays, video control panels), the observer must discriminate among briefly presented targets seen within a complex spatial scene. We compare color-discrimination thresholds by using two tasks. In one task the observer makes color matches between two halves of a continuously displayed bipartite field. In a second task the observer detects a color target in a set of briefly presented objects. The data from both tasks are well summarized by ellipsoidal isosensitivity contours. The fitted ellipsoids differ both in their size, which indicates an absolute sensitivity difference, and orientation, which indicates a relative sensitivity difference.
View details for Web of Science ID A1990CZ95900026
View details for PubMedID 2338598
-
COMPONENT ESTIMATION OF SURFACE SPECTRAL REFLECTANCE
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION
1990; 7 (2): 312-317
View details for Web of Science ID A1990CK60100016
-
THE ELLIPSOIDAL REPRESENTATION OF SPECTRAL SENSITIVITY
VISION RESEARCH
1990; 30 (4): 647-652
Abstract
When plotted in three-dimensional color-space, thresholds of colored lights fall on or near the surface of an ellipsoid. Using data reported in the literature, we estimate the deviation between sets of spectral threshold measurements and the ellipsoid that passes closest to the data. Seventy-three percent of the reported spectral thresholds fall within 0.1 log units of the best-fitting ellipsoid. Our ability to distinguish one ellipsoidal fit as significantly better than another is limited by the choice of sampling directions in color-space. Spectral lights do not provide a good set of sampling directions for reducing the uncertainty about the estimated best-fitting ellipsoid. Complete characterization of visual sensitivity requires measuring thresholds to mixtures of spectral lights.
View details for Web of Science ID A1990CW16300014
View details for PubMedID 2339517
-
THE EFFECT OF THE ILLUMINANT ON COLOR APPEARANCE
CONF ON PERCEIVING, MEASURING, AND USING COLOR
SPIE - INT SOC OPTICAL ENGINEERING. 1990: 119–130
View details for Web of Science ID A1990BR91E00012
-
ESTIMATION OF SURFACE SPECTRAL REFLECTANCE OF INHOMOGENEOUS OBJECTS
SYMP ON SENSING AND RECONSTRUCTION OF THREE-DIMENSIONAL OBJECTS AND SCENES
SPIE - INT SOC OPTICAL ENGINEERING. 1990: 112–121
View details for Web of Science ID A1990BR38T00011
-
STANDARD SURFACE-REFLECTANCE MODEL AND ILLUMINANT ESTIMATION
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION
1989; 6 (4): 576-584
View details for Web of Science ID A1989T912500012
-
BLACK LIGHT - HOW SENSORS FILTER SPECTRAL VARIATION OF THE ILLUMINANT
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING
1989; 36 (1): 140-149
Abstract
Visual sensor responses may be used to classify objects on the basis of their surface reflectance functions. In a color image, the image data are represented as a vector of sensor responses at each point in the image. This vector depends both on the surface reflectance function and on the spectral power distribution of the ambient illumination. Algorithms designed to classify objects on the basis of their surface reflectance functions typically attempt to overcome the dependence of the sensor responses on the illuminant by integrating sensor data collected from multiple surfaces. In machine vision applications, we show that it is often possible to design the sensor spectral responsivities so that the vector direction of the sensor responses does not depend upon the illuminant. We state the conditions under which this is possible and perform an illustrative calculation. In biological systems, where the sensor responsivities are fixed, we show that some changes in the illumination cause no change in the sensor responses. We call such changes in illuminant black illuminants. It is possible to express any illuminant as the sum of two unique components. One component is a black illuminant. We call the second component the visible component. The visible component of an illuminant completely characterizes the effect of the illuminant on the vector of sensor responses.
View details for Web of Science ID A1989R649100015
View details for PubMedID 2921060
-
COLOR CONSTANCY AND THE NATURAL IMAGE
PHYSICA SCRIPTA
1989; 39 (1): 187-192
View details for Web of Science ID A1989T123000031
-
DISCRETE ANALYSIS OF SPATIAL-SENSITIVITY MODELS
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION
1988; 5 (5): 743-755
Abstract
The visual representation of spatial patterns begins with a series of linear transformations: the stimulus is blurred by the optics, spatially sampled by the photoreceptor array, spatially pooled by the ganglion-cell receptive fields, and so forth. Models of human spatial-pattern vision commonly summarize the initial transformations by a single linear transformation that maps the stimulus into an array of sensor responses. Some components of the initial linear transformations (e.g., lens blurring, photoreceptor sampling) have been estimated empirically; others have not. A computable model must include some assumptions concerning the unknown components of the initial linear encoding. Even a modest sketch of the initial visual encoding requires the specification of a large number of sensors, making the calculations required for performance predictions quite large. We describe procedures for reducing the computational burden of current models of spatial vision that ensure that the simplifications are consistent with the predictions of the complete model. We also describe a method for using pattern-sensitivity measurements to estimate the initial linear transformation. The method is based on the assumption that detection performance is monotonic with the vector length of the sensor responses. We show how contrast-threshold data can be used to estimate the linear transformation needed to characterize threshold performance.
View details for Web of Science ID A1988N333000014
View details for PubMedID 3404315
-
THE SYNTHESIS AND ANALYSIS OF COLOR IMAGES
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE
1987; 9 (1): 2-13
Abstract
I describe a method for performing the synthesis and analysis of digital color images. The method is based on two principles. First, image data are represented with respect to the separate physical factors, surface reflectance and the spectral power distribution of the ambient light, that give rise to the perceived color of an object. Second, the encoding is made efficient by using a basis expansion for the surface spectral reflectance and spectral power distribution of the ambient light that takes advantage of the high degree of correlation across the visible wavelengths normally found in such functions. Within this framework, the same basic methods can be used to synthesize image data for color display monitors and printed materials, and to analyze image data into estimates of the spectral power distribution and surface spectral reflectances. The method can be applied to a variety of tasks. Examples of applications include the color balancing of color images and the identification of material surface spectral reflectance when the lighting cannot be completely controlled.
View details for Web of Science ID A1987F378500001
View details for PubMedID 21869373
-
ANALYSIS OF THE RETINEX THEORY OF COLOR-VISION
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION
1986; 3 (10): 1651-1661
Abstract
If color appearance is to be a useful feature in identifying an object, then color appearance must remain roughly constant when the object is viewed in different contexts. People maintain approximate color constancy despite variation in the color of nearby objects and despite variation in the spectral power distribution of the ambient light. Land's retinex algorithm is a model of human color constancy. We analyze the retinex algorithm and discuss its general properties. We show that the algorithm is too sensitive to changes in the color of nearby objects to serve as an adequate model of human color constancy.
View details for Web of Science ID A1986E227800010
View details for PubMedID 3772627
-
COLOR CONSTANCY - A METHOD FOR RECOVERING SURFACE SPECTRAL REFLECTANCE
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION
1986; 3 (1): 29-33
Abstract
Human and machine visual sensing is enhanced when surface properties of objects in scenes, including color, can be reliably estimated despite changes in the ambient lighting conditions. We describe a computational method for estimating surface spectral reflectance when the spectral power distribution of the ambient light is not known.
View details for Web of Science ID A1986AYJ7500006
View details for PubMedID 3950789
-
COLOR RENDERING OF COLOR CAMERA DATA
COLOR RESEARCH AND APPLICATION
1986; 11: S30-S33
View details for Web of Science ID A1986C922700008
-
COLOR MEASUREMENT AND DISCRIMINATION
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION
1985; 2 (1): 62-71
Abstract
Theories of color-difference measurement provide a quantitative means for predicting whether two lights will be discriminable to an average observer. Consider the following color-measurement hypothesis. Suppose that two lights evoke responses from the color channels that we write as vectors, U and U'. The vector difference dU = U - U' is itself a set of channel responses that will result from the presentation of some light. I test the hypothesis that U and U' will be discriminable only if the light that gives rise to their differential, dU, is detectable. In the absence of a luminance component in the difference stimulus, dU, the vector-difference hypothesis holds well. In the presence of a luminance component, the theory is clearly false. When a luminance component is present, discrimination judgements depend largely on whether the lights U and U' are in separate, categorical regions of color space.
View details for Web of Science ID A1985TY04700010
View details for PubMedID 3968600
-
REACTION-TIMES TO WEAK TEST LIGHTS
VISION RESEARCH
1984; 24 (7): 647-652
Abstract
Maloney and Wandell [Vision Res. 24, 633-640 (1984)] describe a model of the response of a single visual channel to weak test lights. The initial channel response is a linearly filtered version of the stimulus. The filter output is randomly sampled over time. Each time a sample occurs there is some probability--increasing with the magnitude of the sampled response--that a discrete detection event is generated. Maloney and Wandell derive the statistics of the detection events. In this paper we test the hypothesis that the reaction time responses to the presence of a weak test light are initiated at the first detection event. This permits us to extend the application of the model to lights that are slightly above threshold, but still within the linear operating range of the visual system. We test a parameter-free prediction of the model proposed by maloney and Wandell for lights detected by this statistic. The data are in agreement with the prediction.
View details for Web of Science ID A1984TB32300003
View details for PubMedID 6464358
-
VISUAL SENSING BY HUMANS AND COMPUTERS
BEHAVIOR RESEARCH METHODS INSTRUMENTS & COMPUTERS
1984; 16 (2): 88-95
View details for Web of Science ID A1984TK77000003
-
A MODEL OF A SINGLE VISUAL CHANNELS RESPONSE TO WEAK TEST LIGHTS
VISION RESEARCH
1984; 24 (7): 633-640
Abstract
We describe a model of the response of a single visual channel to weak test lights. We assume that the initial channel response may be approximated as a linear filter whose output is sampled at random times. At each sample time there is some probability (increasing with the size of the filter response) that a detection event is generated. The detection events form the basis of the observer's detection and duration discrimination judgments. We derive the statistics of the detection events and empirical tests of the model. Assuming the probability of a detection event to be negligible in the absence of a signal, we derive an exact prediction of the form of the psychometric function for detection. Second, assuming that duration discrimination of weak test lights is based solely on the temporal separation of detection events, we predict the exact form of detection/discrimination performance. Third, assuming that the observer's response is initiated by the first detection event, we derive the form of the cumulative reaction time distribution.
View details for Web of Science ID A1984TB32300001
View details for PubMedID 6464356
-
DURATION DISCRIMINATION BETWEEN WEAK TEST LIGHTS
VISION RESEARCH
1984; 24 (7): 641-645
Abstract
Maloney and Wandell [Vision Res. 24, 633-640 (1984)] describe a model of the response of a single visual channel to weak test signals. In the model an initial continuous visual response is randomly sampled, and each sample gives rise--with a probability that increases with the magnitude of the sample--to a discrete detection event. The authors derive a parameter-free prediction for the upper bound on the discriminability of two lights of different durations. In this paper we describe an experimental test of that prediction. We find that the model accurately distinguishes between discrimination performance under conditions where both test lights are detected by a single channel and conditions where the test lights are detected by different channels.
View details for Web of Science ID A1984TB32300002
View details for PubMedID 6464357
-
DETECTION DISCRIMINATION IN THE LONG-WAVELENGTH PATHWAYS
VISION RESEARCH
1982; 22 (8): 1061-1069
View details for Web of Science ID A1982PB04700022
View details for PubMedID 7135844
-
MEASUREMENT OF SMALL COLOR DIFFERENCES
PSYCHOLOGICAL REVIEW
1982; 89 (3): 281-302
View details for Web of Science ID A1982NN36900004
View details for PubMedID 7100367
-
ADAPTATION IN THE LONG-WAVELENGTH PATHWAYS
VISION RESEARCH
1982; 22 (8): 1071-1074
Abstract
We describe and test predictions of a model of long-wavelength test sensitivity upon large, uniform backgrounds. The model explains changes in sensitivity in the red-green detection pathways strictly based upon losses of sensitivity in the receptors. We derive the prediction that field mixture data for field-mixtures of mu1 (fixed) and an addend, mu 2, must follow the same shape on different intensities of the fixed background, mu 1. This prediction is not in good agreement with the measurements.
View details for Web of Science ID A1982PB04700023
View details for PubMedID 7135845
-
DETECTION OF LONG-DURATION, LONG-WAVELENGTH INCREMENTAL FLASHES BY A CHROMATICALLY CODED PATHWAY
VISION RESEARCH
1980; 20 (7): 625-636
View details for Web of Science ID A1980KE29100005
View details for PubMedID 7434597
-
A FIELD-ADDITIVE PATHWAY DETECTS BRIEF-DURATION, LONG-WAVELENGTH INCREMENTAL FLASHES
VISION RESEARCH
1980; 20 (7): 613-624
View details for Web of Science ID A1980KE29100004
View details for PubMedID 7434596
-
HUMAN CONE SATURATION AS A FUNCTION OF AMBIENT INTENSITY - TEST OF MODELS OF SHIFTS IN DYNAMIC RANGE
VISION RESEARCH
1978; 18 (8): 983-993
View details for Web of Science ID A1978FQ34600011
View details for PubMedID 706174
-
POOLING PERIPHERAL INFORMATION - AVERAGES VERSUS EXTREME VALUES
JOURNAL OF MATHEMATICAL PSYCHOLOGY
1978; 17 (3): 220-235
View details for Web of Science ID A1978FK72400002
-
SPEED-ACCURACY TRADEOFF IN VISUAL DETECTION - APPLICATIONS OF NEURAL COUNTING AND TIMING
VISION RESEARCH
1977; 17 (2): 217-225
View details for Web of Science ID A1977CZ40800008
View details for PubMedID 867842
-
ANALYSIS OF NERVE SIGNALS DEDUCED FROM METACONTRAST EXPERIMENTS WITH HUMAN OBSERVERS
JOURNAL OF PHYSIOLOGY-LONDON
1976; 263 (3): 321-329
Abstract
1. This paper reviews Alpern, Rushton & Torii's (1970a-d) derivation of the size of the inhibitory nerve signal arising from after flashes in the metacontrast experiment. 2. Their geometric argument is recast in terms of simple functional equations. This form of argument clearly displays the role of their assumptions in obtaining their main conclusion: nerve signal is linear in intensity over a range of 3-4 log units. 3. Two disadvantages of their approach are discussed. First, it is noted that in the presence of the data the assumption they employ in their analysis is logically equivalent to their conclusion. 4. Secondly, accepting their claim that the nerve signal generated by the after flash is linear over a broad range of intensities, and that this inhibitory signal simply cancels the excitatory signal of the test flash, leads to the conslusion that over this same intensity range the excitatory nerve signal is a power function with an exponent of close to two. This is incompatible with the suggestion that photoreceptor signals have been measured.
View details for Web of Science ID A1976CV32700001
View details for PubMedID 1018271
-
COLOR PROPERTIES OF CONTRAST FLASH EFFECT - MONOPTIC VS DICHOPTIC COMPARISONS
VISION RESEARCH
1976; 16 (11): 1275-1280
View details for Web of Science ID A1976CE16900011
View details for PubMedID 1006999
-
EQUIVALENCE CLASSES OF FUNCTIONS OF FINITE MARKOV CHAINS
JOURNAL OF MATHEMATICAL PSYCHOLOGY
1974; 11 (4): 391-403
View details for Web of Science ID A1974U967500003