Decoding reveals the contents of visual working memory in early visual areas

Harrison SA, Tong F.
Nature. 2009 Apr 2;458(7238):632-5.
http://www.nature.com/nature/journal/v458/n7238/full/nature07832.html

Visual working memory provides an essential link between perception and higher cognitive functions, allowing for the active maintenance of information about stimuli no longer in view. Research suggests that sustained activity in higher-order prefrontal, parietal, inferotemporal and lateral occipital areas supports visual maintenance, and may account for the limited capacity of working memory to hold up to 3-4 items. Because higher-order areas lack the visual selectivity of early sensory areas, it has remained unclear how observers can remember specific visual features, such as the precise orientation of a grating, with minimal decay in performance over delays of many seconds. One proposal is that sensory areas serve to maintain fine-tuned feature information, but early visual areas show little to no sustained activity over prolonged delays. Here we show that orientations held in working memory can be decoded from activity patterns in the human visual cortex, even when overall levels of activity are low. Using functional magnetic resonance imaging and pattern classification methods, we found that activity patterns in visual areas V1-V4 could predict which of two oriented gratings was held in memory with mean accuracy levels upwards of 80%, even in participants whose activity fell to baseline levels after a prolonged delay. These orientation-selective activity patterns were sustained throughout the delay period, evident in individual visual areas, and similar to the responses evoked by unattended, task-irrelevant gratings. Our results demonstrate that early visual areas can retain specific information about visual features held in working memory, over periods of many seconds when no physical stimulus is present.

PMID: 19225460

Comparing face patch systems in macaques and humans.

Tsao DY, Moeller S, Freiwald WA.
Proc Natl Acad Sci U S A. 2008 Dec 9;105(49):19514-9
http://www.pnas.org/content/105/49/19514.long

Face recognition is of central importance for primate social behavior. In both humans and macaques, the visual analysis of faces is supported by a set of specialized face areas. The precise organization of these areas and the correspondence between individual macaque and human face-selective areas are debated. Here, we examined the organization of face-selective regions across the temporal lobe in a large number of macaque and human subjects. Macaques showed 6 regions of face-selective cortex arranged in a stereotypical pattern along the temporal lobe. Human subjects showed, in addition to 3 reported face areas (the occipital, fusiform, and superior temporal sulcus face areas), a face-selective area located anterior to the fusiform face area, in the anterior collateral sulcus. These results suggest a closer anatomical correspondence between macaque and human face-processing systems than previously realized.

PMID: 19033466

Linearly additive shape and color signals in monkey inferotemporal cortex

McMahon DB, Olson CR.
J Neurophysiol. 2009 Apr;101(4):1867-75.
http://jn.physiology.org/cgi/content/full/101/4/1867

How does the brain represent a red circle? One possibility is that there is a specialized and possibly time-consuming process whereby the attributes of shape and color, carried by separate populations of neurons in low-order visual cortex, are bound together into a unitary neural representation. Another possibility is that neurons in high-order visual cortex are selective, by virtue of their bottom-up input from low-order visual areas, for particular conjunctions of shape and color. A third possibility is that they simply sum shape and color signals linearly. We tested these ideas by measuring the responses of inferotemporal cortex neurons to sets of stimuli in which two attributes-shape and color-varied independently. We find that a few neurons exhibit conjunction selectivity but that in most neurons the influences of shape and color sum linearly. Contrary to the idea of conjunction coding, few neurons respond selectively to a particular combination of shape and color. Contrary to the idea that binding requires time, conjunction signals, when present, occur as early as feature signals. We argue that neither conjunction selectivity nor a specialized feature binding process is necessary for the effective representation of shape-color combinations.

PMID: 19144745

Visually driven activation in macaque areas V2 and V3 without input from the primary visual cortex.

Schmid MC, Panagiotaropoulos T, Augath MA, Logothetis NK, Smirnakis SM.
PLoS One. 2009;4(5):e5527. Epub 2009 May 13.Click here to read
http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0005527

Creating focal lesions in primary visual cortex (V1) provides an opportunity to study the role of extra-geniculo-striate pathways for activating extrastriate visual cortex. Previous studies have shown that more than 95% of neurons in macaque area V2 and V3 stop firing after reversibly cooling V1. However, no studies on long term recovery in areas V2, V3 following permanent V1 lesions have been reported in the macaque. Here we use macaque fMRI to study area V2, V3 activity patterns from 1 to 22 months after lesioning area V1. We find that visually driven BOLD responses persist inside the V1-lesion projection zones (LPZ) of areas V2 and V3, but are reduced in strength by approximately 70%, on average, compared to pre-lesion levels. Monitoring the LPZ activity over time starting one month following the V1 lesion did not reveal systematic changes in BOLD signal amplitude. Surprisingly, the retinotopic organization inside the LPZ of areas V2, V3 remained similar to that of the non-lesioned hemisphere, suggesting that LPZ activation in V2, V3 is not the result of input arising from nearby (non-lesioned) V1 cortex. Electrophysiology recordings of multi-unit activity corroborated the BOLD observations: visually driven multi-unit responses could be elicited inside the V2 LPZ, even when the visual stimulus was entirely contained within the scotoma induced by the V1 lesion. Restricting the stimulus to the intact visual hemi-field produced no significant BOLD modulation inside the V2, V3 LPZs. We conclude that the observed activity patterns are largely mediated by parallel, V1-bypassing, subcortical pathways that can activate areas V2 and V3 in the absence of V1 input. Such pathways may contribute to the behavioral phenomenon of blindsight.

PMID: 19436733

What response properties do individual neurons need to underlie position and clutter "invariant" object recognition?

Li N, Cox DD, Zoccolan D, Dicarlo JJ.
J Neurophysiol. 2009 Jul;102(1):360-76.
http://jn.physiology.org/cgi/content/full/102/1/360

Primates can easily identify visual objects over large changes in retinal position-a property commonly referred to as position "invariance." This ability is widely assumed to depend on neurons in inferior temporal cortex (IT) that can respond selectively to isolated visual objects over similarly large ranges of retinal position. However, in the real world, objects rarely appear in isolation, and the interplay between position invariance and the representation of multiple objects (i.e., clutter) remains unresolved. At the heart of this issue is the intuition that the representations of nearby objects can interfere with one another and that the large receptive fields needed for position invariance can exacerbate this problem by increasing the range over which interference acts. Indeed, most IT neurons' responses are strongly affected by the presence of clutter. While external mechanisms (such as attention) are often invoked as a way out of the problem, we show (using recorded neuronal data and simulations) that the intrinsic properties of IT population responses, by themselves, can support object recognition in the face of limited clutter. Furthermore, we carried out extensive simulations of hypothetical neuronal populations to identify the essential individual-neuron ingredients of a good population representation. These simulations show that the crucial neuronal property to support recognition in clutter is not preservation of response magnitude, but preservation of each neuron's rank-order object preference under identity-preserving image transformations (e.g., clutter). Because IT neuronal responses often exhibit that response property, while neurons in earlier visual areas (e.g., V1) do not, we suggest that preserving the rank-order object preference regardless of clutter, rather than the response magnitude, more precisely describes the goal of individual neurons at the top of the ventral visual stream.

PMID: 19439676

Cortical Connections to Area TE in Monkey: Hybrid Modular and Distributed Organization

Borra E, Ichinohe N, Sato T, Tanifuji M, Rockland KS.
Cereb Cortex. 2009 May 23
http://cercor.oxfordjournals.org/cgi/content/full/bhp096v2

To investigate the fine anatomical organization of cortical inputs to visual association area TE, 2-3 small injections of retrograde tracers were made in macaque monkeys. Injections were made as a terminal procedure, after optical imaging and electrophysiological recording, and targeted to patches physiologically identified as object-selective. Retrogradely labeled neurons occurred in several unimodal visual areas, the superior temporal sulcus, intraparietal sulcus (IPS), and prefrontal cortex (PFC), consistent with previous studies. Despite the small injection size (<0.5 mm wide), the projection foci in visual areas, but not in IPS or PFC, were spatially widespread (4-6 mm in extent), and predominantly consisted of neurons labeled by only one of the injections. This can be seen as a quasi-modular organization. In addition, within each projection focus, there were scattered neurons projecting to one of the other injections, together with some double-labeled (DL) neurons, in a more distributed pattern. Finally, projection foci included smaller "hotspots," consisting of intermixed neurons, single-labeled by the different injections, and DL neurons. DL neurons are likely the result of axons having extended, spatially separated terminal arbors, as demonstrated by anterograde experiments. These results suggest a complex, hybrid connectivity architecture, with both modular and distributed components.

PMID: 19443621

Beyond Poisson: increased spike-time regularity across primate parietal cortex

Maimon G, Assad JA.
Neuron. 2009 May 14;62(3):426-40
http://www.cell.com/neuron/retrieve/pii/S0896627309002463

Cortical areas differ in their patterns of connectivity, cellular composition, and functional architecture. Spike trains, on the other hand, are commonly assumed to follow similarly irregular dynamics across neocortex. We examined spike-time statistics in four parietal areas using a method that accounts for nonstationarities in firing rate. We found that, whereas neurons in visual areas fire irregularly, many cells in association and motor-like parietal regions show increasingly regular spike trains by comparison. Regularity was evident both in the shape of interspike interval distributions and in spike-count variability across trials. Thus, Poisson-like randomness is not a universal feature of neocortex. Rather, many parietal cells have reduced trial-to-trial variability in spike counts that could provide for more reliable firing-rate signals. These results suggest that spiking dynamics may play different roles in different cortical areas and should not be assumed to arise from fundamentally irreducible noise sources.

PMID: 19447097

Can monkeys choose optimally when faced with noisy stimuli and unequal rewards?

Samuel Feng, Philip Holmes, Alan Rorie, William T. Newsome
PLoS Computational Biology 5(2):e1000284doi:10.1371/journal.pcbi.1000284
http://www.ploscompbiol.org/article/info:doi/10.1371/journal.pcbi.1000284

We review the leaky competing accumulator model for two-alternative forced-choice decisions with cued responses, and propose extensions to account for the influence of unequal rewards. Assuming that stimulus information is integrated until the cue to respond arrives and that firing rates of stimulus-selective neurons remain well within physiological bounds, the model reduces to an Ornstein-Uhlenbeck (OU) process that yields explicit expressions for the psychometric function that describes accuracy. From these we compute strategies that optimize the rewards expected over blocks of trials administered with mixed difficulty and reward contingencies. The psychometric function is characterized by two parameters: its midpoint slope, which quantifies a subject’s ability to extract signal from noise, and its shift, which measures the bias applied to account for unequal rewards. We fit these to data from two monkeys performing the moving dots task with mixed coherences and reward schedules. We find that their behaviors averaged over multiple sessions are close to optimal, with shifts erring in the direction of smaller penalties. We propose two methods for biasing the OU process to produce such shifts.

Estimates of the contribution of single neurons to perception depend on timescale and noise correlation

Cohen MR, Newsome WT.
J Neurosci. 2009 May 20;29(20):6635-48
http://www.jneurosci.org/cgi/content/full/29/20/6635

The sensitivity of a population of neurons, and therefore the amount of sensory information available to an animal, is limited by the sensitivity of single neurons in the population and by noise correlation between neurons. For decades, therefore, neurophysiologists have devised increasingly clever and rigorous ways to measure these critical variables (Parker and Newsome, 1998). Previous studies examining the relationship between the responses of single middle temporal (MT) neurons and direction-discrimination performance uncovered an apparent paradox. Sensitivity measurements from single neurons suggested that small numbers of neurons may account for a monkey's psychophysical performance (Britten et al., 1992), but trial-to-trial variability in activity of single MT neurons are only weakly correlated with the monkey's behavior, suggesting that the monkey's decision must be based on the responses of many neurons (Britten et al., 1996). We suggest that the resolution to this paradox lies (1) in the long stimulus duration used in the original studies, which led to an overestimate of neural sensitivity relative to psychophysical sensitivity, and (2) mistaken assumptions (because no data were available) about the level of noise correlation in MT columns with opposite preferred directions. We therefore made new physiological and psychophysical measurements in a reaction time version of the direction-discrimination task that matches neural measurements to the actual decision time of the animals. These new data, considered together with our recent data on noise correlation in MT (Cohen and Newsome, 2008), provide a substantially improved account of psychometric performance in the direction-discrimination task.

PMID: 19458234

Chronic electrical stimulation of the contralesional lateral cerebellar nucleus enhances recovery of motor function after cerebral ischemia in rats

Machado AG, Baker KB, Schuster D, Butler RS, Rezai A.
Brain Res. 2009 Jul 14;1280:107-16.
Science Direct

Novel neurorehabilitative strategies are needed to improve motor outcomes following stroke. Based on the disynaptic excitatory projections of the dentatothalamocortical pathway to the motor cortex as well as to anterior and posterior cortical areas, we hypothesize that chronic electrical stimulation of the contralesional dentate (lateral cerebellar) nucleus output can enhance motor recovery after ischemia via augmentation of perilesional cortical excitability. Seventy-five Wistar rats were pre-trained in the Montoya staircase task and subsequently underwent left cerebral ischemia with the 3-vessel occlusion model. All survivors underwent stereotactic right lateral cerebellar nucleus (LCN) implantation of bipolar electrodes. Rats were then randomized to 4 groups: LCN stimulation at 10 pps, 20 pps, 50 pps or sham stimulation, which was delivered for a period of 6 weeks. Performance on the Montoya staircase task was re-assessed over the last 4 weeks of the stimulation period. On the right (contralesional) side, motor performance of the groups undergoing sham, 10 pps, 20 pps and 50 pps stimulation was, respectively, 2.5+/-2.7; 2.1+/-2.5; 6.0+/-3.9 (p<0.01) and 4.5+/-3.5 pellets. There was no difference on the left (ipsilesional) side motor performance among the sham or stimulation groups, varying from 15.9+/-6.7 to 17.2+/-2.1 pellets. We conclude that contralesional chronic electrical stimulation of the lateral cerebellar nucleus at 20 pps but not at 10 or 50 pps improves motor recovery in rats following ischemic strokes. This effect is likely to be mediated by increased perilesional cortical excitability via chronic activation of the dentatothalamocortical pathway.

PMID: 19445910