Skip to main content

Main menu

  • HOME
  • CONTENT
    • Early Release
    • Featured
    • Current Issue
    • Issue Archive
    • Collections
    • Podcast
  • ALERTS
  • FOR AUTHORS
    • Information for Authors
    • Fees
    • Journal Clubs
    • eLetters
    • Submit
  • EDITORIAL BOARD
  • ABOUT
    • Overview
    • Advertise
    • For the Media
    • Rights and Permissions
    • Privacy Policy
    • Feedback
  • SUBSCRIBE

User menu

  • Log out
  • Log in
  • My Cart

Search

  • Advanced search
Journal of Neuroscience
  • Log out
  • Log in
  • My Cart
Journal of Neuroscience

Advanced Search

Submit a Manuscript
  • HOME
  • CONTENT
    • Early Release
    • Featured
    • Current Issue
    • Issue Archive
    • Collections
    • Podcast
  • ALERTS
  • FOR AUTHORS
    • Information for Authors
    • Fees
    • Journal Clubs
    • eLetters
    • Submit
  • EDITORIAL BOARD
  • ABOUT
    • Overview
    • Advertise
    • For the Media
    • Rights and Permissions
    • Privacy Policy
    • Feedback
  • SUBSCRIBE
PreviousNext
Viewpoints

An Annotated Journey through Modern Visual Neuroscience

Stuart Trenholm and Arjun Krishnaswamy
Journal of Neuroscience 2 January 2020, 40 (1) 44-53; DOI: https://doi.org/10.1523/JNEUROSCI.1061-19.2019
Stuart Trenholm
1Montreal Neurological Institute, McGill University, Montreal, Quebec H3A 2B4, Canada, and
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Arjun Krishnaswamy
2Department of Physiology, McGill University, Montreal, Quebec H3G 0B1 Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • Info & Metrics
  • eLetters
  • PDF
Loading

Abstract

Recent advances in microscopy, genetics, physiology, and data processing have expanded the scope and accelerated the pace of discovery in visual neuroscience. However, the pace of discovery and the ever increasing number of published articles can present a serious issue for both trainees and senior scientists alike: with each passing year the fog of progress thickens, making it easy to lose sight of important earlier advances. As part of this special issue of the Journal of Neuroscience commemorating the 50th anniversary of SfN, here, we provide a variation on Stephen Kuffler's Oldies but Goodies classic reading list, with the hope that by looking back at highlights in the field of visual neuroscience we can better define remaining gaps in our knowledge and thus guide future work. We also hope that this article can serve as a resource that will aid those new to the field to find their bearings.

Introduction

“From a series of well-chosen articles one gains more than perspective: one sees vividly how advances come about…Decisive experiments not only create new knowledge but they also significantly advance a field by creating new and higher standards of acceptable evidence. This in turn forces workers into clearer thinking and experimenting…One measure of the success of the studies…is that they enable us to define more precisely areas of ignorance, and this should help the search for new experimental solutions.”

  • Stephen Kuffler, Oldies but Goodies

As researchers, which problems should we study? In the total absence of knowledge, asking nearly any question can lead to fruitful answers. However, in an age of information saturation it becomes increasingly difficult to gain enough knowledge on a given topic to be able to step back and identify key questions that remain unresolved. Around 200 years ago, Thomas Young—the polymath often described as “the last man who knew everything”—could likely remember every fact and experiment related to a subject and apply this knowledge to formulate new theories and tests. Attempting such a feat today is much more daunting. Nonetheless, by carefully taking note of transformative work in a given field we can more clearly identify remaining unknowns. Here we endeavor toward such a goal by compiling a community consensus list of 25 of the most important articles in the field of visual neuroscience, with a focus on the neurons and circuits underlying visual perception (Fig. 1; see Materials and Methods). Below, the 25 articles are grouped into thematic sections. For each section, we indicate the specific article(s) from the top 25 list being described, provide historical context, highlight the discoveries, consider the impact on the field, and outline remaining questions.

Figure 1.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 1.

The early mammalian visual system, from retina to cortex. For brevity, in the legend we only point out features of the figure most relevant to the current article. A drawing by Ramon y Cajal from a rodent, showing retinal circuitry (A), retinal projections (B) to lateral geniculate nucleus (D) and superior colliculus (E). Thalamic neurons then project (K) to visual cortex (G), which in turn projects to higher cortical areas (N). From Cajal, circa 1902. Courtesy of the Cajal Institute, Cajal Legacy, Spanish National Research Council (CSIC), Madrid, Spain.

Figure 1-1

The preface and table of contents from Stephen Kuffler’s Oldies but Goodies classic reading list. Download Figure 1-1, PDF file

Visual threshold and single-photon responses

  • Hecht et al. (1942) Energy, quanta and vision

  • Baylor et al. (1979) Responses of retinal rods to single photons

In the mid-1870s, Franz Boll identified a substance in the frog retina that bleached when exposed to light—he termed it “visual purple.” What he had discovered was rhodopsin (reviewed in Hubbard, 1976). By the middle of the 20th century, it was well established that rods underlie night vision and cones underlie daytime vision, but how each cell was able to convert photons into electrochemical signals was unclear. Selig Hecht and colleagues addressed the question of photoreceptor sensitivity in a clever and groundbreaking study (Hecht et al., 1942). They directed flashes of light of varying luminance into the eye of a subject who was sitting in complete darkness and measured detection performance. By carefully accounting for the stimulus intensity, and reflective and absorptive losses, they made an incredible discovery: a visual stimulus can be detected when it is comprised of as few as five photons. Remarkably, since their visual stimulus encompassed an area of ∼500 rods, it was nearly impossible for any single rod to have absorbed more than one photon. However, what did the amplitude and kinetics of the photon-evoked signal look like, and how likely was it for a single photon response to occur? The answers would have to wait until the development of patch-clamp technology, which Denis Baylor and colleagues applied to record rod photocurrents (Baylor et al., 1979). By recording from rod outer segments in toad retina using suction electrodes while flashing a very dim spot of light, they measured responses exhibiting binary amplitudes, which they defined as successes and failures, with the successes representing the single photon responses predicted by Hecht et al., 1942. The effort to identify the molecular machinery underlying this exquisite light sensitivity would be undertaken by many laboratories, including those of George Wald and Lubert Stryer (Wald, 1968; Stryer, 1987; Dowling, 1997). More recently, it has become clear that dysfunction of the phototransduction machinery underlies many retinal dystrophies (Ferrari et al., 2011). Correcting these mutations with gene therapy and genome-editing tools offers an exciting avenue to interrupt or reverse many blinding disorders (Hohman, 2017; Russell et al., 2017).

Center-surround receptive fields

  • Kuffler (1953) Discharge patterns and functional organization of mammalian retina

  • Barlow (1953) Summation and inhibition in the frog's retina

Adrian and Matthews (1927) recorded the first light responses from the optic nerve in the mid-1920s, and Hartline (1938) went on to describe receptive fields, as well as ON, OFF, and ON-OFF responses. Hartline (1938) found that many ganglion cells had receptive fields large enough to overlap with those of their closely spaced neighbors, an arrangement that could blur the image that is focused onto the retina. New techniques permitted both Stephen Kuffler and Horace Barlow to address this issue with significantly higher precision than in earlier studies. Kuffler and S.A. Talbot developed an ophthalmoscope that focused spots of light of various sizes onto different portions of the retinal surface in anesthetized cats (Talbot and Kuffler, 1952). Kuffler discovered that retinal ganglion cells had a central region that excited the neuron and a surrounding region that antagonized the center (Kuffler, 1953). Similar experiments were performed by Barlow (working in Adrian's laboratory), who built a custom stimulator that enabled independent control of the light intensity of a spot and its background. He found that background illumination antagonized center responses (Barlow, 1953). Both studies showed that center and surround had similar stimulus selectivity: ON-center cells could be inhibited by a large bright spot; the opposite was true of OFF-center neurons. As such, a high-contrast edge that encompasses the receptive field center of a ganglion cell also encompasses the surround of its neighbors, thereby sharpening the population response to incoming images. These findings would inspire and inform many of the articles included in our list, and center-surround receptive fields remain a textbook example of how the retina encodes visual scenes.

Linear and nonlinear responses

  • Enroth-Cugell and Robson (1966) The contrast sensitivity of retinal ganglion cells of the cat

By the mid-1960s, the response of a ganglion cell to a spot of light placed at an arbitrary position over the retina could be predicted with reasonable accuracy. Robert Rodieck had modeled receptive fields as the sum of two Gaussian curves: a positive, narrow, large-amplitude curve for the center, and a negative, wide, low-amplitude curve for the surround (Rodieck, 1965; Rodieck and Stone, 1965). A spot of light placed at a given location over the receptive field thus generated a response based on the sum of these two curves. Could the same model predict responses when different visual stimuli simultaneously activated different portions of the receptive field? Working with television sets at RCA, Otto Schade generated sinusoids of varying spatial frequency and contrast, and proceeded to use these stimuli to test human visual perception (Schade, 1956). Could his psychophysical results be explained by retinal ganglion cell receptive field structures? Enroth-Cugell and Robson decided to test whether ganglion cell responses to Schade's stimuli could be predicted by Rodieck's receptive field model (Enroth-Cugell and Robson, 1966). For instance, would a sinusoid that half-darkens and half-illuminates a ganglion cell receptive field result in no response? Surprisingly, Enroth-Cugell and Robson found that only a subset of ganglion cells (termed X cells) followed this prediction. In contrast, many neurons (termed Y cells) behaved unexpectedly: when adapted to a constant gray background and then stimulated with a sinusoidal grating that went from black to white over the receptive field, Y cells responded vigorously to both the appearance and disappearance of the stimulus. Next, they examined responses when sinusoids of varying spatial frequencies and contrasts were passed over receptive fields of X and Y cells. Enroth-Cugell and Robson concluded that Y cells do not respond to the linear sum of luminance signals across their receptive field. Instead, these neurons sum nonlinearly from receptive field subunits—for intance, so that an ON input to a portion of the receptive field and and OFF input to another portion of the receptive field do not simply cancel each other out. Future work would show that these different cell types appear to form separate but parallel visual streams in the brain (Shapley and Hochstein, 1975; Sherman et al., 1976), though how such X- and Y-cell definitions relate to the increasing number of functionally defined retinal ganglion cell types (Baden et al., 2016) remains unclear. Meanwhile, the field has moved increasingly into studying responses generated by naturalistic scenes (Felsen and Dan, 2005). While there is debate over the ability of such stimuli to reveal coding principles (Rust and Movshon, 2005), there is increasing interest in developing algorithms that endow machines with the impressive abilities our visual system possesses for interpreting natural scenes (Cox and Dean, 2014; Hassabis et al., 2017).

Feature detectors

  • Lettvin et al. (1959) What the frog's eye tells the frog's brain

  • Ölveczky et al. (2003) Segregation of object and background motion in the retina

To Jerome Lettvin, the predictions of the center-surround model felt incomplete (Lettvin, 1999): the properties of a visual stimulus included not only its luminance and size, but also features such as its shape, curvature, contrast, and motion. Could retinal ganglion cells encode such additional features? Lettvin and colleagues hypothesized that one reason such diverse ganglion cell responses had not been observed might relate to biased sampling—they noted that most recordings came from large ganglion cells bearing myelinated axons, whereas unmyelinated ones were more numerous and harder to target (Lettvin et al., 1959, 1960; Lettvin, 1999). They thus developed methods to record from these unmyelinated fibers while presenting frogs with images of spots, flies, geometric objects, and looming figures. Their hunch would turn out correct—they identified at least five different kinds of ganglion cell responses, each tuned to a specific aspect of the visual scene (Lettvin et al., 1959). Interestingly, while their article would be highly cited, this line of inquiry (retinal feature detectors) would soon fade from mainstream research for several decades. Slowly, increasing anatomical evidence would begin to reveal the staggering diversity of retinal cell types (Masland, 2001, 2012), which was at odds with the view of the retina as a system that predominantly adjusts the brightness and sharpness of incoming images through linear and nonlinear center-surround filters. The search for function in this growing forest of cell types reawakened research into feature detectors. One captivating example, from Ölveczky and colleagues, describes a ganglion cell that displays the remarkable ability to distinguish object from background motion (Ölveczky et al., 2003). They presented the retina with two gratings superimposed on one another: the object grating was a small circular patch; the background grating filled the remainder of the stimulus area. By moving object and background gratings with varying degrees of coherence, they discovered ganglion cells that respond selectively to object motion that differs from background motion. The intervening time since this study has seen the catalog of retinal ganglion cell types expand to ∼45, each bearing a unique trigger feature, molecular identity, morphology, and, often, central projection. How the brain uses these lower-level retinal features is still not well understood.

Orientation selectivity

  • Hubel and Wiesel (1959) Receptive fields of single neurons in the cat's striate cortex

  • Hubel and Wiesel (1962) Receptive fields, binocular interaction and functional architecture in the cat's visual cortex

Visual cortex was localized in the 19th century, based on clinical and experimental lesion studies (Gross, 1998; Finger, 2001). By the middle of the 20th century, it remained unclear how the cortex processed visual stimuli at the level of single neurons. The story of visual feature detectors in the cortex begins in September 1959, when David Hubel (Hubel, 1959) published the first example of a putative direction-selective neuron in visual cortex (in a non-head-fixed cat, with the cell responding to the back and forth movement of his arm, no less!). However, it would be two subsequent studies with Torsten Wiesel in head-fixed anesthetized cats that would change the course of visual neuroscience research (Hubel and Wiesel, 1959, 1962). Here they showed the presence of orientation- and direction-selective responses in primary visual cortex, described simple and complex cells, characterized orientation columns, and proposed a model for orientation selectivity. These “line detectors” provided early clues about the brain's strategy for encoding the visual world. Poetically, there is even a legendary anecdote about their seminal discovery: “Suddenly, just as we inserted one of our glass slides into the ophthalmoscope, the cell seemed to come to life and began to fire impulses like a machine gun. It took a while to discover that the firing had nothing to do with the small opaque spot – the cell was responding to the fine moving shadow cast by the edge of the glass slide” (Hubel and Wiesel, 2005). Follow-up work would reveal that orientation columns are arranged in pinwheel patterns, turning Hubel and Wiesel's original finding into modern art (Blasdel and Salama, 1986; Bonhoeffer and Grinvald, 1991). Furthermore, their model for orientation selectivity in V1—that a cortical neuron receives inputs from several center-surround lateral geniculate nucleus (LGN) neurons whose receptive fields are offset along a particular axis—would be validated as at least one of the ways that cortex generates orientation selectivity (Chapman et al., 1991; Reid and Alonso, 1995; Ferster et al., 1996). In the coming years, research will need to reconcile the view of V1 as primarily a collection of orientation filters, with recent findings indicating that V1 can also encode a variety of other features, such as learning (Khan et al., 2018), subjective spatial position (Saleem et al., 2018), locomotion (Niell and Stryker, 2010), reward timing (Shuler and Bear, 2006), and prediction (Keller et al., 2012; Gavornik and Bear, 2014) - though it should be noted that to date most of these additional findings have only been described in rodents and have yet to be replicated in primate models.

Direction selectivity in the retina

  • Barlow and Levick (1965) The mechanisms of directionally selective units in the rabbit's retina

Following close on the heels of Hubel and Wiesel's work in cortex, directionally selective responses were soon described anew in retinal ganglion cells of both rabbit (Barlow and Hill, 1963; Barlow et al., 1964) and pigeon (Maturana and Frenk, 1963). A subsequent article from Barlow and Levick featured refined experiments, analyses, and modeling (Barlow and Levick, 1965). It described with impressive clarity that direction selectivity (DS) is computed over small subunits of the receptive field, and outlined how DS mechanisms could be fooled into signaling motion via presentation of temporally offset paired static stimuli. They proposed that direction selectivity arose due to inhibition during null direction, but not preferred direction, motion. It would take many years of research to validate this model and identify the circuitry underlying this computation: the identification of cholinergic cells in the retina (Masland and Mills, 1979); the characterization of cholinergic cells as starburst amacrine cells (Famiglietti, 1983); the finding that starburst amacrine cells intrinsically generate directional signals (Euler et al., 2002); and the discovery that starburst amacrine cells asymmetrically connect to DS ganglion cells and provide null direction inhibition (Fried et al., 2002; Briggman et al., 2011). DS ganglion cells then would be split into different flavors (Oyster and Barlow, 1967; Kim et al., 2008). While ON DS cells control visual field stabilization reflexes (Oyster et al., 1972), a role for ON-OFF DS cells in behavior remains unclear. Further, while most work in this field has been performed in rabbit or mouse, to what extent DS ganglion cells are present in nonhuman primate or human retina is unclear.

Diverse retinal cell types, organization, and responses

  • Werblin and Dowling (1969) Organization of retina of the mudpuppy, Necturus maculosus. II. Intracellular recordings

  • Slaughter and Miller (1981) 2-Amino-4-phophonobutyric acid: a new pharmacological tool for retina research

  • Wässle et al. (1981) Dendritic territories of cat retinal ganglion cells

  • Berson et al. (2002) Phototransduction by retinal ganglion cells that set the circadian clock

Following a lecture by John Dowling at Johns Hopkins University in the 1960s, a graduate student who had trained as an electrical engineer came to Dowling's office to ask about building a theoretical model of the retina. Dowling told the student, Frank Werblin, that too little was known about electrical responses of retinal neurons to generate such a model (Dowling, 2018). Instead, they would go on to systematically characterize the light responses of all five major retinal neuron classes (photoreceptors, horizontal cells, bipolar cells, amacrine cells, ganglion cells), find evidence for center-surround responses in bipolar cells, outline a diversity of amacrine cell responses, and provide the first evidence that ON and OFF signals were generated in bipolar cells (Werblin and Dowling, 1969). How parallel ON and OFF visual channels arise would remain a mystery until the discovery of a pharmacological agonist (known as L-AP4 or APB) of the ON retinal system (Slaughter and Miller, 1981). These discoveries would enable several additional advances: the discovery that mGluR6 glutamate receptors mediate ON bipolar cell responses (Masu et al., 1995); the deconstruction of complex ganglion cell responses into various combinations of ON versus OFF inputs (Roska and Werblin, 2001); and the search to understand why parallel ON and OFF visual channels exist (Schiller et al., 1986). Increased knowledge of the “vertical” signaling pathway in the retina (photoreceptor→bipolar cell→ganglion cell) revealed our ignorance about how these vertical elements repeat laterally across the retina to cover the entire visual field. Advances in dye filling and tissue imaging revealed a striking repetition of circuit motifs across the retina—for a given ganglion cell type, this involves a tiling interaction between their dendritic arbors and regular spacing of their somata into a mosaic (Wässle et al., 1981). Finally, as the diversity, connectivity, and parallel processing capabilities of the retina were coming into focus, new findings threw a wrench into our understanding of how light responses were generated. This story begins in the 1920s, when Clyde Keeler characterized the maintenance of light-evoked pupillary reflexes in otherwise blind mice (Keeler, 1927), but it would take several decades until retrograde tracing experiments from the suprachiasmatic nucleus identified the third retinal photoreceptor: intrinsically photosensitive retinal ganglion cells (Berson et al., 2002), which express melanopsin (Hattar et al., 2002). While these cells are important for many reflexive and “subconscious” forms of vision, signals from these ganglion cells also appear to make their way to visual cortex (Dacey et al., 2005). More recently, advances in electrophysiology, functional imaging, and genetics have allowed researchers to begin closing in on obtaining a detailed characterization of the light responses of every single retinal cell type to a diverse set of visual stimuli (Baden et al., 2016), potentially putting a comprehensive theoretical model of retinal function within grasp.

The link between eye and brain

  • Reid and Alonso (1995) Specific monosynaptic connections from thalamus to visual cortex

While some early studies suggested that the LGN's role was primarily to simply relay retinal signals to visual cortex (Hubel and Wiesel, 1962), subsequent work has shown that it is far more than a simple relay. (Sherman and Koch, 1986; Sherman and Guillery, 1996, 2014; Sherman, 2006). First, individual LGN relay cells receive convergent inputs from several retinal ganglion cells (Cleland et al., 1971; Chen and Regehr, 2000). Second, relay cells can switch between tonic and bursting modes (Steriade and Llinás, 1988; Guido and Weyand, 1995) and are highly sensitive to the precise timing of their retinal inputs, making them ideally suited to filter the visual information sent to cortex (Usrey et al., 1998). Third, relay cells do not simply receive inputs from the retina and send outputs to V1, but also receive an enormous amount of feedback from diverse areas (Erişir et al., 1997). Fourth, axons from multiple relay cells can converge onto individual postsynaptic neurons in V1 with spectacular specificity, generating novel feature-selective responses in the postsynaptic target. An exquisite example of this last property comes from Reid and Alonso (1995). Making heroic paired recordings in thalamus and cortex, and using the relative spike timing between pairs of neurons in these two areas to identify putatively monosynaptically connected pairs, they were able to show that the elongated, orientation-selective receptive fields of V1 neurons can arise from the convergence of specifically aligned thalamic neurons with center-surround receptive fields, thus providing experimental validation to the model of Hubel and Wiesel (1962). More recent work has shown that similar precision in the convergence of specific thalamic inputs onto individual V1 neurons appears to underlie some forms of direction selectivity found in mouse visual cortex (Lien and Scanziani, 2018). Still, it remains unclear whether novel visual feature detectors arise de novo in the LGN itself as a result of convergent inputs from different retinal cells types. Furthermore, little is known about the way the LGN uses its massive feedback to filter visual signals being sent to cortex, though some studies suggest that the effect of such filtering may be powerful (Wimmer et al., 2015).

Wiring the visual system

  • Wiesel and Hubel (1963) Single-cell responses in striate cortex of kittens deprived of vision in one eye

  • Meister et al. (1991) Synchronous bursts of action potentials in ganglion cells of the developing mammalian retina

Early anecdotal evidence related to vision restoration following long-term vision loss suggested that neuronal activity might play an important role in visual system development (Hebb, 1949). Indeed, subsequent monocular deprivation studies in developing animals supported this idea (Riesen et al., 1953). The cellular basis for this phenomenon remained a mystery, but would be clarified by a study into the effect of early monocular deprivation on V1 responses by Wiesel and Hubel (1963). Here, they showed that monocular deprivation following birth caused cortical neurons to become unresponsive to inputs from the deprived eye. This deficit did not occur when deprivation was performed later in life, indicative of an early critical period for visual development, which later studies would leverage to develop clinical interventions for children with strabismus (Hensch and Quinlan, 2018). Next, interesting work in frogs, in which a third eye was ectopically implanted during development, revealed that the ectopic eye exhibited a segratated projection area, thus showing the robustness of eye-specific segregation in the brain (Constantine-Paton and Law, 1978). Later, studies that silenced retinal activity with tetrodotoxin before eye opening and resulted in altered eye-specific segregation of retino-thalamic projections suggested that spontaneous activity before eye opening was also important for visual circuit development (Shatz and Stryker, 1988; Sretavan et al., 1988). Correlated activity was soon described between pairs of newborn retinal ganglion cells (Maffei and Galli-Resta, 1990), but how such seemingly random patterns of activity could affect the arrangement of eye-specific axonal projection patterns in LGN and V1 seen upon eye opening was unclear. It would take a new way of recording from neurons, a multielectrode array, to reveal the beauty of the signal of the developing retina. Working out of Stanford University, Markus Meister and colleagues would discover wave-like patterns of activity propagating across the developing retina (Meister et al., 1991). This finding provided a potential way for the brain to identify axons from adjacent ganglion cells from the same eye using correlated firing patterns (i.e., spatial location would be mapped via a temporal sequence of action potentials; McLaughlin et al., 2003; Ackman et al., 2012). Subsequent studies would complicate this story, showing that ocular dominance columns are present earlier than had previously been appreciated, and can form to some extent despite early binocular enucleation (Crowley and Katz, 1999, 2000). Thus, it appears that nature and nurture interact in complex ways to refine visual system development. Still many of the molecular factors that help to establish this early wiring remain at large.

Coding in the visual system

  • Barlow (1961) Possible principles underlying the transformations of sensory messages

  • Barlow (1972) Single units and sensation: a neuron doctrine for perceptual psychology?

  • Olshausen and Field (1996) Emergence of simple-cell receptive field properties by learning a sparse code for natural images

How does the brain generate sight? For the visual system, these types of questions were being asked with increasing frequency by the early 1960s due to a growing consensus that the retinal message encodes behaviorally relevant “trigger” features (Kuffler, 1953; Barlow, 1953; Lettvin et al., 1959). However, in the real world, visual inputs constantly bombard the whole retinal surface with time-varying combinations of both trigger and nontrigger features, resulting in a retinal output that presents a difficult problem for the brain to interpret. How does the brain sort out these diverse and numerous retinal signals in terms of behavioral importance? In 1961, Horace Barlow, borrowing ideas from information theory, provided an early and influential framework addressing this idea (Barlow, 1961; see also Attneave, 1954). Barlow envisioned the visual system as an accountant, apportioning as few spikes across as few fibers (optic nerve fibers, for example) as possible to encode a stimulus. From this premise, he elaborated a scenario in which the most common firing pattern of a pair of input neurons, A and B, should silence a pair of output neurons, X and Y, whereas the least common input firing pattern should drive both output cells. Thus, the firing pattern of X and Y is a rank ordering of the rarity of a stimulus, theoretically simplifying the brain's search through incoming stimuli to find the most relevant (i.e., least redundant) for behavior. Such transformations, which he termed passwords, would predict that the visual system should have evolved filters for extracting informative statistics from the natural world. This would influence theories on efficient coding and stimulate studies of natural statistics of visual scenes and how these are coded by the visual system (Atick and Redlich, 1992). Next, incorporating insights from single-unit recordings from inferior temporal (IT) cortex (Gross et al., 1969), in his 1972 article, Barlow (1972) built upon his earlier efficient coding tome to frame the brain as a hierarchical reducer of information, in which sparseness increases at each level in the hierarchy, until we arrive at “grandmother cells,” (hypothetical neurons at the top of the hierarchy that represent specific concepts or objects) a term he took from Lettvin (Gross, 2002). Following up on these ideas, Olshausen and Field (1996) were able to develop a learning algorithm that, when trained on natural images, evolved filters that bore a striking resemblance to the orientation-selective V1 receptive fields first described by Hubel and Wiesel. Importantly, Olshausen and Field discovered that sparseness was central to the ability of their filters to decorrelate features of natural images, thus providing higher visual areas with a more efficient (and less redundant) signal. Though influential, work over the last decades merging modeling and neural recordings from different areas of the visual system have highlighted some of the limitations of efficient coding and redundancy reduction as theories that fully explain the neuronal code (Barlow, 2001; Rust and DiCarlo, 2012). Additionally, with the snowballing ability to record from larger and larger numbers of neurons, the field has been able to focus increasingly on population coding, which adds another layer of complexity to deciphering the neuronal code (Keemink and Machens, 2019). How such population codes relate to the increasingly narrow definitions that are arising for distinct cell types and cell type-specific circuits is unclear. Finally, how any neuronal code is read out by downstream “decoders” and converted into perception remains to be elucidated.

Two ways to see

  • Ungerleider and Mishkin (1982) Two cortical visual systems

In the 1950s and 1960s, different visual deficits began to be regularly described for patients with temporal versus parietal cortex lesions (Newcombe and Russell, 1969): temporal lesions often resulted in impaired visual recognition; parietal lesions tended to produce visual spatial impairments. This led to theories of dichotomous visual pathways for processing stimulus location and identity (Schneider, 1967, 1969; Trevarthen, 1968), which were then experimentally validated in a nonhuman primate lesion study (Pohl, 1973). However, it remained unclear how different visual information was relayed to temporal versus dorsal cortex (for instance, Schneider postulated that spatial visual information was processed via the retinal–tectal pathway). To address this issue, Ungerleider and Mishkin (1982) incorporated recent findings with their own tracing and lesion experiments. Importantly, they fully identified all extrastriate (or “prestriate”) cortical areas, carefully lesioned them, and looked for deficits. They found that V1 projected to a much larger extrastriate area than had previously been appreciated, and fully lesioning it resulted in deficits in spatial visual perception. This allowed them to formalize the theory that two different cortical visual streams leave V1: a dorsal pathway primarily concerned with recognition and a ventral pathway primarily concerned with spatial location (these would become known as the “what” and “where” pathways). This theory has been modified by others who suggest that these two pathways may be better defined as being important for perception (ventral) versus action (dorsal; Goodale and Milner, 1992). The segregation of these two streams has been complicated since its first description, with the discovery of lateral connectivity between the two pathways (Felleman and Van Essen, 1991) and the presence of ventral-like information in dorsal areas, and vice versa (Sereno and Maunsell, 1998; Freud et al., 2016). This theory nonetheless remains as a cornerstone of how we understand the visual system, though much remains to be clarified regarding how these two pathways interact, and how feedback circuits modify these feedforward pathways.

Face cells

  • Kanwisher et al. (1997) The fusiform face area: a module in human extrastriate cortex specialized for face perception

Faces are among the earliest, most intimate and important stimuli encountered by the human visual system. How does the visual system build a detector that cannot only find a familiar face in a crowd, but find many familiar faces in a crowd? The search for face cells arose in part out of interest in Levick's grandmother cells (Barlow, 1972; Gross, 2002) and Konorski's “gnostic cells” (Konorski, 1967; Gross, 2005) - both variations on the idea that there might be high-order visual neurons that encode specific visual objects. Charles Gross, who once worked down the hall from Levick and had visited Konorski's laboratory, was trying to understand what stimuli activate IT cortex. Gross et al. (1969) would first show the existence of visual “hand cells,” providing a compelling update to the hierarchical buildup of complex feature detectors first posited by Hubel and Wiesel. In a follow-up article, Gross et al. (1972) would make the first mention of possible “face cells,” though it would take several more years until they provided more thorough evidence (Bruce et al., 1981; Desimone et al., 1984). Building on this work in nonhuman primates, face selectivity was subsequently shown in human cortex (Haxby et al., 1991; Ojemann et al., 1992). A major milestone came when Nancy Kanwisher and colleagues applied functional magnetic resonance imaging (fMRI) to interrogate neuronal responses to faces in a more systematic manner (Kanwisher et al., 1997). By comparing responses to faces and scrambled faces, they ruled out luminance selectivity; by comparing hands and faces, they established a specificity for faces rather than a general selectivity for body parts; by using hands, faces, and objects in a matching task, they forced attentional recruitment and showed that only faces evoked responses in a small area of IT, termed the fusiform face area. This work opened the door for more precise single-unit recordings, which used fMRI to predefine regions to subsequently study at single-cell resolution (Tsao et al., 2006). More recently, remarkable artificial intelligence-assisted image evolution experiments have corroborated that face cells indeed like to see faces (Ponce et al., 2019). Such progress raises new questions—for instance, how does the brain learn to recognize a face (note that face domains are not present in animals raised without seeing faces; Arcaro et al., 2017), and how is the brain able to distinguish familiar from unfamiliar faces?

From brain to perception

  • Newsome et al. (1989) Neuronal correlates of a perceptual decision

  • Salzman et al. (1990) Cortical microstimulation influences perceptual judgements of motion direction

The increasingly complex nature of feature detectors being described throughout the visual system raised the issue of how and when these signals merge with “internal” needs and wants to direct behavior. A breakthrough came when Newsome and colleagues made single-unit recordings during a visual perception task (Newsome et al., 1989). They focused their recordings on direction-selective neurons in area MT, which possess receptive fields that cover wide swaths of the visual field (Dubner and Zeki, 1971; Zeki, 1974; Maunsell and Van Essen, 1983). Importantly, lesion studies had shown area MT to be crucial for the perception of moving visual stimuli (Newsome and Paré, 1988). Newsome and colleagues related neuronal activity to the behavioral performance of macaques, who were asked to judge the collective motion of a cloud of dots that drifted either to the left or right, with varying degrees of coherence. The results from these experiments suggested that individual neurons judge motion direction just as well—or even better—than the animal does, and predicted that perceptual judgment of motion direction might only require a handful of cells (Britten et al., 1992). In a follow-up study, Salzman et al. (1990) would show that local electrical stimulation of physiologically characterized MT neurons within a single “direction column” is enough to influence the perception of motion in the direction associated with the stimulated column. Work over the next decades that measured the responses of individual MT neurons more specifically on the timescale of perceptual decisions, and took noise correlations into account, found that animals tend to perform significantly better than individual MT neurons (Cook and Maunsell, 2002; Cohen and Newsome, 2009). Recent technical developments that enable one to read–write neuronal activity in vivo, at single-cell resolution (Packer et al., 2015; Carrillo-Reid et al., 2019; Marshel et al., 2019), provide an opportunity to further define the link between neuronal activity and perception. What remains is to determine, on single trials, exactly how many cells and of which type and in which brain region are responsible for specific forms of perception, and to what extent such computations are distributed across different levels of the visual hierarchy.

The whole visual system

  • Felleman and Van Essen (1991) Distributed hierarchical processing in the primate cerebral cortex

Positing distinct roles for different parts of the brain has a long history. Some Greek and Roman thinkers proposed different roles for cerebrum and cerebellum based on differences in how soft they were to touch; in the middle ages, a popular idea ascribed unique brain functions to the ventricles (Gross, 1998; Finger, 2001). Our modern understanding of the localization of function stems from work in human patients exhibiting specific neurological problems (Broca, 1861) and from precise electrical stimulation and lesion studies in both animal models and humans (Penfield and Rasmussen, 1950; Fritsch and Hitzig, 2009). This led to encyclopedic subdivisions of cortex: Ferrier (1886) defined over a dozen distinct functional parts of cortex; Brodmann (1909) divided cerebral cortex into over 50 areas. What Felleman and Van Essen (1991) provided was far more than a simple update to cortical subdivisions, although they did that too. Instead, they provided a hierarchical connectivity map that showed all the known paths taken by information as it passes from eye to brain. This was back-breaking work—they performed a meta-analysis of all previous work on primate visual cortical connectivity, anatomy, and physiology, building upon their earlier work (Van Essen and Maunsell, 1983) as well as work from others (Allman and Kaas, 1976; Zeki, 1978). To generate a functional hierarchy of connected visual areas, they leveraged recently uncovered long-range cortical connectivity principles that had started to coalesce: feedforward projections tend to project to layer 4, whereas feedback projections tend to avoid layer 4 (Rockland and Pandya, 1979). Their opus outlines 32 visual cortical areas organized across nine hierarchical layers, with each layer being highly interconnected. They attempted to generalize their conclusions from vision to other senses and to other species, and set the tone for more recent efforts, such as the Allen Brain Mouse Connectivity Atlas (Oh et al., 2014). However, as we learn more about the diversity of cell types and connectivity profiles even within a single region of the visual system (Zeng et al., 2012; Jiang et al., 2015; Tasic et al., 2016, 2018; Gouwens et al., 2019), we will need to reassess and significantly update our whole-brain functional connectivity atlases and contemplate how this affects our understanding of hierarchies of visual processing.

Conclusion

David Hubel famously described his habit of “reading as little as possible in…neurophysiology,” instead relying on colleagues to keep him informed of important findings (Hubel and Wiesel, 2005). We hope that the 25 articles highlighted above, and the references embedded therein, can serve a similar role as Hubel's helpful colleagues. It is inevitable, though, in putting together a classic reading list that many foundational studies will be left out. We regret that the list did not include work related to many topics, including but not restricted to, functional connectivity (Gilbert and Wiesel, 1989), color processing (Livingstone and Hubel, 1984), binocular or stereo vision (Barlow et al., 1967), attention (Cohen and Maunsell, 2009), eye movements (Wurtz and Goldberg, 1972; Schiller and Stryker, 1972), predictive coding (Rao and Ballard, 1999), circuit development (Rakic, 1974), molecular cues underlying development (Nakamoto et al., 1996), single-cell sequencing (Peng et al., 2019), and recent advances in computational modeling (Yamins et al., 2014). However, regarding working in a field that already possessed a “staggering mass of literature,” in the 1920s Selig Hecht wrote that it was “with much trepidation” that he would write any scientific article about the visual system at all, going so far as to say that his hope was “not to add to the existing material, but rather to subtract from it” (Hecht, 1924). In writing this review, we have tried to embody this spirit.

Materials and Methods

We began this process by contacting, via e-mail, roughly 50 leading visual neuroscientists from around the world. We asked each to provide a top 25 list (though we indicated that this number was flexible) of their favorite articles in the field of visual neuroscience, or which they felt were most influential. Our only, albeit loose, constraint was that we sought to tell the story of “conscious” visual perception, but gave contributors flexibility to detour as they saw fit. In choosing scientists to contact, we tried to select established researchers who focus on various regions of the visual system, who use different model systems, and who use different experimental approaches. In total, we received lists from 23 neuroscientists and used their lists as “votes,” from which we compiled a community consensus list of the top 25 articles. It is important to note that while we tried to limit our bias on the outcome of the final list (eg. we contacted a diverse set of visual neuroscience researchers and did not vote ourselves), there is likely a small bias towards our specific subfields of research, as researchers whom we personally know were more likely to provide lists when contacted. We regret that several important topics in visual neuroscience do not feature in this list, and we have tried to correct this by briefly outlining some of these important topics in the concluding paragraph of the text.

We thought it would be informative to provide a brief meta-analysis of the lists that we received from our contributors. From 23 contributors, over 250 unique articles were selected, spanning in time from 1924 to 2019. Approximately 200 articles were selected by only a single contributor, indicating the diversity of contributor opinions. Within each section of this article, whenever possible we attempted to refer to articles that were selected by our contributors but that did not make the top 25 list. The most highly voted article was Hubel and Wiesel (1962), with 10 votes. A total of 25 articles received three votes each or more, and these are what we used to make the final list. Six of these finalists also appear in Kuffler's Oldies but Goodies collection. The preface and table of contents of Stephen Kuffler's Oldies but Goodies classic reading list are included as Extended Data Fig. 1-1.

Footnotes

  • This research was supported by funding from both the Canada Research Chairs program and the Alfred P. Sloan Foundation to S.T. and A.K. We thank all of the following contributors who provided us with lists: Alessandra Angelucci, Gautam Awatramani, Vijay Balasubramanian, Marlene Berhmann, David Berson, Tobias Bonhoeffer, Richard Born, John Dowling, Marla Feller, William Guido, Nancy Kanwisher, John Maunsell, Markus Meister, Anthony Movshon, Fred Rieke, Massimo Scanziani, Joshua Sanes, Michael Shadlen, Carla Shatz, Murray Sherman, Joshua Trachtenberg, Doris Tsao, and Leslie Ungerleider. We also thank Arjun Bharioke, Richard Born, Erik Cook, John Dowling, Markus Meister, Christopher Pack, Edward Ruthazer, and Leslie Ungerleider for discussions and comments on the manuscript. We thank Keila Garcia for providing a translation of the legend in Figure 1.

  • The authors declare no competing financial interests.

  • Correspondence should be addressed to Stuart Trenholm at stuart.trenholm{at}mcgill.ca or Arjun Krishnaswamy at arjun.krishnaswamy{at}mcgill.ca

References

  1. ↵
    1. Ackman JB,
    2. Burbridge TJ,
    3. Crair MC
    (2012) Retinal waves coordinate patterned activity throughout the developing visual system. Nature 490:219–225. doi:10.1038/nature11529 pmid:23060192
    OpenUrlCrossRefPubMed
  2. ↵
    1. Adrian ED,
    2. Matthews R
    (1927) The action of light on the eye. J Physiol 63:378–414. doi:10.1113/jphysiol.1927.sp002410 pmid:16993896
    OpenUrlCrossRefPubMed
  3. ↵
    1. Allman JM,
    2. Kaas JH
    (1976) Representation of the visual field on the medical wall of occipital-parietal cortex in the owl monkey. Science 191:572–575. doi:10.1126/science.814619 pmid:814619
    OpenUrlAbstract/FREE Full Text
  4. ↵
    1. Arcaro MJ,
    2. Schade PF,
    3. Vincent JL,
    4. Ponce CR,
    5. Livingstone MS
    (2017) Seeing faces is necessary for face-domain formation. Nat Neurosci 20:1404–1412. doi:10.1038/nn.4635 pmid:28869581
    OpenUrlCrossRefPubMed
  5. ↵
    1. Atick JJ,
    2. Redlich AN
    (1992) What does the retina know about natural scenes? Neural Comput 4:196–210. doi:10.1162/neco.1992.4.2.196
    OpenUrlCrossRef
  6. ↵
    1. Attneave F
    (1954) Some informational aspects of visual perception. Psychol Rev 61:183–193. doi:10.1037/h0054663 pmid:13167245
    OpenUrlCrossRefPubMed
  7. ↵
    1. Baden T,
    2. Berens P,
    3. Franke K,
    4. Román Rosón M,
    5. Bethge M,
    6. Euler T
    (2016) The functional diversity of retinal ganglion cells in the mouse. Nature 529:345–350. doi:10.1038/nature16468 pmid:26735013
    OpenUrlCrossRefPubMed
  8. ↵
    1. Barlow H
    (2001) Redundancy reduction revisited. Network 12:241–253. doi:10.1080/net.12.3.241.253 pmid:11563528
    OpenUrlCrossRefPubMed
  9. ↵
    1. Barlow HB
    (1953) Summation and inhibition in the frog's retina. J Physiol 119:69–88. doi:10.1113/jphysiol.1953.sp004829 pmid:13035718
    OpenUrlCrossRefPubMed
  10. ↵
    1. Barlow HB
    (1961) Possible principles underlying the transformation of sensory messages. In: Sensory communication (Rosenblith WA, ed), pp 217–234. MIT Press: Cambridge, MA.
  11. ↵
    1. Barlow HB
    (1972) Single units and sensation: a neuron doctrine for perceptual psychology? Perception 1:371–394. doi:10.1068/p010371 pmid:4377168
    OpenUrlCrossRefPubMed
  12. ↵
    1. Barlow HB,
    2. Hill RM
    (1963) Selective sensitivity to direction of movement in ganglion cells of the rabbit retina. Science 139:412–414. doi:10.1126/science.139.3553.412 pmid:13966712
    OpenUrlAbstract/FREE Full Text
  13. ↵
    1. Barlow HB,
    2. Levick WR
    (1965) The mechanism of directionally selective units in rabbit's retina. J Physiol 178:477–504. doi:10.1113/jphysiol.1965.sp007638 pmid:5827909
    OpenUrlCrossRefPubMed
  14. ↵
    1. Barlow HB,
    2. Hill RM,
    3. Levick WR
    (1964) Retinal ganglion cells responding selectively to direction and speed of image motion in the rabbit. J Physiol 173:377–407. doi:10.1113/jphysiol.1964.sp007463 pmid:14220259
    OpenUrlCrossRefPubMed
  15. ↵
    1. Barlow HB,
    2. Blakemore C,
    3. Pettigrew JD
    (1967) The neural mechanism of binocular depth discrimination. J Physiol 193:327–342. doi:10.1113/jphysiol.1967.sp008360 pmid:6065881
    OpenUrlCrossRefPubMed
  16. ↵
    1. Baylor DA,
    2. Lamb TD,
    3. Yau KW
    (1979) Responses of retinal rods to single photons. J Physiol 288:613–634. pmid:112242
    OpenUrlCrossRefPubMed
  17. ↵
    1. Berson DM,
    2. Dunn FA,
    3. Takao M
    (2002) Phototransduction by retinal ganglion cells that set the circadian clock. Science 295:1070–1073. doi:10.1126/science.1067262 pmid:11834835
    OpenUrlAbstract/FREE Full Text
  18. ↵
    1. Blasdel GG,
    2. Salama G
    (1986) Voltage-sensitive dyes reveal a modular organization in monkey striate cortex. Nature 321:579–585. doi:10.1038/321579a0 pmid:3713842
    OpenUrlCrossRefPubMed
  19. ↵
    1. Bonhoeffer T,
    2. Grinvald A
    (1991) Iso-orientation domains in cat visual cortex are arranged in pinwheel-like patterns. Nature 353:429–431. doi:10.1038/353429a0 pmid:1896085
    OpenUrlCrossRefPubMed
  20. ↵
    1. Briggman KL,
    2. Helmstaedter M,
    3. Denk W
    (2011) Wiring specificity in the direction-selectivity circuit of the retina. Nature 471:183–188. doi:10.1038/nature09818 pmid:21390125
    OpenUrlCrossRefPubMed
  21. ↵
    1. Britten KH,
    2. Shadlen MN,
    3. Newsome WT,
    4. Movshon JA
    (1992) The analysis of visual motion: a comparison of neuronal and psychophysical performance. J Neurosci 12:4745–4765. doi:10.1523/JNEUROSCI.12-12-04745.1992 pmid:1464765
    OpenUrlAbstract/FREE Full Text
  22. ↵
    1. Broca MP
    (1861) Remarques sur le siége de la faculté du langage articulé, suivies d'une observation d'aphémie (perte de la parole). Bulletins de la Société d'anatomie (Paris), 2e serie 6:330–357.
    OpenUrl
  23. ↵
    1. Brodmann K
    (1909) Vergleichende Lokalisationslehre der Grosshirnrinde in ihren Prinzipien dargestellt auf Grund des Zellenbaues. Leipzig: Barth.
  24. ↵
    1. Bruce C,
    2. Desimone R,
    3. Gross CG
    (1981) Visual properties of neurons in a polysensory area in superior temporal sulcus of the macaque. J Neurophysiol 46:369–384. doi:10.1152/jn.1981.46.2.369 pmid:6267219
    OpenUrlCrossRefPubMed
  25. ↵
    1. Carrillo-Reid L,
    2. Han S,
    3. Yang W,
    4. Akrouh A,
    5. Yuste R
    (2019) Controlling visually guided behavior by holographic recalling of cortical ensembles. Cell 178:447–457.e5. doi:10.1016/j.cell.2019.05.045 pmid:31257030
    OpenUrlCrossRefPubMed
  26. ↵
    1. Chapman B,
    2. Zahs KR,
    3. Stryker MP
    (1991) Relation of cortical cell orientation selectivity to alignment of receptive fields of the geniculocortical afferents that arborize within a single orientation column in ferret visual cortex. J Neurosci 11:1347–1358. doi:10.1523/JNEUROSCI.11-05-01347.1991 pmid:2027051
    OpenUrlAbstract/FREE Full Text
  27. ↵
    1. Chen C,
    2. Regehr WG
    (2000) Developmental remodeling of the retinogeniculate synapse. Neuron 28:955–966. doi:10.1016/S0896-6273(00)00166-5 pmid:11163279
    OpenUrlCrossRefPubMed
  28. ↵
    1. Cleland BG,
    2. Dubin MW,
    3. Levick WR
    (1971) Simultaneous recording of input and output of lateral geniculate neurones. Nat New Biol 231:191–192. doi:10.1038/newbio231191a0 pmid:4325715
    OpenUrlCrossRefPubMed
  29. ↵
    1. Cohen MR,
    2. Maunsell JH
    (2009) Attention improves performance primarily by reducing interneuronal correlations. Nat Neurosci 12:1594–1600. doi:10.1038/nn.2439 pmid:19915566
    OpenUrlCrossRefPubMed
  30. ↵
    1. Cohen MR,
    2. Newsome WT
    (2009) Estimates of the contribution of single neurons to perception depend on timescale and noise correlation. J Neurosci 29:6635–6648. doi:10.1523/JNEUROSCI.5179-08.2009 pmid:19458234
    OpenUrlAbstract/FREE Full Text
  31. ↵
    1. Constantine-Paton M,
    2. Law MI
    (1978) Eye-specific termination bands in tecta of three-eyed frogs. Science 202:639–641. doi:10.1126/science.309179 pmid:309179
    OpenUrlAbstract/FREE Full Text
  32. ↵
    1. Cook EP,
    2. Maunsell JH
    (2002) Dynamics of neuronal responses in macaque MT and VIP during motion detection. Nat Neurosci 5:985–994. doi:10.1038/nn924 pmid:12244324
    OpenUrlCrossRefPubMed
  33. ↵
    1. Cox DD,
    2. Dean T
    (2014) Neural networks and neuroscience-inspired computer vision. Curr Biol 24:R921–R929. doi:10.1016/j.cub.2014.08.026 pmid:25247371
    OpenUrlCrossRefPubMed
  34. ↵
    1. Crowley JC,
    2. Katz LC
    (1999) Development of ocular dominance columns in the absence of retinal input. Nat Neurosci 2:1125–1130. doi:10.1038/16051 pmid:10570491
    OpenUrlCrossRefPubMed
  35. ↵
    1. Crowley JC,
    2. Katz LC
    (2000) Early development of ocular dominance columns. Science 290:1321–1324. doi:10.1126/science.290.5495.1321 pmid:11082053
    OpenUrlAbstract/FREE Full Text
  36. ↵
    1. Dacey DM,
    2. Liao HW,
    3. Peterson BB,
    4. Robinson FR,
    5. Smith VC,
    6. Pokorny J,
    7. Yau KW,
    8. Gamlin PD
    (2005) Melanopsin-expressing ganglion cells in primate retina signal colour and irradiance and project to the LGN. Nature 433:749–754. doi:10.1038/nature03387 pmid:15716953
    OpenUrlCrossRefPubMed
  37. ↵
    1. Desimone R,
    2. Albright TD,
    3. Gross CG,
    4. Bruce C
    (1984) Stimulus-selective properties of inferior temporal neurons in the macaque. J Neurosci 4:2051–2062. doi:10.1523/JNEUROSCI.04-08-02051.1984 pmid:6470767
    OpenUrlAbstract/FREE Full Text
  38. ↵
    1. Dowling JE
    (1997) George Wald (1906–97). Nature 387:356. doi:10.1038/387356a0 pmid:9163416
    OpenUrlCrossRefPubMed
  39. ↵
    1. Dowling JE
    (2018) A life in vision. Annu Rev Vis Sci 4:1–23. doi:10.1146/annurev-vision-091517-034222 pmid:30222531
    OpenUrlCrossRefPubMed
  40. ↵
    1. Dubner R,
    2. Zeki SM
    (1971) Response properties and receptive fields of cells in an anatomically defined region of the superior temporal sulcus in the monkey. Brain Res 35:528–532. doi:10.1016/0006-8993(71)90494-X pmid:5002708
    OpenUrlCrossRefPubMed
  41. ↵
    1. Enroth-Cugell C,
    2. Robson JG
    (1966) The contrast sensitivity of retinal ganglion cells of the cat. J Physiol 187:517–552. doi:10.1113/jphysiol.1966.sp008107 pmid:16783910
    OpenUrlCrossRefPubMed
  42. ↵
    1. Erişir A,
    2. Van Horn SC,
    3. Sherman SM
    (1997) Relative numbers of cortical and brainstem inputs to the lateral geniculate nucleus. Proc Natl Acad Sci U S A 94:1517–1520. doi:10.1073/pnas.94.4.1517 pmid:9037085
    OpenUrlAbstract/FREE Full Text
  43. ↵
    1. Euler T,
    2. Detwiler PB,
    3. Denk W
    (2002) Directionally selective calcium signals in dendrites of starburst amacrine cells. Nature 418:845–852. doi:10.1038/nature00931 pmid:12192402
    OpenUrlCrossRefPubMed
  44. ↵
    1. Famiglietti EV Jr.
    (1983) 'Starburst' amacrine cells and cholinergic neurons: mirror-symmetric ON and OFF amacrine cells of rabbit retina. Brain Res 261:138–144. doi:10.1016/0006-8993(83)91293-3 pmid:6301622
    OpenUrlCrossRefPubMed
  45. ↵
    1. Felleman DJ,
    2. Van Essen DC
    (1991) Distributed hierarchical processing in the primate cerebral cortex. Cereb Cortex 1:1–47. doi:10.1093/cercor/1.1.1 pmid:1822724
    OpenUrlCrossRefPubMed
  46. ↵
    1. Felsen G,
    2. Dan Y
    (2005) A natural approach to studying vision. Nat Neurosci 8:1643–1646. doi:10.1038/nn1608 pmid:16306891
    OpenUrlCrossRefPubMed
  47. ↵
    1. Ferrari S,
    2. Di Iorio E,
    3. Barbaro V,
    4. Ponzin D,
    5. Sorrentino FS,
    6. Parmeggiani F
    (2011) Retinitis pigmentosa: genes and disease mechanisms. Curr Genomics 12:238–249. doi:10.2174/138920211795860107 pmid:22131869
    OpenUrlCrossRefPubMed
  48. ↵
    1. Ferrier D
    (1886) The functions of the brain (Smith, Elder). New York, NY: G.P. Putnam's Sons.
  49. ↵
    1. Ferster D,
    2. Chung S,
    3. Wheat H
    (1996) Orientation selectivity of thalamic input to simple cells of cat visual cortex. Nature 380:249–252. doi:10.1038/380249a0 pmid:8637573
    OpenUrlCrossRefPubMed
  50. ↵
    1. Finger S
    (2001) Origins of neuroscience: a history of explorations into brain function. Oxford, UK: Oxford UP.
  51. ↵
    1. Freud E,
    2. Plaut DC,
    3. Behrmann M
    (2016) “What” is happening in the dorsal visual pathway. Trends Cogn Sci 20:773–784. doi:10.1016/j.tics.2016.08.003 pmid:27615805
    OpenUrlCrossRefPubMed
  52. ↵
    1. Fried SI,
    2. Münch TA,
    3. Werblin FS
    (2002) Mechanisms and circuitry underlying directional selectivity in the retina. Nature 420:411–414. doi:10.1038/nature01179 pmid:12459782
    OpenUrlCrossRefPubMed
  53. ↵
    1. Fritsch G,
    2. Hitzig E
    (2009) Electric excitability of the cerebrum (Über die elektrische erregbarkeit des Grosshirns). Epilepsy Behav 15:123–130. doi:10.1016/j.yebeh.2009.03.001 pmid:19457461
    OpenUrlCrossRefPubMed
  54. ↵
    1. Gavornik JP,
    2. Bear MF
    (2014) Learned spatiotemporal sequence recognition and prediction in primary visual cortex. Nat Neurosci 17:732–737. doi:10.1038/nn.3683 pmid:24657967
    OpenUrlCrossRefPubMed
  55. ↵
    1. Gilbert CD,
    2. Wiesel TN
    (1989) Columnar specificity of intrinsic horizontal and corticocortical connections in cat visual cortex. J Neurosci 9:2432–2442. doi:10.1523/JNEUROSCI.09-07-02432.1989 pmid:2746337
    OpenUrlAbstract/FREE Full Text
  56. ↵
    1. Goodale MA,
    2. Milner AD
    (1992) Separate visual pathways for perception and action. Trends Neurosci 15:20–25. doi:10.1016/0166-2236(92)90344-8 pmid:1374953
    OpenUrlCrossRefPubMed
  57. ↵
    1. Gouwens NW,
    2. Sorensen SA,
    3. Berg J,
    4. Lee C,
    5. Jarsky T,
    6. Ting J,
    7. Sunkin SM,
    8. Feng D,
    9. Anastassiou CA,
    10. Barkan E,
    11. Bickley K,
    12. Blesie N,
    13. Braun T,
    14. Brouner K,
    15. Budzillo A,
    16. Caldejon S,
    17. Casper T,
    18. Castelli D,
    19. Chong P,
    20. Crichton K, et al.
    (2019) Classification of electrophysiological and morphological neuron types in the mouse visual cortex. Nat Neurosci 22:1182–1195. doi:10.1038/s41593-019-0417-0 pmid:31209381
    OpenUrlCrossRefPubMed
  58. ↵
    1. Gross CG
    (1998) Brain, vision, memory: tales in the history of neuroscience. Cambridge, MA: MIT.
  59. ↵
    1. Gross CG
    (2002) Genealogy of the “grandmother cell.” Neuroscientist 8:512–518. doi:10.1177/107385802237175
    OpenUrlCrossRefPubMed
  60. ↵
    1. Gross CG
    (2005) Processing the facial image: a brief history. Am Psychol 60:755–763. doi:10.1037/0003-066X.60.8.755 pmid:16351399
    OpenUrlCrossRefPubMed
  61. ↵
    1. Gross CG,
    2. Bender DB,
    3. Rocha-Miranda CE
    (1969) Visual receptive fields of neurons in inferotemporal cortex of the monkey. Science 166:1303–1306. doi:10.1126/science.166.3910.1303 pmid:4982685
    OpenUrlAbstract/FREE Full Text
  62. ↵
    1. Gross CG,
    2. Rocha-Miranda CE,
    3. Bender DB
    (1972) Visual properties of neurons in inferotemporal cortex of the macaque. J Neurophysiol 35:96–111. doi:10.1152/jn.1972.35.1.96 pmid:4621506
    OpenUrlCrossRefPubMed
  63. ↵
    1. Guido W,
    2. Weyand T
    (1995) Burst responses in thalamic relay cells of the awake behaving cat. J Neurophysiol 74:1782–1786. doi:10.1152/jn.1995.74.4.1782 pmid:8989413
    OpenUrlCrossRefPubMed
  64. ↵
    1. Hartline HK
    (1938) The response of single optic nerve fibers of the vertebrate eye to illumination of the retina. Am J Physiol 121:400–415. doi:10.1152/ajplegacy.1938.121.2.400
    OpenUrlCrossRef
  65. ↵
    1. Hassabis D,
    2. Kumaran D,
    3. Summerfield C,
    4. Botvinick M
    (2017) Neuroscience-inspired artificial intelligence. Neuron 95:245–258. doi:10.1016/j.neuron.2017.06.011 pmid:28728020
    OpenUrlCrossRefPubMed
  66. ↵
    1. Hattar S,
    2. Liao HW,
    3. Takao M,
    4. Berson DM,
    5. Yau KW
    (2002) Melanopsin-containing retinal ganglion cells: architecture, projections, and intrinsic photosensitivity. Science 295:1065–1070. doi:10.1126/science.1069609 pmid:11834834
    OpenUrlAbstract/FREE Full Text
  67. ↵
    1. Haxby JV,
    2. Grady CL,
    3. Horwitz B,
    4. Ungerleider LG,
    5. Mishkin M,
    6. Carson RE,
    7. Herscovitch P,
    8. Schapiro MB,
    9. Rapoport SI
    (1991) Dissociation of object and spatial visual processing pathways in human extrastriate cortex. Proc Natl Acad Sci U S A 88:1621–1625. doi:10.1073/pnas.88.5.1621
    OpenUrlAbstract/FREE Full Text
  68. ↵
    1. Hebb DO
    (1949) The organization of behavior: a neuropsychological theory. New York: John Wiley and Sons.
  69. ↵
    1. Hecht S
    (1924) The visibility of the spectrum. J Opt Soc Am 9:211–222. doi:10.1364/JOSA.9.000211
    OpenUrlCrossRef
  70. ↵
    1. Hecht S,
    2. Shlaer S,
    3. Pirenne MH
    (1942) Energy, quanta, and vision. J Gen Physiol 25:819–840. doi:10.1085/jgp.25.6.819 pmid:19873316
    OpenUrlAbstract/FREE Full Text
  71. ↵
    1. Hensch TK,
    2. Quinlan EM
    (2018) Critical periods in amblyopia. Vis Neurosci 35:E014. doi:10.1017/S0952523817000219 pmid:29905116
    OpenUrlCrossRefPubMed
  72. ↵
    1. Hohman TC
    (2017) Hereditary retinal dystrophy. Handb Exp Pharmacol 242:337–367. doi:10.1007/164_2016_91 pmid:28035529
    OpenUrlCrossRefPubMed
  73. ↵
    1. Hubbard R
    (1976) 100 years of rhodopsin. Trends Biochem Sci 1:154–158.
    OpenUrl
  74. ↵
    1. Hubel DH
    (1959) Single unit activity in striate cortex of unrestrained cats. J Physiol 147:226–238. doi:10.1113/jphysiol.1959.sp006238 pmid:14403678
    OpenUrlCrossRefPubMed
  75. ↵
    1. Hubel DH,
    2. Wiesel TN
    (1959) Receptive fields of single neurones in the cat's striate cortex. J Physiol 148:574–591. doi:10.1113/jphysiol.1959.sp006308 pmid:14403679
    OpenUrlCrossRefPubMed
  76. ↵
    1. Hubel DH,
    2. Wiesel TN
    (1962) Receptive fields, binocular interaction and functional architecture in the cat's visual cortex. J Physiol 160:106–154. doi:10.1113/jphysiol.1962.sp006837 pmid:14449617
    OpenUrlCrossRefPubMed
  77. ↵
    1. Hubel DH,
    2. Wiesel TN
    (2005) Brain and visual perception: the story of a 25-year collaboration. Oxford, UK: Oxford UP.
  78. ↵
    1. Jiang X,
    2. Shen S,
    3. Cadwell CR,
    4. Berens P,
    5. Sinz F,
    6. Ecker AS,
    7. Patel S,
    8. Tolias AS
    (2015) Principles of connectivity among morphologically defined cell types in adult neocortex. Science 350:aac9462. doi:10.1126/science.aac9462 pmid:26612957
    OpenUrlAbstract/FREE Full Text
  79. ↵
    1. Kanwisher N,
    2. McDermott J,
    3. Chun MM
    (1997) The fusiform face area: a module in human extrastriate cortex specialized for face perception. J Neurosci 17:4302–4311. doi:10.1523/JNEUROSCI.17-11-04302.1997 pmid:9151747
    OpenUrlAbstract/FREE Full Text
  80. ↵
    1. Keeler CE
    (1927) Iris movements in blind mice. Am J Physiol 81:107–112. doi:10.1152/ajplegacy.1927.81.1.107
    OpenUrlCrossRef
  81. ↵
    1. Keemink SW,
    2. Machens CK
    (2019) Decoding and encoding (de)mixed population responses. Curr Opin Neurobiol 58:112–121. doi:10.1016/j.conb.2019.09.004 pmid:31563083
    OpenUrlCrossRefPubMed
  82. ↵
    1. Keller GB,
    2. Bonhoeffer T,
    3. Hübener M
    (2012) Sensorimotor mismatch signals in primary visual cortex of the behaving mouse. Neuron 74:809–815. doi:10.1016/j.neuron.2012.03.040 pmid:22681686
    OpenUrlCrossRefPubMed
  83. ↵
    1. Khan AG,
    2. Poort J,
    3. Chadwick A,
    4. Blot A,
    5. Sahani M,
    6. Mrsic-Flogel TD,
    7. Hofer SB
    (2018) Distinct learning-induced changes in stimulus selectivity and interactions of GABAergic interneuron classes in visual cortex. Nat Neurosci 21:851–859. doi:10.1038/s41593-018-0143-z pmid:29786081
    OpenUrlCrossRefPubMed
  84. ↵
    1. Kim IJ,
    2. Zhang Y,
    3. Yamagata M,
    4. Meister M,
    5. Sanes JR
    (2008) Molecular identification of a retinal cell type that responds to upward motion. Nature 452:478–482. doi:10.1038/nature06739 pmid:18368118
    OpenUrlCrossRefPubMed
  85. ↵
    1. Konorski J
    (1967) Integrative activity of the brain: an interdisciplinary approach. Chicago: University of Chicago.
  86. ↵
    1. Kuffler SW
    (1953) Discharge patterns and functional organization of mammalian retina. J Neurophysiol 16:37–68. doi:10.1152/jn.1953.16.1.37 pmid:13035466
    OpenUrlCrossRefPubMed
  87. ↵
    1. Lettvin J
    (1999) The history of neuroscience in autobiography. In: The history of neuroscience in autobiography, Volume 2 (Squire LR, ed), pp 222–243. New York: Academic.
    OpenUrl
  88. ↵
    1. Lettvin JY,
    2. Maturana HR,
    3. McCulloch WS,
    4. Pitts WH
    (1959) What the frog's eye tells the frog's brain. Proc IRE 47:1940–1951. doi:10.1109/jrproc.1959.287207
    OpenUrlCrossRef
  89. ↵
    1. Lettvin JY,
    2. Maturana HR,
    3. Pitts WH,
    4. Mcculloch WS
    (1960) Two remarks on the visual system of the frog. AFOSR TR United States Air Force Off Sci Res 60–77:1–25. pmid:13761261
    OpenUrlPubMed
  90. ↵
    1. Lien AD,
    2. Scanziani M
    (2018) Cortical direction selectivity emerges at convergence of thalamic synapses. Nature 558:80–86. doi:10.1038/s41586-018-0148-5 pmid:29795349
    OpenUrlCrossRefPubMed
  91. ↵
    1. Livingstone MS,
    2. Hubel DH
    (1984) Anatomy and physiology of a color system in the primate visual cortex. J Neurosci 4:309–356. doi:10.1523/JNEUROSCI.04-01-00309.1984 pmid:6198495
    OpenUrlAbstract/FREE Full Text
  92. ↵
    1. Maffei L,
    2. Galli-Resta L
    (1990) Correlation in the discharges of neighboring rat retinal ganglion cells during prenatal life. Proc Natl Acad Sci U S A 87:2861–2864. doi:10.1073/pnas.87.7.2861 pmid:2320593
    OpenUrlAbstract/FREE Full Text
  93. ↵
    1. Marshel JH,
    2. Kim YS,
    3. Machado TA,
    4. Quirin S,
    5. Benson B,
    6. Kadmon J,
    7. Raja C,
    8. Chibukhchyan A,
    9. Ramakrishnan C,
    10. Inoue M,
    11. Shane JC,
    12. McKnight DJ,
    13. Yoshizawa S,
    14. Kato HE,
    15. Ganguli S,
    16. Deisseroth K
    (2019) Cortical layer-specific critical dynamics triggering perception. Science 365:eaaw5202. doi:10.1126/science.aaw5202 pmid:31320556
    OpenUrlAbstract/FREE Full Text
  94. ↵
    1. Masland RH
    (2001) The fundamental plan of the retina. Nat Neurosci 4:877–886. doi:10.1038/nn0901-877 pmid:11528418
    OpenUrlCrossRefPubMed
  95. ↵
    1. Masland RH
    (2012) The neuronal organization of the retina. Neuron 76:266–280. doi:10.1016/j.neuron.2012.10.002 pmid:23083731
    OpenUrlCrossRefPubMed
  96. ↵
    1. Masland RH,
    2. Mills JW
    (1979) Autoradiographic identification of acetylcholine in the rabbit retina. J Cell Biol 83:159–178. doi:10.1083/jcb.83.1.159 pmid:92476
    OpenUrlAbstract/FREE Full Text
  97. ↵
    1. Masu M,
    2. Iwakabe H,
    3. Tagawa Y,
    4. Miyoshi T,
    5. Yamashita M,
    6. Fukuda Y,
    7. Sasaki H,
    8. Hiroi K,
    9. Nakamura Y,
    10. Shigemoto R
    (1995) Specific deficit of the ON response in visual transmission by targeted disruption of the mGIuR6 gene. Cell 80:757–765. doi:10.1016/0092-8674(95)90354-2 pmid:7889569
    OpenUrlCrossRefPubMed
  98. ↵
    1. Maturana HR,
    2. Frenk S
    (1963) Directional movement and horizontal edge detectors in the pigeon retina. Science 142:977–979. doi:10.1126/science.142.3594.977 pmid:14069232
    OpenUrlAbstract/FREE Full Text
  99. ↵
    1. Maunsell JH,
    2. Van Essen DC
    (1983) Functional properties of neurons in middle temporal visual area of the macaque monkey. I. Selectivity for stimulus direction, speed, and orientation. J Neurophysiol 49:1127–1147. doi:10.1152/jn.1983.49.5.1127 pmid:6864242
    OpenUrlCrossRefPubMed
  100. ↵
    1. McLaughlin T,
    2. Torborg CL,
    3. Feller MB,
    4. O'Leary DD
    (2003) Retinotopic map refinement requires spontaneous retinal waves during a brief critical period of development. Neuron 40:1147–1160. doi:10.1016/S0896-6273(03)00790-6 pmid:14687549
    OpenUrlCrossRefPubMed
  101. ↵
    1. Meister M,
    2. Wong RO,
    3. Baylor DA,
    4. Shatz CJ
    (1991) Synchronous bursts of action potentials in ganglion cells of the developing mammalian retina. Science 252:939–943. doi:10.1126/science.2035024 pmid:2035024
    OpenUrlAbstract/FREE Full Text
  102. ↵
    1. Nakamoto M,
    2. Cheng HJ,
    3. Friedman GC,
    4. McLaughlin T,
    5. Hansen MJ,
    6. Yoon CH,
    7. O'Leary DD,
    8. Flanagan JG
    (1996) Topographically specific effects of ELF-1 on retinal axon guidance in vitro and retinal axon mapping in vivo. Cell 86:755–766. doi:10.1016/S0092-8674(00)80150-6 pmid:8797822
    OpenUrlCrossRefPubMed
  103. ↵
    1. Newcombe F,
    2. Russell WR
    (1969) Dissociated visual perceptual and spatial deficits in focal lesions of the right hemisphere. J Neurol Neurosurg Psychiatry 32:73–81. doi:10.1136/jnnp.32.2.73
    OpenUrlFREE Full Text
  104. ↵
    1. Newsome WT,
    2. Paré EB
    (1988) A selective impairment of motion perception following lesions of the middle temporal visual area (MT). J Neurosci 8:2201–2211. doi:10.1523/JNEUROSCI.08-06-02201.1988 pmid:3385495
    OpenUrlAbstract/FREE Full Text
  105. ↵
    1. Newsome WT,
    2. Britten KH,
    3. Movshon JA
    (1989) Neuronal correlates of a perceptual decision. Nature 341:52–54. doi:10.1038/341052a0 pmid:2770878
    OpenUrlCrossRefPubMed
  106. ↵
    1. Niell CM,
    2. Stryker MP
    (2010) Modulation of visual responses by behavioral state in mouse visual cortex. Neuron 65:472–479. doi:10.1016/j.neuron.2010.01.033 pmid:20188652
    OpenUrlCrossRefPubMed
  107. ↵
    1. Oh SW,
    2. Harris JA,
    3. Ng L,
    4. Winslow B,
    5. Cain N,
    6. Mihalas S,
    7. Wang Q,
    8. Lau C,
    9. Kuan L,
    10. Henry AM,
    11. Mortrud MT,
    12. Ouellette B,
    13. Nguyen TN,
    14. Sorensen SA,
    15. Slaughterbeck CR,
    16. Wakeman W,
    17. Li Y,
    18. Feng D,
    19. Ho A,
    20. Nicholas E, et al.
    (2014) A mesoscale connectome of the mouse brain. Nature 508:207–214. doi:10.1038/nature13186 pmid:24695228
    OpenUrlCrossRefPubMed
  108. ↵
    1. Ojemann JG,
    2. Ojemann GA,
    3. Lettich E
    (1992) Neuronal activity related to faces and matching in human right nondominant temporal cortex. Brain 115:1–13. doi:10.1093/brain/115.1.1 pmid:1559147
    OpenUrlCrossRefPubMed
  109. ↵
    1. Olshausen BA,
    2. Field DJ
    (1996) Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature 381:607–609. doi:10.1038/381607a0 pmid:8637596
    OpenUrlCrossRefPubMed
  110. ↵
    1. Ölveczky BP,
    2. Baccus SA,
    3. Meister M
    (2003) Segregation of object and background motion in the retina. Nature 423:401–408. doi:10.1038/nature01652 pmid:12754524
    OpenUrlCrossRefPubMed
  111. ↵
    1. Oyster CW,
    2. Barlow HB
    (1967) Direction-selective units in rabbit retina: distribution of preferred directions. Science 155:841–842. doi:10.1126/science.155.3764.841 pmid:6019094
    OpenUrlAbstract/FREE Full Text
  112. ↵
    1. Oyster CW,
    2. Takahashi E,
    3. Collewijn H
    (1972) Direction-selective retinal ganglion cells and control of optokinetic nystagmus in the rabbit. Vision Res 12:183–193. doi:10.1016/0042-6989(72)90110-1 pmid:5033683
    OpenUrlCrossRefPubMed
  113. ↵
    1. Packer AM,
    2. Russell LE,
    3. Dalgleish HW,
    4. Häusser M
    (2015) Simultaneous all-optical manipulation and recording of neural circuit activity with cellular resolution in vivo. Nat Methods 12:140–146. doi:10.1038/nmeth.3217 pmid:25532138
    OpenUrlCrossRefPubMed
  114. ↵
    1. Penfield W,
    2. Rasmussen T
    (1950) The cerebral cortex of man; a clinical study of localization of function. Oxford, UK: Macmillan.
  115. ↵
    1. Peng YR,
    2. Shekhar K,
    3. Yan W,
    4. Herrmann D,
    5. Sappington A,
    6. Bryman GS,
    7. van Zyl T,
    8. Do MTH,
    9. Regev A,
    10. Sanes JR
    (2019) Molecular classification and comparative taxonomics of foveal and peripheral cells in primate retina. Cell 176:1222–1237.e22. doi:10.1016/j.cell.2019.01.004 pmid:30712875
    OpenUrlCrossRefPubMed
  116. ↵
    1. Pohl W
    (1973) Dissociation of spatial discrimination deficits following frontal and parietal lesions in monkeys. J Comp Physiol Psychol 82:227–239. doi:10.1037/h0033922 pmid:4632974
    OpenUrlCrossRefPubMed
  117. ↵
    1. Ponce CR,
    2. Xiao W,
    3. Schade PF,
    4. Hartmann TS,
    5. Kreiman G,
    6. Livingstone MS
    (2019) Evolving images for visual neurons using a deep generative network reveals coding principles and neuronal preferences. Cell 177:999–1009.e10. doi:10.1016/j.cell.2019.04.005 pmid:31051108
    OpenUrlCrossRefPubMed
  118. ↵
    1. Rakic P
    (1974) Neurons in rhesus monkey visual cortex: systematic relation between time of origin and eventual disposition. Science 183:425–427. doi:10.1126/science.183.4123.425 pmid:4203022
    OpenUrlAbstract/FREE Full Text
  119. ↵
    1. Rao RP,
    2. Ballard DH
    (1999) Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. Nat Neurosci 2:79–87. doi:10.1038/4580 pmid:10195184
    OpenUrlCrossRefPubMed
  120. ↵
    1. Reid CR,
    2. Alonso JM
    (1995) Specificity of monosynaptic connections from thalamus to visual cortex. Nature 378:281–284. doi:10.1038/378281a0 pmid:7477347
    OpenUrlCrossRefPubMed
  121. ↵
    1. Riesen AH,
    2. Kurke, MI,
    3. Mellinger JC
    (1953) Interocular transfer of habits learned monocularly in visually naive and visually experienced cats. J Comp Physiol Psychol 46:166–172. doi:10.1037/h0057003 pmid:13061640
    OpenUrlCrossRefPubMed
  122. ↵
    1. Rockland KS,
    2. Pandya DN
    (1979) Laminar origins and terminations of cortical connections of the occipital lobe in the rhesus monkey. Brain Res 179:3–20. doi:10.1016/0006-8993(79)90485-2 pmid:116716
    OpenUrlCrossRefPubMed
  123. ↵
    1. Rodieck RW
    (1965) Quantitative analysis of cat retinal ganglion cell response to visual stimuli. Vision Res 5:583–601. doi:10.1016/0042-6989(65)90033-7 pmid:5862581
    OpenUrlCrossRefPubMed
  124. ↵
    1. Rodieck RW,
    2. Stone J
    (1965) Analysis of receptive fields of cat retinal ganglion cells. J Neurophysiol 28:833–849. doi:10.1152/jn.1965.28.5.833 pmid:5867882
    OpenUrlCrossRefPubMed
  125. ↵
    1. Roska B,
    2. Werblin F
    (2001) Vertical interactions across ten parallel, stacked representations in the mammalian retina. Nature 410:583–587. doi:10.1038/35069068 pmid:11279496
    OpenUrlCrossRefPubMed
  126. ↵
    1. Russell S,
    2. Bennett J,
    3. Wellman JA,
    4. Chung DC,
    5. Yu Z-F,
    6. Tillman A,
    7. Wittes J,
    8. Pappas J,
    9. Elci O,
    10. McCague S,
    11. Cross D,
    12. Marshall KA,
    13. Walshire J,
    14. Kehoe TL,
    15. Reichert H,
    16. Davis M,
    17. Raffini L,
    18. George LA,
    19. Hudson FP,
    20. Dingfield L, et al.
    (2017) Efficacy and safety of voretigene neparvovec (AAV2-hRPE65v2) in patients with RPE65-mediated inherited retinal dystrophy: a randomised, controlled, open-label, phase 3 trial. Lancet 390:849–860. doi:10.1016/S0140-6736(17)31868-8 pmid:28712537
    OpenUrlCrossRefPubMed
  127. ↵
    1. Rust NC,
    2. DiCarlo JJ
    (2012) Balanced increases in selectivity and tolerance produce constant sparseness along the ventral visual stream. J Neurosci 32:10170–10182. doi:10.1523/JNEUROSCI.6125-11.2012 pmid:22836252
    OpenUrlAbstract/FREE Full Text
  128. ↵
    1. Rust NC,
    2. Movshon JA
    (2005) In praise of artifice. Nat Neurosci 8:1647–1650. doi:10.1038/nn1606 pmid:16306892
    OpenUrlCrossRefPubMed
  129. ↵
    1. Saleem AB,
    2. Diamanti EM,
    3. Fournier J,
    4. Harris KD,
    5. Carandini M
    (2018) Coherent encoding of subjective spatial position in visual cortex and hippocampus. Nature 562:124–127. doi:10.1038/s41586-018-0516-1 pmid:30202092
    OpenUrlCrossRefPubMed
  130. ↵
    1. Salzman CD,
    2. Britten KH,
    3. Newsome WT
    (1990) Cortical microstimulation influences perceptual judgements of motion direction. Nature 346:174–177. doi:10.1038/346174a0 pmid:2366872
    OpenUrlCrossRefPubMed
  131. ↵
    1. Schade OH Sr.
    (1956) Optical and photoelectric analog of the eye. J Opt Soc Am 46:721. doi:10.1364/JOSA.46.000721 pmid:13358013
    OpenUrlCrossRefPubMed
  132. ↵
    1. Schiller PH,
    2. Stryker M
    (1972) Single-unit recording and stimulation in superior colliculus of the alert rhesus monkey. J Neurophysiol 35:915–924. doi:10.1152/jn.1972.35.6.915 pmid:4631839
    OpenUrlCrossRefPubMed
  133. ↵
    1. Schiller PH,
    2. Sandell JH,
    3. Maunsell JH
    (1986) Functions of the ON and OFF channels of the visual system. Nature 322:824–825. doi:10.1038/322824a0 pmid:3748169
    OpenUrlCrossRefPubMed
  134. ↵
    1. Schneider GE
    (1967) Contrasting visuomotor functions of tectum and cortex in the golden hamster. Psychol Forsch 31:52–62. doi:10.1007/BF00422386 pmid:5605117
    OpenUrlCrossRefPubMed
  135. ↵
    1. Schneider GE
    (1969) Two visual systems. Science 163:895–902. doi:10.1126/science.163.3870.895 pmid:5763873
    OpenUrlFREE Full Text
  136. ↵
    1. Sereno AB,
    2. Maunsell JH
    (1998) Shape selectivity in primate lateral intraparietal cortex. Nature 395:500–503. doi:10.1038/26752 pmid:9774105
    OpenUrlCrossRefPubMed
  137. ↵
    1. Shapley R,
    2. Hochstein S
    (1975) Visual spatial summation in two classes of geniculate cells. Nature 256:411–413. doi:10.1038/256411a0 pmid:1143345
    OpenUrlCrossRefPubMed
  138. ↵
    1. Shatz CJ,
    2. Stryker MP
    (1988) Prenatal tetrodotoxin infusion blocks segregation of retinogeniculate afferents. Science 242:87–89. doi:10.1126/science.3175636 pmid:3175636
    OpenUrlAbstract/FREE Full Text
  139. ↵
    1. Sherman SM
    (2006) The role of thalamus in cortical function: not just a simple relay (abstract). J Vis 6(13):28, 28a. doi:10.1167/6.13.28
    OpenUrlAbstract
  140. ↵
    1. Sherman SM,
    2. Guillery RW
    (1996) Functional organization of thalamocortical relays. J Neurophysiol 76:1367–1395. doi:10.1152/jn.1996.76.3.1367 pmid:8890259
    OpenUrlCrossRefPubMed
  141. ↵
    1. Sherman SM,
    2. Koch C
    (1986) The control of retinogeniculate transmission in the mammalian lateral geniculate nucleus. Exp Brain Res 63:1–20. doi:10.1007/bf00235642 pmid:3015651
    OpenUrlCrossRefPubMed
  142. ↵
    1. Sherman SM,
    2. Wilson JR,
    3. Kaas JH,
    4. Webb SV
    (1976) X- and Y-cells in the dorsal lateral geniculate nucleus of the owl monkey (Aotus trivirgatus). Science 192:475–477. doi:10.1126/science.816006 pmid:816006
    OpenUrlFREE Full Text
  143. ↵
    1. Sherman SM,
    2. Guillery RW
    (2014) The lateral geniculate nucleus and pulvinar. In: The New Visual Neurosciences (Chalupa LM, Werner JS, eds), pp 257–283. Cambridge, MA: MIT Press.
  144. ↵
    1. Shuler MG,
    2. Bear MF
    (2006) Reward timing in the primary visual cortex. Science 311:1606–1609. doi:10.1126/science.1123513 pmid:16543459
    OpenUrlAbstract/FREE Full Text
  145. ↵
    1. Slaughter MM,
    2. Miller RF
    (1981) 2-amino-4-phosphonobutyric acid: a new pharmacological tool for retina research. Science 211:182–185. doi:10.1126/science.6255566 pmid:6255566
    OpenUrlAbstract/FREE Full Text
  146. ↵
    1. Sretavan DW,
    2. Shatz CJ,
    3. Stryker MP
    (1988) Modification of retinal ganglion cell axon morphology by prenatal infusion of tetrodotoxin. Nature 336:468–471. doi:10.1038/336468a0 pmid:2461517
    OpenUrlCrossRefPubMed
  147. ↵
    1. Steriade M,
    2. Llinás RR
    (1988) The functional states of the thalamus and the associated neuronal interplay. Physiol Rev 68:649–742. doi:10.1152/physrev.1988.68.3.649 pmid:2839857
    OpenUrlCrossRefPubMed
  148. ↵
    1. Stryer L
    (1987) The molecules of visual excitation. Sci Am 257:42–51. doi:10.1038/scientificamerican0787-42 pmid:3037690
    OpenUrlCrossRefPubMed
  149. ↵
    1. Talbot SA,
    2. Kuffler SW
    (1952) A multibeam ophthalmoscope for the study of retinal physiology. J Opt Soc Am 42:931–936. doi:10.1364/JOSA.42.000931 pmid:13011674
    OpenUrlCrossRefPubMed
  150. ↵
    1. Tasic B,
    2. Menon V,
    3. Nguyen TN,
    4. Kim TK,
    5. Jarsky T,
    6. Yao Z,
    7. Levi B,
    8. Gray LT,
    9. Sorensen SA,
    10. Dolbeare T,
    11. Bertagnolli D,
    12. Goldy J,
    13. Shapovalova N,
    14. Parry S,
    15. Lee C,
    16. Smith K,
    17. Bernard A,
    18. Madisen L,
    19. Sunkin SM,
    20. Hawrylycz M, et al
    . (2016) Adult mouse cortical cell taxonomy revealed by single cell transcriptomics. Nat Neurosci 19:335–346. doi:10.1038/nn.4216 pmid:26727548
    OpenUrlCrossRefPubMed
  151. ↵
    1. Tasic B,
    2. Yao Z,
    3. Graybuck LT,
    4. Smith KA,
    5. Nguyen TN,
    6. Bertagnolli D,
    7. Goldy J,
    8. Garren E,
    9. Economo MN,
    10. Viswanathan S,
    11. Penn O,
    12. Bakken T,
    13. Menon V,
    14. Miller J,
    15. Fong O,
    16. Hirokawa KE,
    17. Lathia K,
    18. Rimorin C,
    19. Tieu M,
    20. Larsen R, et al
    . (2018) Shared and distinct transcriptomic cell types across neocortical areas. Nature 563:72–78. doi:10.1038/s41586-018-0654-5 pmid:30382198
    OpenUrlCrossRefPubMed
  152. ↵
    1. Trevarthen CB
    (1968) Two mechanisms of vision in primates. Psychol Forsch 31:299–348. doi:10.1007/BF00422717 pmid:4973634
    OpenUrlCrossRefPubMed
  153. ↵
    1. Tsao DY,
    2. Freiwald WA,
    3. Tootell RB,
    4. Livingstone MS
    (2006) A cortical region consisting entirely of face-selective cells. Science 311:670–674. doi:10.1126/science.1119983 pmid:16456083
    OpenUrlAbstract/FREE Full Text
  154. ↵
    1. Ungerleider LG,
    2. Mishkin M
    (1982) Two cortical visual systems. In: Analysis of visual behavior (Ingle DJ, Goodale MA, Mansfield RJW, eds), pp 549–586. Cambridge, MA: MIT.
  155. ↵
    1. Usrey WM,
    2. Reppas JB,
    3. Reid RC
    (1998) Paired-spike interactions and synaptic efficacy of retinal inputs to the thalamus. Nature 395:384–387. doi:10.1038/26487 pmid:9759728
    OpenUrlCrossRefPubMed
  156. ↵
    1. Van Essen DC,
    2. Maunsell JHR
    (1983) Hierarchical organization and functional streams in the visual cortex. Trends Neurosci 6:370–375. doi:10.1016/0166-2236(83)90167-4
    OpenUrlCrossRef
  157. ↵
    1. Wald G
    (1968) Molecular basis of visual excitation. Science 162:230–239. doi:10.1126/science.162.3850.230 pmid:4877437
    OpenUrlFREE Full Text
  158. ↵
    1. Wässle H,
    2. Peichl L,
    3. Boycott BB
    (1981) Dendritic territories of cat retinal ganglion cells. Nature 292:344–345. doi:10.1038/292344a0 pmid:7254331
    OpenUrlCrossRefPubMed
  159. ↵
    1. Werblin FS,
    2. Dowling JE
    (1969) Organization of the retina of the mudpuppy, Necturus maculosus. II. Intracellular recording. J Neurophysiol 32:339–355. doi:10.1152/jn.1969.32.3.339 pmid:4306897
    OpenUrlCrossRefPubMed
  160. ↵
    1. Wiesel TN,
    2. Hubel DH
    (1963) Single-cell responses in striate cortex of kittens deprived of vision in one eye. J Neurophysiol 26:1003–1017. doi:10.1152/jn.1963.26.6.1003 pmid:14084161
    OpenUrlCrossRefPubMed
  161. ↵
    1. Wimmer RD,
    2. Schmitt LI,
    3. Davidson TJ,
    4. Nakajima M,
    5. Deisseroth K,
    6. Halassa MM
    (2015) Thalamic control of sensory selection in divided attention. Nature 526:705–709. doi:10.1038/nature15398 pmid:26503050
    OpenUrlCrossRefPubMed
  162. ↵
    1. Wurtz RH,
    2. Goldberg ME
    (1972) Activity of superior colliculus in behaving monkey. 3. cells discharging before eye movements. J Neurophysiol 35:575–586. doi:10.1152/jn.1972.35.4.575 pmid:4624741
    OpenUrlCrossRefPubMed
  163. ↵
    1. Yamins DL,
    2. Hong H,
    3. Cadieu CF,
    4. Solomon EA,
    5. Seibert D,
    6. DiCarlo JJ
    (2014) Performance-optimized hierarchical models predict neural responses in higher visual cortex. Proc Natl Acad Sci U S A 111:8619–8624. doi:10.1073/pnas.1403112111 pmid:24812127
    OpenUrlAbstract/FREE Full Text
  164. ↵
    1. Zeki SM
    (1974) Functional organization of a visual area in the posterior bank of the superior temporal sulcus of the rhesus monkey. J Physiol 236:549–573. doi:10.1113/jphysiol.1974.sp010452 pmid:4207129
    OpenUrlCrossRefPubMed
  165. ↵
    1. Zeki SM
    (1978) Functional specialisation in the visual cortex of the rhesus monkey. Nature 274:423–428. doi:10.1038/274423a0 pmid:97565
    OpenUrlCrossRefPubMed
  166. ↵
    1. Zeng H,
    2. Shen EH,
    3. Hohmann JG,
    4. Oh SW,
    5. Bernard A,
    6. Royall JJ,
    7. Glattfelder KJ,
    8. Sunkin SM,
    9. Morris JA,
    10. Guillozet-Bongaarts AL,
    11. Smith KA,
    12. Ebbert AJ,
    13. Swanson B,
    14. Kuan L,
    15. Page DT,
    16. Overly CC,
    17. Lein ES,
    18. Hawrylycz MJ,
    19. Hof PR,
    20. Hyde TM, et al
    . (2012) Large-scale cellular-resolution gene profiling in human neocortex reveals species-specific molecular signatures. Cell 149:483–496. doi:10.1016/j.cell.2012.02.052 pmid:22500809
    OpenUrlCrossRefPubMed
Back to top

In this issue

The Journal of Neuroscience: 40 (1)
Journal of Neuroscience
Vol. 40, Issue 1
2 Jan 2020
  • Table of Contents
  • Table of Contents (PDF)
  • About the Cover
  • Index by author
  • Advertising (PDF)
  • Ed Board (PDF)
Email

Thank you for sharing this Journal of Neuroscience article.

NOTE: We request your email address only to inform the recipient that it was you who recommended this article, and that it is not junk mail. We do not retain these email addresses.

Enter multiple addresses on separate lines or separate them with commas.
An Annotated Journey through Modern Visual Neuroscience
(Your Name) has forwarded a page to you from Journal of Neuroscience
(Your Name) thought you would be interested in this article in Journal of Neuroscience.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Print
View Full Page PDF
Citation Tools
An Annotated Journey through Modern Visual Neuroscience
Stuart Trenholm, Arjun Krishnaswamy
Journal of Neuroscience 2 January 2020, 40 (1) 44-53; DOI: 10.1523/JNEUROSCI.1061-19.2019

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Respond to this article
Request Permissions
Share
An Annotated Journey through Modern Visual Neuroscience
Stuart Trenholm, Arjun Krishnaswamy
Journal of Neuroscience 2 January 2020, 40 (1) 44-53; DOI: 10.1523/JNEUROSCI.1061-19.2019
del.icio.us logo Digg logo Reddit logo Twitter logo CiteULike logo Facebook logo Google logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • Abstract
    • Introduction
    • Visual threshold and single-photon responses
    • Center-surround receptive fields
    • Linear and nonlinear responses
    • Feature detectors
    • Orientation selectivity
    • Direction selectivity in the retina
    • Diverse retinal cell types, organization, and responses
    • The link between eye and brain
    • Wiring the visual system
    • Coding in the visual system
    • Two ways to see
    • Face cells
    • From brain to perception
    • The whole visual system
    • Conclusion
    • Materials and Methods
    • Footnotes
    • References
  • Figures & Data
  • Info & Metrics
  • eLetters
  • PDF

Responses to this article

Respond to this article

Jump to comment:

No eLetters have been published for this article.

Related Articles

Cited By...

More in this TOC Section

  • A Proposed Role for Interactions between Argonautes, miRISC, and RNA Binding Proteins in the Regulation of Local Translation in Neurons and Glia
  • Stopping Interference in Response Inhibition: Behavioral and Neural Signatures of Selective Stopping
  • From the Neuroscience of Individual Variability to Climate Change
Show more Viewpoints

Subjects

  • 50th Anniversary
  • Home
  • Alerts
  • Visit Society for Neuroscience on Facebook
  • Follow Society for Neuroscience on Twitter
  • Follow Society for Neuroscience on LinkedIn
  • Visit Society for Neuroscience on Youtube
  • Follow our RSS feeds

Content

  • Early Release
  • Current Issue
  • Issue Archive
  • Collections

Information

  • For Authors
  • For Advertisers
  • For the Media
  • For Subscribers

About

  • About the Journal
  • Editorial Board
  • Privacy Policy
  • Contact
(JNeurosci logo)
(SfN logo)

Copyright © 2022 by the Society for Neuroscience.
JNeurosci Online ISSN: 1529-2401

The ideas and opinions expressed in JNeurosci do not necessarily reflect those of SfN or the JNeurosci Editorial Board. Publication of an advertisement or other product mention in JNeurosci should not be construed as an endorsement of the manufacturer’s claims. SfN does not assume any responsibility for any injury and/or damage to persons or property arising from or related to any use of any material contained in JNeurosci.