Trends in Neurosciences
ReviewSeparate visual pathways for perception and action
Abstract
Accumulating neuropsychological, electrophysiological and behavioural evidence suggests that the neural substrates of visual perception may be quite distinct from those underlying the visual control of actions. In other words, the set of object descriptions that permit identification and recognition may be computed independently of the set of descriptions that allow an observer to shape the hand appropriately to pick up an object. We propose that the ventral stream of projections from the striate cortex to the inferotemporal cortex plays the major role in the perceptual identification of objects, while the dorsal stream projecting from the striate cortex to the posterior parietal region mediates the required sensorimotor transformations for visually guided actions directed at such objects.
References (61)
- L.G. Ungerleider et al.
Exp. Neurol.
(1977) - A.D. Milner et al.
Cortex
(1977) - E.A. DeYoe et al.
Trends Neurosci.
(1988) - P.H. Schiller et al.
Trends Neurosci.
(1990) - F. Newcombe et al.
Neuropsychologia
(1987) - L.S. Jakobson et al.
Neuropsychologia
(1991) - B. Milner
Neuropsychologia
(1965) - M.L. Smith et al.
Neuropsychologia
(1989) - G. Ettlinger
Cortex
(1990) - S. Faugier-Grimaud et al.
Neuropsychologia
(1978)
Trends Neurosci.
Cortex
Science
Brain Res.
Prog. Physiol. Psychol.
J. Comp. Physiol. Psychol.
J. Comp. Neurol.
Visual Neurosci.
J. Neurosci.
Science
J. Neurosci.
Invest. Ophthalmol. Visual Sci.
Invest. Ophthalmol. Visual Sci.
Annu. Rev. Neurosci.
Cited by (4685)
Hemispheric asymmetry of hand and tool perception in left- and right-handers with known language dominance
2024, NeuropsychologiaRegions in the brain that are selective for images of hands and tools have been suggested to be lateralised to the left hemisphere of right-handed individuals. In left-handers, many functions related to tool use or tool pantomime may also depend more on the left hemisphere. This result seems surprising, given that the dominant hand of these individuals is controlled by the right hemisphere. One explanation is that the left hemisphere is dominant for speech and language in the majority of left-handers, suggesting a supraordinate control system for complex motor sequencing that is required for skilled tool use, as well as for speech. In the present study, we examine if this left-hemispheric specialisation extends to perception of hands and tools in left- and right-handed individuals. We, crucially, also include a group of left-handers with right-hemispheric language dominance to examine their asymmetry biases. The results suggest that tools lateralise to the left hemisphere in most right-handed individuals with left-hemispheric language dominance. Tools also lateralise to the language dominant hemisphere in right-hemispheric language dominant left-handers, but the result for left-hemispheric language dominant left-handers are more varied, and no clear bias towards one hemisphere is found. Hands did not show a group-level asymmetry pattern in any of the groups. These results suggest a more complex picture regarding hemispheric overlap of hand and tool representations, and that visual appearance of tools may be driven in part by both language dominance and the hemisphere which controls the motor-dominant hand.
Audio-visual saliency prediction for movie viewing in immersive environments: Dataset and benchmarks
2024, Journal of Visual Communication and Image RepresentationIn this paper, an eye-tracking dataset of movie viewing in the immersive environment is developed, which contains 256 movie clips with 2K QHD resolution and corresponding movie genre labels from IMDb (Internet Movie Database). The dataset provides the audio-visual clues for studying the human visual attention when watching movie using a VR headset, by recording the eye movements using integrated eye tracker. To provide benchmarks for a saliency prediction for movie viewing in the immersive environment, fifteen computational models are evaluated on the dataset, including a newly developed multi-stream audio-visual saliency prediction model based on deep neural networks, named as MSAV. Detailed quantitative and qualitative comparisons and analyses are also provided. The developed dataset and benchmarks could help to facilitate the studies of visual saliency prediction for movie viewing in the immersive environments.
Revisiting the effect of visual illusions on grasping in left and right handers
2024, NeuropsychologiaVisual illusions have provided compelling evidence for a dissociation between perception and action. For example, when two different-sized objects are placed on opposite ends of the Ponzo illusion, people erroneously perceive the physically smaller object to be bigger than the physically larger one, but when they pick up the objects, their grip aperture reflects the real difference in size between the objects. This and similar findings have been demonstrated almost entirely for the right hand in right handers. The scarce research that has examined right and left-handed subjects in this context, has typically used only small samples. Here, we extended this research with a larger sample size (more than 50 in each group) in a version of the Ponzo illusion that allowed us to disentangle the effects of real and illusory size on action and perception in much more powerful way. We also collected a wide range of kinematic measures to assess possible differences in visuomotor control in left and right handers. The results showed that the dissociation between perception and action persisted for both hands in right handers, but only for the right hand in left handers. The left hand of left handers was sensitive to the illusion. Left handers also showed more variable and slower movements, as well as larger safety margins in both hands. These findings suggest that grasping in left handers may require more cognitive supervision, which could lead to greater sensitivity to visual context , particularly with their dominant left hand.
Whole-brain structural connectome asymmetry in autism
2024, NeuroImageAutism spectrum disorder is a common neurodevelopmental condition that manifests as a disruption in sensory and social skills. Although it has been shown that the brain morphology of individuals with autism is asymmetric, how this differentially affects the structural connectome organization of each hemisphere remains under-investigated. We studied whole-brain structural connectivity-based brain asymmetry in individuals with autism using diffusion magnetic resonance imaging obtained from the Autism Brain Imaging Data Exchange initiative. By leveraging dimensionality reduction techniques, we constructed low-dimensional representations of structural connectivity and calculated their asymmetry index. Comparing the asymmetry index between individuals with autism and neurotypical controls, we found atypical structural connectome asymmetry in the sensory and default-mode regions, particularly showing weaker asymmetry towards the right hemisphere in autism. Network communication provided topological underpinnings by demonstrating that the inferior temporal cortex and limbic and frontoparietal regions showed reduced global network communication efficiency and decreased send-receive network navigation in the inferior temporal and lateral visual cortices in individuals with autism. Finally, supervised machine learning revealed that structural connectome asymmetry could be used as a measure for predicting communication-related autistic symptoms and nonverbal intelligence. Our findings provide insights into macroscale structural connectome alterations in autism and their topological underpinnings.
Neurophysiological processes reflecting the effects of the immediate past during the dynamic management of actions
2024, NeuroImageIn recent years, there has been many efforts to establish a comprehensive theoretical framework explaining the working mechanisms involved in perception-action integration. This framework stresses the importance of the immediate past on mechanisms supporting perception-action integration. The present study investigates the neurophysiological principles of dynamic perception-action bindings, particularly considering the influence of the immediate history on action control mechanisms. For this purpose, we conducted an established stimulus-response binding paradigm during EEG recording. The SR-task measures stimulus-response binding in terms of accuracy and reaction time differences depending on the degree of feature overlap between conditions. Alpha, beta and theta band activity in distinct time domains as well as associated brain regions were investigated applying time-frequency analyses, a beamforming approach as well as correlation analyses. We demonstrate, for the first time, interdependencies of neuronal processes relying on the immediate past. The reconfiguration of an action seems to overwrite immediately preceding processes. The analyses revealed modulations of theta (TBA), alpha (ABA) and beta band activity (BBA) in connection with fronto-temporal structures supporting the theoretical assumptions of the considered conceptual framework. The close interplay of attentional modulation by gating irrelevant information (ABA) and binding and retrieval processes (TBA) is reflected by the correlation of ABA in all pre-probe-intervals with post-probe TBA. Likewise, the role of BBA in maintaining the event file until retrieval is corroborated by BBA preceding the TBA-associated retrieval of perception-action codes. Following action execution, TBA shifted towards visual association cortices probably reflecting preparation for upcoming information, while ABA and BBA continue to reflect processes of attentional control and information selection for goal-directed behavior. The present work provides the first empirical support for concepts about the neurophysiological mechanisms of dynamic management of perception and action.
Scene-selectivity in CA1/subicular complex: Multivoxel pattern analysis at 7T
2024, NeuropsychologiaPrior univariate functional magnetic resonance imaging (fMRI) studies in humans suggest that the anteromedial subicular complex of the hippocampus is a hub for scene-based cognition. However, it is possible that univariate approaches were not sufficiently sensitive to detect scene-related activity in other subfields that have been implicated in spatial processing (e.g., CA1). Further, as connectivity-based functional gradients in the hippocampus do not respect classical subfield boundary definitions, category selectivity may be distributed across anatomical subfields. Region-of-interest approaches, therefore, may limit our ability to observe category selectivity across discrete subfield boundaries. To address these issues, we applied searchlight multivariate pattern analysis to 7T fMRI data of healthy adults who undertook a simultaneous visual odd-one-out discrimination task for scene and non-scene (including face) visual stimuli, hypothesising that scene classification would be possible in multiple hippocampal regions within, but not constrained to, anteromedial subicular complex and CA1. Indeed, we found that the scene-selective searchlight map overlapped not only with anteromedial subicular complex (distal subiculum, pre/para subiculum), but also inferior CA1, alongside posteromedial (including retrosplenial) and parahippocampal cortices. Probabilistic overlap maps revealed gradients of scene category selectivity, with the strongest overlap located in the medial hippocampus, converging with searchlight findings. This was contrasted with gradients of face category selectivity, which had stronger overlap in more lateral hippocampus, supporting ideas of parallel processing streams for these two categories. Our work helps to map the scene, in contrast to, face processing networks within, and connected to, the human hippocampus.