 |
The Journal of Neuroscience, January 4, 2006, 26(1):73-85; doi:10.1523/JNEUROSCI.2356-05.2006
Previous Article | Next Article 
Behavioral/Systems/Cognitive
Visual and Nonvisual Contributions to Three-Dimensional Heading Selectivity in the Medial Superior Temporal Area
Yong Gu,
Paul V. Watkins,
Dora E. Angelaki, * and
Gregory C. DeAngelis *
Departments of Neurobiology and Biomedical Engineering, Washington University School of Medicine, St. Louis, Missouri 63110
Robust perception of self-motion requires integration of visual motion signals with nonvisual cues. Neurons in the dorsal subdivision of the medial superior temporal area (MSTd) may be involved in this sensory integration, because they respond selectively to global patterns of optic flow, as well as translational motion in darkness. Using a virtual-reality system, we have characterized the three-dimensional (3D) tuning of MSTd neurons to heading directions defined by optic flow alone, inertial motion alone, and congruent combinations of the two cues. Among 255 MSTd neurons, 98% exhibited significant 3D heading tuning in response to optic flow, whereas 64% were selective for heading defined by inertial motion. Heading preferences for visual and inertial motion could be aligned but were just as frequently opposite. Moreover, heading selectivity in response to congruent visual/vestibular stimulation was typically weaker than that obtained using optic flow alone, and heading preferences under congruent stimulation were dominated by the visual input. Thus, MSTd neurons generally did not integrate visual and nonvisual cues to achieve better heading selectivity. A simple two-layer neural network, which received eye-centered visual inputs and head-centered vestibular inputs, reproduced the major features of the MSTd data. The network was trained to compute heading in a head-centered reference frame under all stimulus conditions, such that it performed a selective reference-frame transformation of visual, but not vestibular, signals. The similarity between network hidden units and MSTd neurons suggests that MSTd may be an early stage of sensory convergence involved in transforming optic flow information into a (head-centered) reference frame that facilitates integration with vestibular signals.
Key words: monkey; MST; optic flow; heading; visual; vestibular
Received June 8, 2005;
revised September 16, 2005;
accepted November 1, 2005.
This article has been cited by other articles:

|
 |

|
 |
 
S. A. Chowdhury, K. Takahashi, G. C. DeAngelis, and D. E. Angelaki
Does the Middle Temporal Area Carry Vestibular Signals Related to Self-Motion?
J. Neurosci.,
September 23, 2009;
29(38):
12020 - 12030.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
S. Liu and D. E. Angelaki
Vestibular Signals in Macaque Extrastriate Visual Cortex Are Functionally Appropriate for Heading Perception
J. Neurosci.,
July 15, 2009;
29(28):
8936 - 8945.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
V. Marlinski and R. A. McCrea
Self-Motion Signals in Vestibular Nuclei Neurons Projecting to the Thalamus in the Alert Squirrel Monkey
J Neurophysiol,
April 1, 2009;
101(4):
1730 - 1741.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
A. S. Bryan and D. E. Angelaki
Optokinetic and Vestibular Responsiveness in the Macaque Rostral Vestibular and Fastigial Nuclei
J Neurophysiol,
February 1, 2009;
101(2):
714 - 720.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
P. R. MacNeilage, N. Ganesan, and D. E. Angelaki
Computational Approaches to Spatial Orientation: From Transfer Functions to Dynamic Bayesian Inference
J Neurophysiol,
December 1, 2008;
100(6):
2981 - 2996.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
A. Chen, Y. Gu, K. Takahashi, D. E. Angelaki, and G. C. DeAngelis
Clustering of Self-Motion Selectivity and Visual Response Properties in Macaque Area MSTd
J Neurophysiol,
November 1, 2008;
100(5):
2669 - 2683.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
G. Kovacs, M. Raabe, and M. W. Greenlee
Neural Correlates of Visually Induced Self-Motion Illusion in Depth
Cereb Cortex,
August 1, 2008;
18(8):
1779 - 1787.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
M. Ruiz-Ruiz and J. C. Martinez-Trujillo
Human Updating of Visual Motion Direction During Head Rotations
J Neurophysiol,
May 1, 2008;
99(5):
2558 - 2576.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
V. Marlinski and R. A. McCrea
Activity of Ventroposterior Thalamus Neurons During Rotation and Translation in the Horizontal Plane in the Alert Squirrel Monkey
J Neurophysiol,
May 1, 2008;
99(5):
2533 - 2545.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
A. Bartels, S. Zeki, and N. K. Logothetis
Natural Vision Reveals Regional Specialization to Local Motion and to Contrast-Invariant, Global Flow in the Human Brain
Cereb Cortex,
March 1, 2008;
18(3):
705 - 717.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
M. De Vrijer, W. P. Medendorp, and J.A.M. Van Gisbergen
Shared Computational Mechanism for Tilt Compensation Accounts for Biased Verticality Percepts in Motion and Pattern Vision
J Neurophysiol,
February 1, 2008;
99(2):
915 - 930.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
G. A. Orban
Higher Order Visual Processing in Macaque Extrastriate Cortex
Physiol Rev,
January 1, 2008;
88(1):
59 - 89.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
H. Meng, P. J. May, J. D. Dickman, and D. E. Angelaki
Vestibular Signals in Primate Thalamus: Properties and Origins
J. Neurosci.,
December 12, 2007;
27(50):
13590 - 13602.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
K. Takahashi, Y. Gu, P. J. May, S. D. Newlands, G. C. DeAngelis, and D. E. Angelaki
Multimodal Coding of Three-Dimensional Rotation and Translation in Area MSTd: Comparison of Visual and Vestibular Selectivity
J. Neurosci.,
September 5, 2007;
27(36):
9742 - 9756.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
C. R. Fetsch, S. Wang, Y. Gu, G. C. DeAngelis, and D. E. Angelaki
Spatial Reference Frames of Visual, Vestibular, and Multimodal Heading Signals in the Dorsal Subdivision of the Medial Superior Temporal Area
J. Neurosci.,
January 17, 2007;
27(3):
700 - 712.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
S. Ono and M. J. Mustari
Extraretinal Signals in MSTd Neurons Related to Volitional Smooth Pursuit
J Neurophysiol,
November 1, 2006;
96(5):
2819 - 2825.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
F. Klam and W. Graf
Discrimination between active and passive head movements by macaque ventral and medial intraparietal cortex neurons
J. Physiol.,
July 15, 2006;
574(2):
367 - 386.
[Abstract]
[Full Text]
[PDF]
|
 |
|
|

|