The Journal of Neuroscience, August 26, 2009, 29(34):10573-10581; doi:10.1523/JNEUROSCI.0559-09.2009
Previous Article | Next Article 
Behavioral/Systems/Cognitive
Natural Scene Categories Revealed in Distributed Patterns of Activity in the Human Brain
Dirk B. Walther,1
Eamon Caddigan,1,2
Li Fei-Fei,3 * and
Diane M. Beck1,2 *
1Beckman Institute for Advanced Science and Technology, University of Illinois Urbana-Champaign, Urbana, Illinois, 61801-2325, 2Department of Psychology, University of Illinois at Urbana-Champaign, Champaign, Illinois 61820-6232, and 3Computer Science Department, Stanford University, Stanford, California 94305-9025
Correspondence should be addressed to Dr. Dirk B. Walther, Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, 405 North Mathews Avenue, Urbana, IL 61801-2325. Email: walther{at}illinois.edu
Human subjects are extremely efficient at categorizing natural scenes, despite the fact that different classes of natural scenes often share similar image statistics. Thus far, however, it is unknown where and how complex natural scene categories are encoded and discriminated in the brain. We used functional magnetic resonance imaging (fMRI) and distributed pattern analysis to ask what regions of the brain can differentiate natural scene categories (such as forests vs mountains vs beaches). Using completely different exemplars of six natural scene categories for training and testing ensured that the classification algorithm was learning patterns associated with the category in general and not specific exemplars. We found that area V1, the parahippocampal place area (PPA), retrosplenial cortex (RSC), and lateral occipital complex (LOC) all contain information that distinguishes among natural scene categories. More importantly, correlations with human behavioral experiments suggest that the information present in the PPA, RSC, and LOC is likely to contribute to natural scene categorization by humans. Specifically, error patterns of predictions based on fMRI signals in these areas were significantly correlated with the behavioral errors of the subjects. Furthermore, both behavioral categorization performance and predictions from PPA exhibited a significant decrease in accuracy when scenes were presented up-down inverted. Together these results suggest that a network of regions, including the PPA, RSC, and LOC, contribute to the human ability to categorize natural scenes.
Received Jan. 30, 2009;
revised May 21, 2009;
accepted July 8, 2009.
Correspondence should be addressed to Dr. Dirk B. Walther, Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, 405 North Mathews Avenue, Urbana, IL 61801-2325. Email: walther{at}illinois.edu