Elsevier

Neuropsychologia

Volume 50, Issue 10, August 2012, Pages 2467-2476
Neuropsychologia

Imagined tool-use in near and far space modulates the extra-striate body area

https://doi.org/10.1016/j.neuropsychologia.2012.06.018Get rights and content

Abstract

Active tool-use can result in the incorporation of the tool into the body schema, e.g., the representation of the arm is enlarged according to tool length. This modification even influences the processing of space: using a long tool leads to a remapping of far space as near space. We here further investigate the interaction of the neural representations of the human body, tool use, and spatial domain.

Functional magnetic resonance imaging (fMRI) was performed in twelve right-handed healthy individuals while they imagined moving a cylinder towards a target position in far or near space by mentally using either pliers or a joystick. The fMRI data revealed that already the imagined use of preferred tools in near and far space (i.e., pliers in far space, joystick in near space) modulated the neural activity in the extra-striate body area (EBA) located in the occipito-temporal cortex. Moreover, psycho-physical interaction analysis showed that during imagined tool-use the functional connectivity of left EBA to a network representing the near-personal space around the hand was strengthened. This increased functional connectivity is likely to reflect the neural processes underlying the incorporation of the tool into the body schema.

Thus, the current data suggest that simulating tool-use modulates the representation of the human body in extra-striate cortex.

Highlights

► Interaction of human body, tool use, and spatial domain representations. ► EBA represents the human body in a multisensory and dynamic manner. ► The imagined use of appropriate tools in near and far space modulated EBA. ► Simulating tool-use alters the representation of the human body in EBA.

Introduction

Understanding how the human body is represented in the human brain is an important prerequisite to elucidate the neural bases of body schema disorders observed in neurological patients suffering from neglect, apraxia, autotopagnosia or phantom limb experiences (Rumiati, Papeo, & Corradi-Dell'Acqua, 2010). Moreover, this understanding is likely to be essential for the development of efficient prosthesis and brain–computer-interfaces (Donoghue, 2008, Hochberg et al., 2006, Scott, 2004, Scott, 2008, Velliste et al., 2008). The body schema is a continuously updated map of body shape and posture (Maravita & Iriki, 2004). This map contains and combines sensory afferences and motor efferences. This central representation of the current position of body parts and the body's spatial properties (updated during body movement) is a prerequisite for the spatial organization of an action. Particularly relevant for our study, the notion of a body schema can be related to multisensory spatial integration within (peri-personal) space and its neural substrates (Maravita, Spence, & Driver, 2003).

One important feature of the body schema is that it is flexible and dynamic. Behavioral, electrophysiological, and imaging studies in non-human primates and humans showed that the use of tools modifies the neural representation of the body so that the tool is incorporated into the body schema (Corradi-Dell'Acqua et al., 2008, Holmes and Spence, 2004, Inoue et al., 2001, Iriki et al., 1996, Obayashi et al., 2001). This modification of the neural representation of the human body even influences the processing of space: using a long tool leads to a remapping of far space as near space (Berti & Frassinetti, 2000). Repeatedly manipulating a tool to reach beyond body space establishes a strong association between the body part using the tool (hand/arm), the tool itself, and the spatial domain (i.e., far space), in which the tool is used. Thus, reaching for distant objects using a stick or a rake may alter the body-schema as if the hand was elongated to the tip of the tool (e.g., (Inoue et al., 2001; Iriki et al., 1996; Obayashi et al., 2001)). Electrophysiological studies in non-human primates revealed that polymodal cells responding to both tactile and visual information (with spatially congruent receptive fields in these modalities) constitute the neural basis for this phenomenon: when a monkey uses a rake to retrieve distant objects, visual receptive fields of visual-tactile cells are enlarged along the axis of the rake (Iriki et al., 1996). As a consequence, polymodal neurons which previously responded to stimuli around the hand, then also respond to visual stimuli at the far end of the rake. Consistent with these neurophysiological findings, imaging studies revealed corresponding changes in neural activity during actual tool-use in far space in both monkeys (Obayashi et al., 2001) and humans (Inoue et al., 2001).

However, the neural processes underlying the complex interaction of the neural representation of the human body, tool use, and spatial domain to date remain poorly understood (Scott H. Frey, 2004). Previous studies implicated the extrastriate body area (EBA) (Downing, Jiang, Shuman, & Kanwisher, 2001) in the representation of human body parts. Importantly, the EBA does not only seem to be involved in the visual processing of static body representations (Astafiev et al., 2004, Downing et al., 2001, Peelen and Downing, 2005, Peelen and Downing, 2007), but is also activated by many other body-part related processes including self generated (Astafiev et al., 2004) and goal directed (Takahashi et al., 2008) movements (even when the limb is not visible (Astafiev et al., 2004)), visual imagery of haptic exploration of body parts (Costantini, Urgesi, Galati, Romani, & Aglioti, 2011), as well as reaching to kinesthetically defined targets (Darling, Seitz, Peltier, Tellmann, & Butler, 2007). Thus, EBA represents the parts of the human body in a multisensory and dynamic manner (Astafiev et al., 2004, Costantini et al., 2011).

The current functional imaging study investigated whether EBA activity is already modulated by simulating tool-use actions without seeing or moving any body part. In particular, we hypothesized that imagining the use of an ‘appropriate’ tool for the respective spatial domain (defined by preference; here: pliers in far space and joystick in near space) would specifically alter neural activity in the EBA indicating an adaptation of the neural representation of the human body by motor simulation of tool use. Previous studies showed that situations in which there is an incongruency between body or action representations and movement-related visual signals activate EBA, thereby indicating that EBA represents the human body in a dynamic manner (David et al., 2007). By manipulating the visual feedback of the subjects’ joystick-movement in half of the trials, EBA was more active when the visual feedback was incongruent to the subjects’ own executed movements (David et al., 2007). Interestingly, in the same study EBA showed enhanced functional connectivity to posterior parietal cortex when visual feedback and joystick movements were congruent. In our study, participants imagined using one of two tools (joystick or long pliers) in order to virtually move objects around a circle at two displayed distances in near and far virtual space. Using simulated rather than actual tool-use movements reduced many confounding factors which would be triggered by overt actions or their perception. Any EBA activity observed during actual tool-use movements could be triggered by tool-induced body schema changes, but also by seeing/perceiving the moving body parts. Therefore, simulated tool-use actions are better suited to attribute changes of EBA activity either to the modulation of the body schema or to actually seeing/perceiving moving body parts. With respect to the current fMRI-investigation, actual tool-use would also have been prone to movement artefacts during scanning. Moreover, the visible moving pliers during actual tool-use would have led to strong visual differences of the stimuli compared to the joystick conditions. In contrast, relying on simulated tool-use allowed keeping the visual scene almost identical across conditions (only the little arrow pointing to either the pliers or the joystick changed location, see Fig. 1a). Given past evidence (Farnè and Làvadas, 2000, Inoue et al., 2001, Iriki et al., 1996, Maravita and Iriki, 2004, Obayashi et al., 2001) we expected that the pliers would be more effective at inducing plasticity in the representation of the upper limb when movements were simulated in far space, while the joystick (given its habitual use to move objects on a PC screen, i.e., usually located in near space) would rather induce such changes for movements being simulated in near space (Obayashi et al., 2002, Obayashi et al., 2004). It should be noted, that these two tools differ also in other ways. For instance, while joysticks are predominately used in near space (e.g., on one's desk), pliers can be used both in far, and, although uncomfortably, in near space. Pliers need to be lifted and are then manipulated with the opening and closing of the hand (i.e., more distal movements), while a joystick is stationary and (after grasping it with a whole hand grip) is usually operated by more proximal arm movements. Pliers and joystick also involve two qualitatively different movements and thus implied motion types. However, the current experimental design was factorial (factors tool and space). Therefore, both tools and thus both types of imagined tool-use movements (and hence implied motion types) were similarly present in the conditions involving near and far space. In the interaction term (space x tool), such ‘confounding factors’ (as different tool-related actions) are controlled for since the interaction term constitutes the difference of the differences ([F_P>F_J]>[N_P>N_J]). Thus, any differential activity we find for the interaction term cannot simply be explained by differences in simulating these two actions per se or by the implied motion that goes along with it.

Functional magnetic resonance imaging (fMRI) was performed in twelve right-handed healthy individuals while they imagined moving a red cylinder towards a target position in far or near space by mentally using either pliers or a joystick. They were asked to determine which of the two possible directions (clockwise or counter-clockwise) would provide the shortest path for transporting the cylinder. Whether tool-use induced modulations might occur also during motor imagery of tool-use, in absence of any overt movement and tactile feedback from the tool, is unknown. In light of the striking parallelism between motor imagery and motor execution (e.g., (Decety et al., 1994; Gerardin et al., 2000; Parsons et al., 1995; Stephan et al., 1995)), it could be predicted that already imagined tool-use may be sufficient to trigger specific changes of neural activity. While a dissociation between near and far mental space (in neglect) has been described (Ortigue et al., 2003), to date no study investigated yet the interaction of simulated tool-use with far and near (mental) space. Taking into account that Uddin and colleagues revealed a strong functional and structural connectivity between the parietal cortex and the lateral occipital cortex (containing putative EBA; (Uddin et al., 2010)), a modulation of these areas (or their connectivity) by simulating the use of a tool appropriate for the given spatial domain could be expected.

Based on our hypothesis that imagining the use of an appropriate tool for the respective spatial domain (here: pliers in far space and joystick in near space) would specifically draw on the body schema, the key analysis of the fMRI data relies on the interaction between spatial domain and tool. Furthermore, psycho-physical interaction (PPI) analyses were performed with bilateral EBA (as revealed by the interaction analysis) as seeds to assess the areas with increased connectivity with EBA during simulated tool-use.

Section snippets

Subjects

Twelve (7 males) right-handed (Edinburgh Inventory, (Oldfield, 1971)) healthy subjects (age range 24–37 years, mean 30.5 years) with no past or present neurological or psychiatric disease gave informed consent to participate in the study. The study was approved by the local ethics committee.

Stimuli

Stimuli were created by using open source software (Blender, www.blender.org) with 3D-features to mimic far and near space (Fig. 1a) and depicted a chair and a green table with a size that would correspond

Behavioral results

All subjects were good at forming mental images as judged by the Movement Imagery questionnaire (kinesthetic/motor: 6±0.9; visual: 5.8±0.5; (Hall & Martin, 1997)). Overall, the mean rate of kinesthetic sensations subjects felt at the right arm/hand was 5.7 during imagined tool-use (using a 1 to 7 scale).

All subjects reported that simulating tool use in far or in near space was comparably difficult and that they properly switched between far and near space throughout the experiment. Ten (of the

Discussion

The neural representation of the human body is dynamic, rather than static. Here, we show for the first time that brain regions involved in body (part) processing are modulated already by motor imagery of tool-use, even in the absence of any overt movement or visual feedback from the acting limb/simulated movement. This finding confirms and extends previous research on the neural representation of the human body (Berti and Frassinetti, 2000, Corradi-Dell'Acqua et al., 2008, Holmes and Spence,

Acknowledgments

We would like to thank the volunteers and our colleagues from the Cognitive Neuroscience (INM-3) and Physics of Medical Imaging (INM-4) sections. We are very gratefully to Dr. I. Baldinotti for his help in preparing the stimuli. The Alexander von Humboldt foundation is gratefully acknowledged for supporting BT.

References (89)

  • J.P. Gallivan et al.

    Neuroimaging reveals enhanced activation in a reach-selective brain area for objects located within participants’ typical hand workspaces

    Neuropsychologia

    (2011)
  • M.J. Giummarra et al.

    Mechanisms underlying embodiment, disembodiment and loss of embodiment

    Neuroscience and Biobehavioral Review

    (2008)
  • E.D. Grossman et al.

    Brain areas active during visual perception of biological motion

    Neuron

    (2002)
  • R.J. Howard et al.

    A direct demonstration of functional specialization within motion-related visual and auditory cortex of the human brain

    Current Biology

    (1996)
  • K. Inoue et al.

    Activation in the ipsilateral posterior parietal cortex during tool use: a PET study

    Neuroimage

    (2001)
  • I. Kontaris et al.

    Dissociation of extrastriate body and biological-motion selective areas by manipulation of visual-motor congruency

    Neuropsychologia

    (2009)
  • A. Maravita et al.

    Tools for the body (schema)

    Trends in Cognitive Sciences

    (2004)
  • A. Maravita et al.

    Multisensory integration and the body schema: close to hand and within reach

    Current Biology

    (2003)
  • S. Obayashi et al.

    Functional brain mapping of monkey tool use

    Neuroimage

    (2001)
  • R.C. Oldfield

    The assessment and analysis of handedness: the Edinburgh inventory

    Neuropsychologia

    (1971)
  • D.J. Quinlan et al.

    fMRI reveals a preference for near viewing in the human parieto-occipital cortex

    Neuroimage

    (2007)
  • R. Saxe et al.

    Divide and conquer: a defense of functional localizers

    Neuroimage

    (2006)
  • B. Tomasino et al.

    Dissociation between the mental rotation of visual images and motor images in unilateral brain-damaged patients

    Brain and Cognition

    (2003)
  • B. Tomasino et al.

    Stimulus properties matter more than perspective: an fMRI study of mental imagery and silent reading of action phrases

    Neuroimage

    (2007)
  • K.S. Weiner et al.

    Sparsely-distributed organization of face and limb activations in human ventral temporal cortex

    Neuroimage

    (2010)
  • K.S. Weiner et al.

    Not one extrastriate body area: using anatomical landmarks, hMT+, and visual field maps to parcellate limb-selective activations in human lateral occipitotemporal cortex

    Neuroimage

    (2011)
  • S. Arzy et al.

    Neural basis of embodiment: distinct contributions of temporoparietal junction and extrastriate body area

    The Journal of Neuroscience

    (2006)
  • S.V. Astafiev et al.

    Extrastriate body area in human occipital cortex responds to the performance of motor actions

    Nature Neuroscience

    (2004)
  • A. Berti et al.

    When far becomes near: re-mapping of space by tool use

    Journal of Cognitive Neuroscience

    (2000)
  • O. Blanke et al.

    Mental imagery for full and upper human bodies: common right hemisphere activations and distinct extrastriate activations

    Brain Topography

    (2010)
  • E. Bonda et al.

    Specific involvement of human parietal systems and the amygdala in teh perception of biological motion

    Journal of Neuroscience

    (1996)
  • Bracci, S., Cavina-Pratesi, C., Ietswaart, M., Caramazza, A., & Peelen, M.V. (2011). Closely overlapping responses to...
  • S. Bracci et al.

    Dissociable neural responses to hands and non-hand body parts in human left extrastriate visual cortex

    Journal of Neurophysiology

    (2010)
  • C. Brozzoli et al.

    FMRI adaptation reveals a cortical mechanism for the coding of space near the hand

    Journal of Neuroscience

    (2011)
  • A.W.Y. Chan et al.

    The effect of viewpoint on body representation in the extrastriate body area

    NeuroReport

    (2004)
  • C. Corradi-Dell'Acqua et al.

    Where is a nose with respect to a foot? The left posterior parietal cortex processes spatial relationships among body parts

    Cerebral Cortex

    (2008)
  • C. Corradi-Dell'Acqua et al.

    What is the position of an arm relative to the body? Neural correlates of body schema and body structural description

    Journal of Neuroscience

    (2009)
  • E.S. Cross et al.

    Contorted and ordinary body postures in the human brain

    Experimental Brain Research

    (2010)
  • W.G. Darling et al.

    Visual cortex activation in kinesthetic guidance of reaching

    Experimental Brain Research

    (2007)
  • J. Decety et al.

    Mapping motor representations with PET

    Nature

    (1994)
  • E. Disbrow et al.

    Somatotopic organization of cortical fields in the lateral sulcus of homo sapiens: Evidence for SII and PV

    Journal of Comparative Nerology

    (2000)
  • P.E. Downing et al.

    A cortical area selective for visual processing of the human body

    Science

    (2001)
  • P.E. Downing et al.

    The role of occipitotemporal body-selective regions in person perception

    Cognitive Neuroscience

    (2011)
  • P.E. Downing et al.

    Functional magnetic resonance imaging investigation of overlapping lateral occipitotemporal activations using multi-voxel pattern analysis

    Journal of Neuroscience

    (2007)
  • Cited by (24)

    • Body-tool integration: past, present, and future

      2023, Cognitive Archaeology, Body Cognition, and the Evolution of Visuospatial Perception
    • Objects with motor valence affect the visual processing of human body parts: Evidence from behavioural and ERP studies

      2022, Cortex
      Citation Excerpt :

      In fact, the body (and its parts) is considered a special object for its relevance in many cognitive functions such as self-awareness, motor control and social communication. Critically, it has been argued that EBA is not a purely perceptual area, but it might also provide an interface between perceptual and motor processes (Astafiev et al., 2004; Bracci et al., 2012; David et al., 2007; Gallivan, McLean, Valyear, Pettypiece, & Culham, 2011; Kühn, Keizer, Rombouts, & Hommel., 2011; Limanowski, Lutti, & Blankenburg, 2014; Orgs et al., 2016; Simos et al., 2017; Tomasino, Weiss, & Fink, 2012). Remarkably, in our task, all targets were body parts yet, in the Unrelated condition, the N200 (and P300) amplitude significantly differed from the Related one.

    • Smartphone use can modify the body schema: An ERP study based on hand mental rotation task

      2022, Computers in Human Behavior
      Citation Excerpt :

      In addition to evidence from distance perceptual aspect, it is found that the efficiency of visual detection for stimulus presented on the tool significantly increases after trained tool use, suggesting the update of body schema (Jovanov et al., 2015; Kao & Goodale, 2009). Moreover, neurophysiological and neuropsychological studies further provide compelling evidence to the conclusion that tool-use experience can modify the body schema (Holmes, 2012; Homes & Spence, 2004; Inoue et al., 2001; Iriki et al., 1996; Tomasino et al., 2012). Iriki et al. (1996) reported that the trained macaque monkeys’ visual receptive fields were expanded by covering the entire area of hand and the tool, which demonstrated that tool use promoted the process of tool embodiment.

    • Interactions between emotion and action in the brain

      2020, NeuroImage
      Citation Excerpt :

      The EBA site in the middle temporal gyrus has also been shown to be engaged by emotion-laden stimuli (Grosbras and Paus, 2006; Ponseti et al., 2006; Grèzes et al., 2007; Peelen et al., 2007; Pichon et al., 2008; Flaisch et al., 2009; Sinke et al., 2010; Kret et al., 2011; Kveraga et al., 2015; Van den Stock et al., 2015). It has been proposed that the function of this area goes beyond the mere perception of body shape, as it might provide an interface between perceptual and motor processes (Astafiev et al., 2004; David et al., 2007; Kuhn et al., 2011; Tomasino et al., 2012; Limanowski et al., 2014; Orgs et al., 2016; Simos et al., 2017). For example, Zimmermann et al. (2017) suggested that the middle temporal gyrus/EBA interacts more strongly with dorsal-stream regions, when compared to other portions of the occipito-temporal cortex involved in processing body parts and object identification, and proposed that the area contributes to planning goal-directed actions.

    • Far space remapping by tool use: A rTMS study over the right posterior parietal cortex

      2015, Brain Stimulation
      Citation Excerpt :

      Objects located outside the reaching distance can be brought into reachable space using a rake and so processed by dorsal stream mechanisms [27]. More recently, in an fMRI study, Tomasino et al. [54] by using only imagined movements, showed that IPS may be modulated during motor imagery of tool use [55], as well as during actual execution in the far space [27,44,45,56]. In conclusion, our study demonstrate that space representation is dynamically modulated by the position of the target in space and by the use of tool.

    View all citing articles on Scopus
    View full text