Action comprehension in aphasia: linguistic and non-linguistic deficits and their lesion correlates
Introduction
While aphasia is primarily characterized by disturbance of language functions following brain injury, patients have been observed to also exhibit impairments in nonverbal domains, revealed by tasks such as associating pictures with corresponding objects (De Renzi, Pieczuro, & Vignolo, 1968), colors with pictures (De Renzi, Faglioni, Scotti, & Spinnler, 1972), and environmental sounds with pictures (e.g., Saygin et al., 2003a, Spinnler and Vignolo, 1966). In particular, aphasic patients’ deficits in using and recognizing signs, gestures and pantomime have been examined in numerous studies (e.g., Bell, 1994; Duffy & Duffy, 1981; Gainotti & Lemmo, 1976; Goodglass & Kaplan, 1963; Pickett, 1974; Varney, 1978; Wang & Goodglass, 1992).
In the present study, we examined aphasic patients’ comprehension of visually presented action stimuli in both linguistic and non-linguistic domains. We used a variant of a classical neuropsychological paradigm commonly used to test comprehension in aphasic patients: an object selection task. We had a two-alternative forced-choice (2AFC) design and asked patients to choose the object that best matched visually presented stimuli containing action information. In both the linguistic and the non-linguistic domains, the associated objects upon which the actions should be carried out were removed from the stimuli; thus subjects matched either a sentence missing its object (such as “he is licking the …”), or a picture missing its object (such as a picture of a boy licking an invisible ice-cream cone) to the corresponding object (in this case, the ice-cream cone). We used static black and white drawings of pantomimed actions in our design (like Seron, van der Kaa, Remitz, & van der Linden, 1979) because they are more appropriate visual matches to written text stimuli which are also static in nature.
We had two main goals in this study: (1) to test linguistic and non-linguistic action comprehension at the same time, using the same task, on the same patients, and with stimuli as closely matched as possible, (2) to conduct lesion-symptom mapping analyses using voxel-based lesion symptom mapping (VLSM; Bates et al., 2003b) to identify the lesion correlates of action comprehension deficits.
Regarding the first goal, relationships between linguistic and non-linguistic deficits in aphasic patients are important to examine because they shed light on whether aphasia is a domain-specific disorder which affects only language, or is part of a larger deficit which affects other domains as well. Such questions have been asked since the early days of neurology. Finkelnburg (1870) was the first to propose what is known as the “asymbolia” hypothesis: he suggested that a single underlying factor was common to both the language impairments in aphasia and the deficits in nonverbal domains that these patients exhibit. This idea received some support from subsequent pioneers in neurology as well (e.g., Goldstein, 1948, Head, 1926). On the other hand, it does not seem plausible that aphasia is completely reducible to a strong version of asymbolia, especially given that dissociations in performance between linguistic and non-linguistic domains can be encountered in individual patients.
Even though nonverbal deficits in aphasia have been of interest to researchers for a long time, it has been difficult to assess whether the linguistic and the non-linguistic deficits patients exhibit are related to each other. First, performance on language processing and on non-linguistic tasks must be explored in the same patients. Furthermore, task and stimulus-level factors should be as closely matched as possible. Considerations such as these motivate the first goal of the present study: to contrast linguistic and non-linguistic comprehension of action information in aphasia by comparing performance in the two domains in the same patients more directly than in previous studies. Previous studies seeking correlations between patients’ performance in various language tests and various action comprehension tests do exist, although stimuli and tasks have often not been closely matched across the two domains. While some of these studies found correlations between language impairments and non-linguistic action processing impairments in aphasic patients (e.g., Duffy & Duffy, 1981; Pickett, 1974; Seron et al., 1979, Varney, 1978, Varney, 1982), others found largely uncorrelated performance (e.g., Bell, 1994; Goodglass & Kaplan, 1963; Kimura, 1977).
With regards to the second goal, although it has been known since the early days of neurology that left-hemisphere lesions can often cause receptive and/or expressive disorders in both language and action domains (i.e., aphasic and apraxic disorders) and that patients with right hemisphere injury will rarely exhibit such impairments, the precise lesion sites leading to aphasic and apraxic deficits remain quite unclear. Specifically, results on lesion correlates of impairments in action, pantomime and gesture comprehension deficits are few, and not entirely consistent. Heilman and colleagues have reported that apraxic patients with posterior lesions have more trouble in comprehending the meaning of pantomimes (Heilman et al., 1982, Rothi et al., 1985) and have suggested that posterior parietal regions of the cortex may mediate the production and comprehension of purposeful movements (see also De Renzi et al., 1986, Kertesz et al., 1984). On the other hand, Ferro, Martins, Mariano, and Castro Caldas (1983) reported that while gesture recognition impairments were most commonly associated with parietal lesions in chronic stages of brain damage, in acute stages it was the patients with left frontal and basal ganglia damage who showed deficiencies, but unfortunately this study had a rather small sample size. Other studies failed to find reliable lesion sites associated with deficits (e.g., Schnider, Hanlon, Alexander, & Benson, 1997; Wang & Goodglass, 1992). Recently, Tranel, Kemmerer, Adolphs, Damasio, and Damasio (2003) used more novel lesion-mapping methods and reported that lesions in the left premotor/prefrontal and parietal cortex and in the white matter underlying the left posterior middle temporal cortex are implicated in deficits in tasks which were designed to tap into conceptual knowledge for actions.
There is also a substantial literature on the related question of brain areas differentially involved in the naming of actions versus objects, and/or the processing of verbs versus nouns. Many researchers have argued that left frontal areas are differentially involved in the processing of actions or verbs. For example, in a PET study using a lexical decision task, Perani, Cappa, Schnur, and Tettamanti (1999) found that verbs activated left dorsolateral frontal cortex more than nouns. However, other studies have failed to find significant differences; for instance, Tyler, Russell, Fadili, and Moss (2001), using carefully matched stimuli, did not find any regions differentially involved in the lexical decision or semantic processing of nouns versus verbs. Hillis, Tuffiash, Wityk, and Barker (2002) reported that damage or hypoperfusion in precentral and middle temporal gyri were associated with action naming deficits in patients with acute left hemisphere injury, while for object naming, middle temporal and superior temporal gyri were associated with impairment. However, for comprehension of action and object words, they did not find separate sites; impairments were associated with superior temporal lesions. Hillis et al. suggested in light of this finding that only the naming of actions, rather than semantic knowledge, may be localized to left frontal cortex.
Given the diverse results which have been reported in the literature, we wanted to use VLSM, a quantitative lesion-symptom mapping technique, to contribute to identifying lesion correlates of action comprehension in aphasia in linguistic and non-linguistic domains.
In addition to these two major goals, we had some other points in mind in our design: In line with earlier studies (e.g., Varney, 1978), we also addressed the effect of semantic competition in both domains in order to see if processing in the two domains is similarly modulated by higher-level conceptual constraints. In addition, following Seron et al. (1979), Wang and Goodglass (1992) and Bell (1994), we also used distracters that were related to the targets in the way they may be handled, to see if there are differential effects of this kind of competition (previous researchers termed these morphological, perceptual or motoric distracters; here we refer to these as “affordance-based” distracters; see Gibson, 1977).
Section snippets
Participants
Patients were voluntary participants recruited from the community in San Diego, CA or the VA Northern California Health Care System (VANCHCS) in Martinez, CA, and were paid US$ 25.00 for their participation. Twenty-nine left-hemisphere injured patients with varying types and severity of aphasia participated in the experiment. All aphasic patients were administered the Western Aphasia Battery (WAB; Kertesz, 1979) and were diagnosed as Anomic (N = 9), Broca’s (N = 12), or Wernicke’s aphasics (N =
Results
Here, we report differences in accuracy and reaction time between patient and control groups, the correlation in performance across verbal and nonverbal domains, and the relationship between lesion site and processing deficits.
Action processing impairments in aphasia and their relation to language deficits
Aphasic patients were significantly impaired in our action-to-picture matching task compared with control subjects. Performance was compromised in both linguistic and non-linguistic domains. However, patients tended to show deficits that were more pronounced in the linguistic domain and the severity of aphasia was strongly related to the relative disparity between performance in linguistic and non-linguistic domains. There was no overall correlation between patients’ deficits in the two
Acknowledgements
We are grateful to H. Saygın for help with preparing the picture stimuli, R. Buffington, C. Ludy, S. Moineau, and E. Schleicher for assistance with testing or programming, R.T. Knight for lesion reconstructions, F. Dick, and M. Iacoboni for helpful discussions and all of our subjects for participating in our experiments. We also thank L. Barsalou, G. Goldenberg, the anonymous reviewers, and M. Moscovitch for their suggestions on previous versions of this manuscript, which greatly improved our
References (86)
- et al.
Modulated activation of the human SI and SII cortices during observation of hand actions
NeuroImage
(2002) - et al.
Perception of biological motion in parietal patients
Neuropsychologia
(2003) Pantomime recognition impairment in aphasia: an analysis of error types
Brain and Language
(1994)- et al.
Functional anatomy of intra- and cross-modal lexical tasks
NeuroImage
(2002) - et al.
Neural circuits underlying imitation learning of hand actions: An event-related FMRI study
Neuron
(2004) - et al.
Functional magnetic resonance image analysis of a large-scale neurocognitive network
NeuroImage
(1996) - et al.
Representation of manipulable man-made objects in the dorsal stream
NeuroImage
(2000) - et al.
Ideational apraxia: A quantitative study
Neuropsychologia
(1968) - et al.
Lesion analysis of the brain areas involved in language comprehension
Cognition
(2004) - et al.
The effect of response choice relatedness on pantomime and verbal recognition ability in aphasic patients
Brain and Language
(1984)
Comprehension of symbolic gestures in aphasia
Brain and Language
Matching and imitation of hand and finger postures in patients with damage in the left or right hemispheres
Neuropsychologia
Activations related to “mirror” and “canonical” neurones in the human brain: an fMRI study
NeuroImage
Recognition and imitation of pantomimed motor acts after unilateral parietal and premotor lesions: A perspective on apraxia
Neuropsychologia
Mental imagery in the motor context
Neuropsychologia
Neural simulation of action: A unifying mechanism of motor cognition
NeuroImage
Brain imaging of tongue-twister sentence comprehension: Twisting the tongue and the brain
Brain and Language
Three distinct ventral occipitotemporal regions for reading and object naming
NeuroImage
Premotor cortex and the recognition of motor actions
Cognitive Brain Research
Ideomotor apraxia: Behavioral dimensions and neuroanatomical basis
Brain and Language
Pantomime interpretation and aphasia
Neuropsychologia
Impaired recognition of meaningful sounds in aphasia
Cortex
Pantomime recognition defect in aphasia: Implications for the concept of asymbolia
Brain and Language
Qualitative aspects of pantomime recognition defect in aphasia
Brain and Cognition
Pantomime, praxis, and aphasia
Brain and Language
Perceptual symbol systems
The Behavioral and Brain Sciences
Quantifying dissociations in neuropsychological research
Journal of Experimental and Clinical Neuropsychology
Voxel-based lesion-symptom mapping
Nature Neuroscience
Speech production: Wernicke, Broca and beyond
Brain
Caudate infarcts
Archives of Neurology
PsyScope: An interactive graphic system for designing and controlling experiments in the psychology laboratory using Macintosh computers
Behavior Research Methods, Instruments, and Computers
Models of reading aloud: Dual-route and parallel-distributed-processing approaches
Psychological Review
Limb apraxia in patients with damage confined to the left basal ganglia and thalamus
Journal of Neurology, Neurosurgery and Psychiatry
Impairment in associating colour to form, concomitant with aphasia
Brain
A new brain region for coordinating speech articulation
Nature
Three studies of deficits in pantomimic expression and pantomime recognition in aphasia
Journal of Speech and Hearing Research
Motor facilitation during action observation: a magnetic stimulation study
Journal of Neurophysiology
CT scan correlates of gesture recognition
Journal of Neurology, Neurosurgery and Psychiatry
Functional magnetic resonance imaging of neural activity related to orthographic, phonological, and lexico-semantic judgments of visually presented characters and words
Human Brain Mapping
Action recognition in the premotor cortex
Brain
Cited by (128)
Anterior insula as a gatekeeper of executive control
2022, Neuroscience and Biobehavioral ReviewsWhat modulates the Mirror Neuron System during action observation?: Multiple factors involving the action, the actor, the observer, the relationship between actor and observer, and the context
2021, Progress in NeurobiologyCitation Excerpt :Another fMRI study found that when subjects judged sequences of three static body postures, responses in primary and supplementary motor areas were greater when those sequences were natural and fluent (ABC) than when they were unnatural and nonfluent (ACB) (Orgs et al., 2016). In addition, a number of neuropsychological and TMS studies have shown that real or virtual lesions to left inferior frontal, premotor, primary motor, and/or inferior parietal regions impair performance on nonlinguistic tasks that require judgments about static action stimuli (Tranel et al., 2003; Bak and Hodges, 2004; Saygin et al., 2004; Hillis et al., 2006; Urgesi et al., 2007; Moro et al., 2008; Fazio et al., 2009; Kemmerer et al., 2012). Furthermore, a TMS study showed that, compared with static images of either a relaxed hand or a hand at the endpoint of an action, static images of a hand executing a thumb-forefinger pincer grip increased the excitability of the muscles that would perform that action; those muscles were not affected, however, by static images of nonbiological entities with (e.g., waterfalls) or without (e.g., icefalls) implied motion (Urgesi et al., 2006; for follow-up studies see Urgesi et al., 2010, and Mattiassi et al., 2014; and for contrary data see Bunday et al., 2016).
Grey and white matter substrates of action naming
2019, Neuropsychologia
- †
Elizabeth Bates, Professor of Cognitive Science at the University of California, San Diego, passed away December 13, 2003.