There has been a long controversy concerning whether the amygdala's response to emotional stimuli is automatic or dependent on attentional load. Using magnoencephalography and an advanced beamformer source localization technique, we found that amygdala automaticity was a function of time: while early amygdala responding to emotional stimuli (40–140 ms) was unaffected by attentional load, later amygdala response (280–410 ms), subsequent to frontoparietal cortex activity, was modulated by attentional load.
There has been considerable debate regarding the automaticity of the amygdala response to emotional stimuli. Rodent data indicate that the amygdala responds to emotional stimulation through a fast but coarse subcortical (thalamus–amygdala) processing stream in parallel to a slower, more detail-oriented, cortical pathway (Quirk et al., 1995, 1997; LeDoux, 2000). It has been proposed that these dual routes are present in humans too, and because of the existence of the subcortical route, the amygdala's response to emotional stimuli is largely automatic and can occur independently of attention (de Gelder et al., 2003; Vuilleumier et al., 2003; Whalen et al., 2004; for review, see Dolan and Vuilleumier, 2003; Johnson, 2005). Others have suggested that it is unlikely that representations of emotional stimuli are independent of representational competition and that increased attention to nonemotional stimulus features should significantly reduce the amygdala's response to emotional stimulus features (Pessoa et al., 2002; Bishop et al., 2007; Blair et al., 2007; Mitchell et al., 2008; Pessoa, 2009; for review, see Pessoa and Ungerleider, 2004). It is possible, however, that this debate has been fostered by the limited temporal resolution of blood oxygenation level-dependent (BOLD) functional magnetic resonance imaging (fMRI) data. There may be a rapid, automatic amygdala response to emotional stimuli, possibly via the subcortical route, that is contaminated because of the limited temporal properties of the BOLD response by a slower, attentionally modulated response. If this is true, it can be predicted that there is an early amygdala response that is relatively independent of attentional control and a later amygdala response to the same emotional stimuli that is subject to significant attentional modulation.
To test this hypothesis, it is necessary to use techniques with good temporal and spatial resolution. Magnetoencephalography (MEG), combined with the advanced source analysis technique synthetic aperture magnetometry (SAM) and a sliding window analysis, is ideal for this purpose (for details, see supplemental Methods, available at www.jneurosci.org as supplemental material). While there has been debate regarding the ability of MEG to identify activity in subcortical nuclei (Vrba and Robinson, 2001, 2002), previous work from a variety of laboratories has demonstrated the ability of MEG to detect a signal from deep structures such as hippocampus (Rogers et al., 1991; Ioannides et al., 1995) and amygdala (Ioannides et al., 1995; Streit et al., 2003) even when using evoked field methods. Moreover, SAM uses the second-order covariance between channels rather than single-channel averages and thus is sensitive to spatially correlated activity. As such, it is more sensitive to deep structure activity (Vrba and Robinson, 2001, 2002). Indeed, recent studies using SAM have reported robust amygdala signals over time (Cornwell et al., 2007; Luo et al., 2007, 2009).
We focused on gamma band oscillations as they are considered to be of particular importance for cognition (Singer, 1999; Varela et al., 2001; Bichot et al., 2005; Fries et al., 2007) and emotion (Keil et al., 2001; Oya et al., 2002; Luo et al., 2007; Desmond et al., 2008) and have a demonstrable relationship with the BOLD response (Logothetis et al. 2001; Niessing et al., 2005). An adapted form of an attentional interference paradigm (Erthal et al., 2005) was used in the present study.
Materials and Methods
Sixteen volunteers (eight males) aged between 22 and 41 years participated. All gave written informed consent and the study was approved by the National Institute of Mental Health Institutional Review Board.
This paradigm, adapted from Erthal et al. (2005), involved a 2 (task load: high, low) × 2 (distracter: fearful, neutral) design. Each trial involved the participant responding to a stimulus array containing a face (fearful or neutral) bracketed between two lines by judging, via button press, whether the lines were parallel or not. Task load was manipulated by varying the angular difference of the bars on nonparallel trials (90° for low-load and 15° for high-load trials). The participant received 208 trials (52 trials in each of the four conditions). The face stimuli (50% male) were selected from the NimStim Face Stimulus Set (http://www.macbrain.org/resource.htm). We cut away the hair and transformed the photos into grayscale.
Each trial lasted 2600 ms (Fig. 1). For the initial 300 ms, the participant received the stimulus: a face bracketed by two lines. There was then a 200 ms blank screen before the response window was presented for 1500 ms. They responded by pressing either the left (S: same) or the right (D: different) button after seeing the response cue (S D). The response window was followed by a second blank screen lasting 600 ms. Stimuli were presented within Presentation software (Neurobehavioral Systems).
MEG data were recorded at 600 Hz using a 275 channel CTF whole-head MEG system in a shielded environment. The CTF MEG system is equipped with synthetic third gradient balancing, an active noise cancellation technique that uses a set of reference channels to subtract background interference. The resulting noise floor is on the order of 5–7 fT above 1 Hz. At the beginning and end of each measurement, the participant's head position was registered with localization coils that were placed at the nasion and the bilateral preauricular points. It was required that head movements did not exceed 0.5 cm. By registration of the head position at these three points, the MEG data could be superimposed on the individual anatomical images with an accuracy of a few millimeters. High-resolution anatomical MRI images were acquired using a T1-weighted, three-dimensional, spoiled GRASS (gradient-recalled acquisition in steady state) imaging sequence (1 × 1 × 1.5 mm3) with a 1.5 tesla GE scanner.
The VSM/CTF software and software developed at the National Institute of Mental Health (NIMH) MEG Core Facility (Bethesda, MD) together with AFNI (http://afni.nimh.nih.gov/afni/) were used for data processing. Before doing SAM analysis, the data were marked according to the four trial types. A multisphere head model was created for each participant based the anatomical image of each participant. The advantage of using a multisphere over a single-sphere model is that in the former each sphere (one per MEG sensor) is fitted to a small patch of the head model (directly under the sensor) to better model the local return currents.
Time–frequency results provide a view of neuromagnetic signals represented over frequency across time. The results would help us to determine the specific frequency range of our analysis in the gamma band. Here, we performed a time–frequency analysis (0–100 Hz) based on averaged signals of the whole brain. The Ctf2st software developed by the NIMH MEG Core Facility (http://kurage.nimh.nih.gov/meglab/Meg/Ctf2st) was adopted. Ctf2st performs Stockwell time–frequency analysis within Matlab. To be consistent with later SAM analyses, the control window was −150 to 0 ms, and the active window was 0 to 500 ms. This was done on the averaged data on all the participants. The group time–frequency results were then contrasted with zero and thresholded at p < 0.05.
Sliding window SAM analysis.
In the present analysis, SAM was then used to analyze task-related activation differences in the gamma frequency band (30–50 Hz). To obtain an image of the dynamic spatiotemporal development of the brain's activity, a sliding window analysis was used in combination with SAM. With a window length of 150 ms and a step of 10 ms, we estimated the signal power in each voxel by using dual-state SAM imaging in which the control state (baseline) was the 150 ms before stimulus onset (or −150 to 0 ms), and the active state was a 150 ms window sliding with a 10 ms step: 150 to 0 ms, −140 to 10 ms, −130 to 20 ms, etc. The dual-state SAM output was the contrast between the active state and the control state. With sliding window SAM, we could obtain information regarding when significant gamma band oscillations emerged, peaked, and offset. For example, if significant gamma band oscillations in a region were not seen in the “−110 to 40 ms” window but seen in the “−100 to 50 ms” window, then we could infer that the onset of gamma band oscillations in this region was between 40 and 50 ms. Fifty dual-state SAM imaging analyses were performed with a spatial resolution of 7 mm. The output results were then concatenated, enabling us to obtain a time course in combination with spatial activation maps across all the time points starting from 150 ms before the stimulus to 500 ms after the stimulus. The time window for button response was not selected for analysis. The high-performance computational capabilities of the NIH Biowulf PC/Linux cluster (http://biowulf.nih.gov) was used to perform the above computation-intensive tasks.
For group analyses, individual anatomical images were first spatially normalized to the Talairach brain atlas. The SAM results of participants were also normalized (transformed to z-score) and registered to their respective anatomical Talairach images. The group analysis for each of the 50 time windows was performed using a random effects 2 × 2 ANOVA model in AFNI, which generated the gamma band oscillation results. Oscillations in the gamma band of p < 0.005 were considered statistically significant.
A 2 × 2 ANOVA was conducted on the response time (RT) and error rate data. This revealed a significant effect of task load [F(1,15) = 16.103, p < 0.001]; the participants showed significantly longer RTs for the high-load relative to the low-load trials (423 and 370 ms, respectively). There was no significant effect of distracter emotionality [F(1, 15) = 0.206, p = 0.656] nor distracter emotionality by task load interaction [F(1, 15) = 1.348, p = 0.264]. The results on error rates were similar: a significant effect of task load [F(1, 15) = 25.340, p < 0.001], more errors for the high-load condition relative to the low-load condition (17 and 1%, respectively), but no significant effect of distracter emotionality (F(1, 15) = 0.000, p = 1) or distracter emotionality by task load interaction [F(1, 15) = 0.044, p = 0.837].
The result showed that within the gamma band there was strong power at 30–50 Hz (Fig. 2). This range was therefore used in the present analysis. Two other reasons for focusing on 30–50 Hz are as follows. (1) Within the gamma band, oscillations around 40 Hz are to date the most established frequencies associated with cognition (Singer, 1999; Varela et al., 2001). (2) Our previous MEG studies have shown that 30–50 Hz is modulated by emotion (Luo et al., 2007, 2009).
MEG-SAM results in the gamma band
Our overall aim was to determine whether the amygdala response to emotional stimuli is under different levels of attentional control as a function of time. Our first goal was to determine whether participants showed an early amygdala response to emotional stimuli that is independent of attention, i.e., that is not modulated by task load. Consistent with our hypothesis, a significant main effect of distracter was seen within the left amygdala; increased gamma band activity was seen in response to fearful relative to neutral expressions very rapidly after stimulus onset (30–40 ms) and lasted until 50–60 ms (p < 0.005; at a more lenient threshold of p < 0.05 this effect lasted until 140 ms). There was no significant task load or task load-by-distracter interaction within the amygdala for this time period; i.e., task load did not modulate the early amygdala response (Fig. 3a,c).
Our second goal was to determine whether later amygdala responding is modulated by task load. Consistent with our hypothesis, a significant task load-by-distracter interaction was seen within the right amygdala starting at 280–290 ms and lasting until 330–340 ms (p < 0.005; at p < 0.05 this effect lasted until 410 ms). Notably this interaction became significant after a significant main effect of task load was seen within regions implicated in top-down attentional control (Desimone and Duncan, 1995) (lateral frontal [BA8] and parietal cortices [BA7]; 120–130 to 370–380 ms and 200–210 to 290–300 ms, respectively). Under high-load conditions, there was no significant effect of distracter emotionality on the amygdala response. In contrast, under low-load conditions, there was significantly greater gamma band activity within the amygdala to fearful relative to neutral expressions (p < 0.005) (Fig. 3b,d).
Our results demonstrated an early (40–140 ms) amygdala response to emotional information that was independent of attentional modulation and a later (290–410 ms) amygdala response that showed significant attentional modulation. In short, these data indicate that the degree of automaticity of the amygdala response is a function of time.
Previous work has identified early gamma band activity in the amygdala in response to emotional expressions (Luo et al., 2007, 2009), and work with rodents has indicated that auditory fearful signals can reach the amygdala at a short latency of 12 ms (Quirk et al., 1995; LeDoux, 1998). The current data suggest that this early amygdala response is not modulated by attentional load because it occurs before task-related activity is seen within lateral frontal and parietal cortices. Later amygdala activity, which occurred after task related activity within these regions, showed a significant emotion-by-task load interaction. We hypothesize that this interaction reflects the impact of top-down attentional mechanisms. Specifically, stronger representation of task-relevant information during high-load trials via top-down attention should result in reduced representation of emotional distracter information caused by representational competition (Desimone and Duncan, 1995; Kastner and Ungerleider, 2000; Marois et al., 2004). We believe that the limited temporal resolution of BOLD data results in the contamination of the rapid, automatic amygdala response to emotional stimuli by the slower, attentionally modulated response.
Our results can be considered consistent with suggestions of a dual-route model to amygdala activation (LeDoux, 2000; de Gelder et al., 2003; Dolan and Vuilleumier, 2003; Ohman et al., 2007). Considerable animal work has demonstrated that conditioned stimulus (CS) inputs can reach the amygdala via this subcortical route (Quirk et al., 1995, 1997; LeDoux, 2000). Moreover, the human amygdala has been reported to show activity changes during conditioning to a masked CS that correlate with activity in the thalamus but not the cortex (Morris et al., 1999). Early findings of automatic amygdala activity that was not reduced by reduced attention were thought to reflect activity via this subcortical route (Vuilleumier et al., 2001; Anderson et al., 2003). Later fMRI work, however, indicated that increased attention to nonemotional stimulus features did significantly reduce the amygdala's response to emotional stimulus features (e.g., Pessoa et al., 2002; Bishop et al., 2007; Blair et al., 2007; Mitchell et al., 2008; Pessoa, 2009). It is possible that the early amygdala activity seen in the current study that was independent of attentional modulation was a result of stimulation of the amygdala via the subcortical route. The later amygdala activity that showed significant attentional modulation may reflect the interaction of lateral frontal and parietal regions implicated in top-down attentional control priming competing task-relevant representations within the cortical route.
The apparent laterality of our findings was not predicted. The left amygdala showed an early response to emotional information that was independent of attentional modulation, while the right amygdala showed a later response to emotional information that was significantly modulated by attention. However, it should be noted that, at a more lenient significance threshold (p < 0.05), the left amygdala also showed a later response to emotional information that was significantly modulated by attention. This started at 180–190 ms and lasted until 210–220 ms. While there was no indication of an early right amygdala response to emotional information in the current study, this has been reported in previous work (Luo et al., 2007). In short, on the basis of the current literature, we do not believe that the apparent laterality of our findings reflects genuine processing/connectivity differences between the left and right amygdala.
It is worth considering whether the current results are specific for emotional expressions or whether they might generalize to other stimulus categories. Most work considering the degree of attentional modulation of amygdala activity and the potential subcortical route has involved emotional expression stimuli (e.g., Pessoa et al., 2002; Vuilleumier et al., 2003; de Gelder et al., 2003; Whalen et al., 2004; Mitchell et al., 2008), although not all has done so (Blair et al., 2007). However, the potential evolutionary importance of the subcortical route (allowing the very rapid processing of potential threats) (Ohman et al., 2007) might suggest that similar findings should be seen for other biologically relevant threat stimuli (e.g., snakes, spiders, and snarling animals), although not for evolutionarily more recent threats (e.g., pointed guns). In this regard, it is interesting to note recent findings indicating altered processing of biologically relevant threat stimuli in a patient with pulvinar damage (Ward et al., 2007). Our current work explores these predictions.
In summary, our results suggest that the early amygdala response to emotional distracters may be automatic. We argue that this reflects the reduced time for frontoparietal cortex to augment the representational strength of task-relevant stimuli and thus, following representational competition, reduce the representational strength of emotional information. In contrast, later amygdala response is modulated by task load because frontoparietal cortex has had sufficient time to augment the representation of task-relevant information. In short, amygdala automaticity is a matter of timing.
This research was supported by the National Institute of Mental Health Intramural Research Program.
- Correspondence should be addressed to Dr. Qian Luo, Mood and Anxiety Disorders Program, National Institute of Mental Health, National Institutes of Health, 15K North Drive, Mail Stop Code 2670, Bethesda, MD 20892-2670.