Skip to main content

Main menu

  • HOME
  • CONTENT
    • Early Release
    • Featured
    • Current Issue
    • Issue Archive
    • Collections
    • Podcast
  • ALERTS
  • FOR AUTHORS
    • Information for Authors
    • Fees
    • Journal Clubs
    • eLetters
    • Submit
  • EDITORIAL BOARD
  • ABOUT
    • Overview
    • Advertise
    • For the Media
    • Rights and Permissions
    • Privacy Policy
    • Feedback
  • SUBSCRIBE

User menu

  • Log out
  • Log in
  • My Cart

Search

  • Advanced search
Journal of Neuroscience
  • Log out
  • Log in
  • My Cart
Journal of Neuroscience

Advanced Search

Submit a Manuscript
  • HOME
  • CONTENT
    • Early Release
    • Featured
    • Current Issue
    • Issue Archive
    • Collections
    • Podcast
  • ALERTS
  • FOR AUTHORS
    • Information for Authors
    • Fees
    • Journal Clubs
    • eLetters
    • Submit
  • EDITORIAL BOARD
  • ABOUT
    • Overview
    • Advertise
    • For the Media
    • Rights and Permissions
    • Privacy Policy
    • Feedback
  • SUBSCRIBE
PreviousNext
Research Articles, Behavioral/Cognitive

Development of Human Emotion Circuits Investigated Using a Big-Data Analytic Approach: Stability, Reliability, and Robustness

Yuan Zhang, Aarthi Padmanabhan, James J. Gross and Vinod Menon
Journal of Neuroscience 4 September 2019, 39 (36) 7155-7172; DOI: https://doi.org/10.1523/JNEUROSCI.0220-19.2019
Yuan Zhang
1Department of Psychiatry and Behavioral Sciences,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Yuan Zhang
Aarthi Padmanabhan
1Department of Psychiatry and Behavioral Sciences,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
James J. Gross
2Department of Psychology,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Vinod Menon
1Department of Psychiatry and Behavioral Sciences,
3Department of Neurology and Neurological Sciences, and
4Stanford Neuroscience Institute, Stanford University, Stanford, California 94305
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • Info & Metrics
  • eLetters
  • PDF
Loading

Abstract

Emotion perception is fundamental to affective and cognitive development and is thought to involve distributed brain circuits. Efforts to chart neurodevelopmental changes in emotion have been severely hampered by narrowly focused approaches centered on activation of individual brain regions and small sample sizes. Here we investigate the maturation of human functional brain circuits associated with identification of fearful, angry, sad, happy, and neutral faces using a large sample of 759 children, adolescents, and adults (ages 8–23; female/male = 419/340). Network analysis of emotion-related brain circuits revealed three functional modules, encompassing lateral frontoparietal, medial prefrontal-posterior cingulate, and subcortical-posterior insular cortices, with hubs in medial prefrontal, but not posterior cingulate, cortex. This overall network architecture was stable by age 8, and it anchored maturation of circuits important for salience detection and cognitive control, as well as dissociable circuit patterns across distinct emotion categories. Our findings point to similarities and differences in functional circuits associated with identification of fearful, angry, sad, happy, and neutral faces, and reveal aspects of brain circuit organization underlying emotion perception that are stable over development as well as features that change with age. Reliability analyses demonstrated the robustness of our findings and highlighted the importance of large samples for probing functional brain circuit development. Our study emphasizes a need to focus beyond amygdala circuits and provides a robust neurodevelopmental template for investigating emotion perception and identification in psychopathology.

SIGNIFICANCE STATEMENT Emotion perception is fundamental to cognitive and affective development. However, efforts to chart neurodevelopmental changes in emotion perception have been hampered by narrowly focused approaches centered on the amygdala and prefrontal cortex and small sample sizes. Using a large sample of 759 children, adolescents, and adults and a multipronged analytical strategy, we investigated the development of brain network organization underlying identification and categorization of fearful, happy, angry, sad, and neutral facial expressions. Results revealed a developmentally stable modular architecture that anchored robust age-related and emotion category-related changes in brain connectivity across multiple brain systems that extend far beyond amygdala circuits and provide a new template for investigation of emotion processing in the developing brain.

  • Big-Data
  • emotion perception and identification
  • functional networks
  • maturation
  • reliability
  • replicability

Introduction

Identification of distinct facial expressions, which is fundamental to recognizing the emotional state of others, begins in infancy and continues to develop throughout childhood and adolescence (Batty and Taylor, 2006; Thomas et al., 2007; Rodger et al., 2015; Leitzke and Pollak, 2016; Theurel et al., 2016). How emotions are identified and categorized in the developing brain remains a fundamental open question. Analysis of task-evoked brain circuits using a “Big-Data” approach has the potential to accelerate foundational knowledge of emotion perception circuit development and provides robust templates for understanding miswiring of functional circuits in developmental psychopathologies. Here, we leverage the Philadelphia Neurodevelopmental Cohort (PNC) (Satterthwaite et al., 2014) to address critical gaps in our knowledge regarding the functional circuits of emotion perception and their development.

Meta-analyses of neuroimaging studies in adults have identified widely distributed, and overlapping functional systems engaged by distinct emotion categories (Kober et al., 2008; Fusar-Poli et al., 2009). In particular, brain regions associated with three large-scale functional brain networks are relevant for emotion processing based on their extensive role in integrating salient cues across cortical and limbic systems. The “salience network” facilitates rapid detection of personally relevant and salient emotional cues in the environment (Seeley et al., 2007; Menon and Uddin, 2010; Menon, 2011), the “default mode network” is important for mentalizing and inferring the emotional states of others (Greicius et al., 2003; Blakemore, 2008), and the frontoparietal (FP) “central executive network” is involved in attention, reappraisal, and regulation of reactivity to emotional stimuli (Dosenbach et al., 2007; Gyurak et al., 2011; Tupak et al., 2014; Braunstein et al., 2017; Sperduti et al., 2017). However, previous neurodevelopmental studies of emotion perception have focused almost exclusively on the amygdala and its connectivity with the mPFC (Gee et al., 2013; Vink et al., 2014; Kujawa et al., 2016; Wolf and Herringa, 2016; Wu et al., 2016), with inconsistent findings (for a summary, see Table 1). While some studies found no age-related changes (Kujawa et al., 2016; Wolf and Herringa, 2016; Wu et al., 2016), others have reported increases (Vink et al., 2014; Wolf and Herringa, 2016) or decreases with age (Gee et al., 2013; Kujawa et al., 2016; Wu et al., 2016) in amygdala activation or connectivity with the mPFC. In contrast, intrinsic functional connectivity studies have highlighted protracted developmental changes in distributed brain networks (Power et al., 2010; Menon, 2013), including developmental changes in amygdala connectivity with subcortical, paralimbic, and limbic structures, polymodal association, and ventromedial prefrontal cortex (vmPFC) (Qin et al., 2012). These findings highlight a critical need for characterizing the development of task-evoked functional brain circuits and network organization underlying emotion perception (Barrett and Satpute, 2013).

View this table:
  • View inline
  • View popup
Table 1.

Studies that examined age-related changes in amygdala activity and connectivity underlying emotion perceptiona

Here, we characterize the neurodevelopment of emotion perception circuits leveraging high-quality data (N = 759) from the emotion-identification fMRI task in the PNC, an unprecedented Big-Data initiative for charting brain development in a large community sample (Satterthwaite et al., 2014) (Fig. 1). We first used meta-analysis and community detection methods to identify and characterize the modular architecture of brain circuits associated with perception and identification of fearful, angry, sad, happy, and neutral faces. We then investigated aspects of brain circuit organization that are stable over development in addition to aspects that changed with age. Last, given the challenges of small sample sizes (Button et al., 2013; Szucs and Ioannidis, 2017; Turner et al., 2018), high false-positive rates (Eklund et al., 2016; Szucs and Ioannidis, 2017), and lack of replicability in neuroimaging research (Ioannidis, 2005; Eklund et al., 2016; Szucs and Ioannidis, 2017), we evaluated the reliability of our age-related findings on randomly subsampled independent datasets across a wide range of sample sizes (Fig. 1d) and assessed the replicability of previously reported findings. Our findings advance a new understanding of emotion circuit development in the human brain.

Figure 1.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 1.

Schematic view of participant selection procedure and main analysis steps. a, From the original 1495 participants, 157 were excluded due to incomplete data, medical problems, poor brain coverage, or not being able to perform the task. A total of 567 participants were excluded due to excess head motion, and 12 participants were excluded due to low task accuracy. A total of 759 participants 8–23 years of age survived these exclusion criteria. b, Brain ROIs involved in emotion perception were identified using meta-analysis implemented in Neurosynth (Yarkoni et al., 2011). They included the following: vmPFC, dmPFC, vlPFC, dlPFC, lOFC, IPL, SPL, sgACC, pgACC, dACC, PCC, pre-SMA, BLA, vAI, dAI, PI, hippocampus (Hipp), and FFG. Subcortical ROIs, including CMA, BNST, and NAc, were identified using anatomical atlases (see also Table 3). ROIs were overlaid on a reference brain surface using BrainNet Viewer (Xia et al., 2013). c, Network analysis steps used to investigate development of the affective circuits. ci, ROI β series were derived from each task condition (fear, anger, sad, happy, or neutral) for each individual. cii, Functional connectivity matrices were computed for each individual. ciii, Functional connectivity matrices were fed into a community detection algorithm to determine community structure of the ROIs. civ, ROI nodal degree was computed over a wide range of sparsity (10% ≤ sparsity ≤ 40% with an interval of 5%), and then an integrated metric of nodal degree was obtained by computing the area under the curve. cv, Intramodule and intermodule interactions were computed. cvi, Deviation of individual community structure from template community structure was measured as the Jaccard overlap between the two. cvii, ROIs were further categorized into hubs or nonhubs, and then the probability of an ROI to be a hub within each age year was calculated. Permutation test was used to assess hub significance. cviii, These resulting brain metrics were further fed into linear mixed-effect models to assess age, emotion, and age × emotion effects. d, Reliability analyses assessed the robustness of age-related findings and the effect of sample size. Briefly, we randomly drew N (sample size) participants from the full sample and assessed age-related changes in the subsample. This was repeated 1000 times across a wide range of sample sizes (50 ≤ N ≤ 400, increased by 50). Correlation between age effects from a subsample and that from the full sample was calculated and then averaged across subsamples for each sample size. The resulting average correlation was used to measure reliability.

Materials and Methods

Participants

Participants were selected from the PNC 8–23 years of age (N = 1495). Data were excluded based on the following criteria: (1) lack of complete emotion task fMRI data; (2) high in-scanner motion (mean scan-to-scan displacement > 0.2 mm or maximum scan-to-scan displace > 1 mm or maximum displacement > 3 mm); (3) missing brain coverage; (4) medical rating > 2 (i.e., having significant or major medical problems); and (5) overall task performance (accuracy) < 70%. A total of 759 participants (fMRI sample) survived these exclusion criteria and were included in further behavioral and neuroimaging analyses (Fig. 1a; Table 2). Additional behavioral analysis was performed to investigate age-related effects on emotion categorization accuracy and reaction time (RT) in a larger sample of 1338 participants (behavioral sample) who had valid behavioral data. A total of 157 participants with medical issues or incomplete data or were unable to perform the task were excluded from any analysis. All study procedures were approved by the institutional review boards of both the University of Pennsylvania and the Children's Hospital of Philadelphia (Satterthwaite et al., 2014).

View this table:
  • View inline
  • View popup
Table 2.

Participant characteristics and task performance

Behavioral and demographic differences between the neuroimaging and excluded samples

We examined whether participants in the fMRI (N = 759) and excluded (N = 579) samples are similar cross-sections of the overall population in terms of age, sex, and behavioral performance (accuracy and RT). The excluded sample included participants who did not meet our criteria for inclusion in fMRI data analysis but were included in the behavioral analysis.

PNC emotion identification fMRI task

Participants were presented with faces and were required to categorize them as one of five emotion categories: neutral, fear, anger, sadness, or happiness. Each face was presented for 5.5 s followed by a jittered interstimulus interval ranging between 0.5 and 18.5 s, during which a complex crosshair that matched perceptual qualities of the face was displayed. There were 12 faces per emotion category, resulting in 60 total trials (Satterthwaite et al., 2014).

Neuroimaging data acquisition and preprocessing

Images were acquired using a 3T Siemens TIM Trio scanner (32 channel head coil), with a single-shot, interleaved multislice, gradient-echo, EPI sequence (TR/TE = 3000/32 ms, flip angle = 90°, FOV = 192 × 192 mm2, matrix = 64 × 64, slice thickness = 3 mm). fMRI data were preprocessed and analyzed using Statistical Parametric Mapping software SPM8 (Wellcome Trust Department of Cognitive Neurology, London). Images were slice-time corrected, motion-corrected, resampled to 3 mm × 3 mm × 3 mm isotropic voxels, normalized to MNI space, spatially smoothed with a 6 mm FWHM Gaussian filter, and temporally filtered using a high-pass filter with a cutoff frequency of 1/128 Hz.

Head motion

Participants with mean scan-to-scan displacement ≤0.2 mm and maximum scan-to-scan displace ≤1 mm and maximum displacement ≤3 mm were included in further analysis. In addition to correction for motion correction at the whole-brain level during fMRI preprocessing (as described above), to rule out any potential residual effects of motion, mean scan-to-scan displacement was included as a nuisance covariate in all our analyses.

Network analysis

Network nodes.

To overcome limitations of extant neurodevelopmental studies of emotion perception and categorization, which have predominantly focused on the amygdala (Gee et al., 2013; Vink et al., 2014; Kujawa et al., 2016; Wolf and Herringa, 2016; Wu et al., 2016), we conducted a meta-analysis to identify cortical and subcortical brain regions that are consistently involved in emotion-related processes. Specifically, using the meta-analysis toolbox Neurosynth (Yarkoni et al., 2011) and the search term “emotion,” we identified local peaks (at least 8 mm apart) within each cluster in the forward and reverse inference maps. We selected peaks in frontal, parietal, medial temporal, limbic, and subcortical areas. ROIs were defined as a 6 mm sphere with an identified peak as center. If a unilateral peak was detected at a specific region, we included its contralateral counterpart by flipping the peak coordinate along the x axis.

Together, nodes encompassed the vmPFC, dorsomedial PFC (dmPFC), ventrolateral PFC (vlPFC), and dorsolateral PFC (dlPFC), lateral orbitofrontal cortex (lOFC), inferior parietal lobule (IPL), and superior parietal lobule (SPL), subgenual ACC (sgACC), pregenual ACC (pgACC), dorsal ACC (dACC), and posterior cingulate cortex (PCC), presupplementary motor area (pre-SMA), BLA, dorsal anterior insula (dAI), posterior insula (PI), hippocampus (Hipp), and fusiform gyrus (FFG). An additional pair of dorsolateral prefrontal ROIs superior to the pair identified by Neurosynth were included based on two recent emotion-regulation meta-analyses (Buhle et al., 2014; Kohn et al., 2014). We also included nodes in the ventral anterior insula (vAI), centromedial amygdala (CMA), bed nucleus stria terminalis (BNST), and nucleus accumbens (NAc) based on their well-known roles in perception of negative and positive emotions (LeDoux, 2007; Deen et al., 2011; Chang et al., 2013; Floresco, 2015; Lebow and Chen, 2016; Namkung et al., 2017). The vAI node was identified using Neurosynth and search term “anxiety” (Paulus and Stein, 2006; Etkin, 2010; Menon, 2011; Blackford and Pine, 2012; Qin et al., 2014), the CMA was identified based on its cytoarchitectonically defined probabilistic map using the Anatomy toolbox (Eickhoff et al., 2005), the BNST node was based on the meta-analysis by Avery et al. (2014), and NAc was identified based on the Harvard-Oxford atlas distributed with FSL (http://www.fmrib.ox.ac.uk/fsl/). These procedures identified 50 ROIs consistently associated with emotion processing (Fig. 1b; Table 3). Finally, we further verified that the activation maps of emotion-related topics encompassed the maps reported in a large meta-analytic database of fMRI studies (Rubin et al., 2017).

View this table:
  • View inline
  • View popup
Table 3.

Anatomical location and MNI coordinates of emotion circuit-related nodes

Emotion-related node-level activity.

Task-related brain activation was identified using a GLM implemented in SPM8. At individual level, brain activation representing correct trials for each emotion task condition (neutral, fear, anger, sad, or happy) was modeled using boxcar functions convolved with a canonical hemodynamic response function and a temporal derivative to account for voxelwise latency differences in hemodynamic response. An error regressor was also included in the model to account for the influence of incorrect trials. Additionally, six head movement parameters generated from the realignment procedure were included as regressors of no interest. Serial correlations were accounted for by modeling the fMRI time series as a first-degree autoregressive process. For each emotion task condition, ROI activity was obtained by averaging the estimated β values across voxels within that ROI.

Emotion-related internode connectivity.

Functional connectivity was assessed using a β series analysis approach (Rissman et al., 2004). At individual level, brain activation related to each trial was modeled using boxcar functions convolved with a canonical hemodynamic response function. Six head movement parameters were included as regressors of no interest. Serial correlations were accounted for by modeling the fMRI time series as a first-degree autoregressive process. Trialwise ROI activity was obtained by averaging the estimated β values across voxels within that ROI. A β series was derived for each ROI each emotion condition by concatenating trialwise ROI activity belonging to the same emotion condition. Only ROI activity corresponding to correct trials was used to construct β series. Conditionwise β series were demeaned and used to calculate Pearson correlation between all pairs of ROIs. Pearson correlation coefficients were Fisher Z-transformed and used to index functional connectivity strength and form emotion-related networks in each participant (Fig. 1c).

Emotion-related network structure.

To determine common patterns of community structure across all participants, we used a consensus-based approach for identifying functional modules (Lancichinetti and Fortunato, 2012; Dwyer et al., 2014) associated with each emotion. In each participant, the Louvain algorithm (Blondel et al., 2008), as implemented in the Brain Connectivity Toolbox (Rubinov and Sporns, 2010), was used to first determine the modular structure of the signed, weighted connectivity matrix (Newman, 2004, 2006). To handle potential degeneracy of community assignments, we repeated this procedure 1000 times in each participant (Lancichinetti and Fortunato, 2012; Dwyer et al., 2014). In each iteration, we generated a co-classification matrix in which each element contained 1 if two nodes were part of the same module and 0 otherwise. The resulting 1000 co-classification matrices were averaged to generate a co-occurrence matrix indicating the probability of two nodes being in the same module across 1000 iterations. Co-occurrence matrices were then averaged across participants to produce a positive, weighted group consistency matrix, with higher weight in elements of this matrix indicating that two nodes were more frequently classified in the same module across participants. This group consistency matrix was used to determine a consensus partition (Lancichinetti and Fortunato, 2012). To evaluate the influence of resolution parameter gamma, which tunes the size and number of communities obtained from modularity maximization (Fortunato and Barthélemy, 2007; Sporns and Betzel, 2016), the above consensus-based approach was repeated at gamma values ranging from 0.1 to 2.0 in increments of 0.1.

To assess the significance of the modular structure, we compared the actual Q to the Q derived from null networks. Specifically, the group consistency matrix was used to create 1000 null networks with preserved weight and degree distributions. For each null network, weak edges with weight <0.1 were first set to 0 and Q was calculated 1000 times and used to establish an empirical null distribution of Q. Q was considered significant if it was larger than the 95th percentile of the empirical null distribution.

Emotion-related hubs.

To identify hubs in the affective circuits and their development with age, we first computed nodal degree for each individual and each emotion category. Degree of a node i is defined as the number of edges connected to that node as follows: Embedded Image where eij is the connection status (0 or 1) between node i and node j, and n is the total number of nodes (Rubinov and Sporns, 2010). Because the functional matrix is fully connected, a sparsity condition, based on the ratio of the actual edge number to the maximum possible edge number in a network, was applied to the connectivity matrix before computing nodal degree. To minimize the impact of setting an arbitrary level of sparsity, we calculated degree over a wide range of sparsity (i.e., 10% ≤ sparsity ≤ 40% with an interval of 5%) and then computed area under the curve, to obtain an integrated metric of node degree as in previous studies examining functional circuits (Yan et al., 2013; Lv et al., 2016). A node with high degree indicates high interconnectivity with other brain nodes. Hub nodes were defined as nodes with integrated degree metric at least 1 SD above the mean across all nodes.

Generalization of ROIs to the Brainnetome atlas.

We used the Brainnetome atlas to determine robustness and generalizability of findings from the 50 emotion-related meta-analysis-derived ROIs. An advantage of the Brainnetome atlas, compared with many other functional brain parcellations, is that it includes both cortical and subcortical clusters with appropriate anatomical labels (Fan et al., 2016). Specifically, we identified Brainnetome clusters in which each of the 50 ROIs was located; because 2 ROI pairs were located in the same Brainnetome cluster, this procedure yielded 46 matching clusters. We then repeated all our analyses using these spatially extended clusters.

Statistical analysis

Linear versus nonlinear age models.

The remainder of our analyses involved assessing age-related changes in task performance, regional activity, regional connectivity, and intramodule and intermodule connectivity. For task performance, we analyzed both the fMRI (N = 759) and behavioral (N = 1338) samples. We examined three models (linear, quadratic, and cubic spline) to test for linear and nonlinear age-related effects, and used Bayesian Information Criteria to determine the best model. The vast majority of the analyses indicated that nonlinear models did not fit the data better than linear models. Where appropriate, we report nonlinear age effects that survived FDR correction for multiple comparisons.

Linear mixed-effect model.

To examine main effects of age, emotion, and age × emotion interactions on task performance and brain measures, we used R package lme4 (Bates et al., 2015) to perform a linear mixed-effect analysis. As fixed effects, we entered age, emotion, and age × emotion interactions (regressors of interest) as well as sex, race, and head movement (regressors of no interest) into the model. As random effects, we had intercepts for participants. Significance of regressor coefficients were obtained by F tests.

Multiple linear regression of age-related changes.

For significant age × emotion interactions, we performed additional analyses to examine age-related changes in each emotion category. Specifically, we used multiple linear regression models, with behavioral or brain measure as dependent variable, age as a covariate of interest, and sex, race, and head movement as covariates of no interest.

Development of emotion circuits

Development of emotion-related network structure.

To determine how network structure changes with age, we first determined community structure for each participant and each group as described above. We then computed the Jaccard index between individual and group consensus community structures. Specifically, overlap in community structure was computed using a co-occurrence matrix, with 1 indicating two nodes belonging to the same module and 0 indicating two nodes belonging to different modules. The Jaccard index is defined as the ratio of the intersection between two matrices divided by their union, ranging from 0 (no overlap) to 1 (full overlap). A linear mixed-effect model was then applied to the Jaccard index to determine main effects of age, emotion, and age × emotion interactions. We also examined community structure in three distinct age groups, children (8–12 years), adolescents (13–17 years), and adults (18–23 years), to provide additional insights into the development of emotion circuits.

Development of emotion-related intramodule and intermodule connectivity.

To examine main effect of age, emotion, and age × emotion interactions on functional interactions between the module, we assessed the intramodule connectivity, by computing the mean strength of all connectional weights within a module, and intermodule interaction, by computing the mean strength of connectional weights between modules, for each individual and each emotion category.

Development of emotion-related hubs.

To investigate the development of hub nodes, we first computed the probability of an ROI being a hub in a 1 year age window, separately for each emotion category. Specifically, for each participant and each emotion category, we identified hubs (see above) and counted, for each node, how many times it functioned as hub across participants under a specific emotion category. This count was divided by the total number of participants within that specific age window to derive a node's hub probability. To assess the significance of hub probability, we constructed an empirical null distribution for each region and each age window under each emotion category. Specifically, we first permuted hub identity across all nodes within each individual, by randomly designating which nodes were hubs while keeping the total number of hubs constant over 1000 iterations, and then calculated the probability of a brain region being a hub node within each age window for all permutations. Only nodes with a probability above the 95th percentile of its empirical null distribution were considered as a significant hub.

Classification analysis

We used a nonlinear support vector machine classification algorithm with 10-fold cross-validation to assess the discriminability of regional connectivity measures between all pairs of emotion categories. The python scikit-learn package (https://scikit-learn.org/stable/) was used to perform this analysis. Permutation test was used to assess the performance of the classifier. Specifically, for each pair of emotion categories, data were divided into 10 folds, with those belonging to the same participant included in the same fold. A nonlinear support vector machine classifier was trained using nine folds, leaving out one fold. The samples in the left-out fold were then predicted using this classifier, and an accuracy was derived by calculating the percentage of correct predictions. This procedure was repeated 10 times, and a final classification accuracy was derived by calculating the mean of the 10 left-out accuracy, which was used as a measure of model performance. Next, the statistical significance of the model was assessed using permutation test. In each permutation, emotion category labels (e.g., neutral vs fear) were randomly exchanged with a probability of 0.5 for each participant. A classifier was trained, and a classification accuracy was derived using the same scheme described above. Classification accuracy from 100 permutations was used to construct the empirical null distribution from which a p value was computed.

Reliability analysis

Behavior.

We examined the reliability of our developmental findings and assessed the effect of sample size on reliability for each emotion category. First, we randomly drew N (sample size) participants (50 ≤ N ≤ 700, incremented by 50) from either the fMRI (N = 759), or behavioral (N = 1338), sample without replacement and with the proportion of children (ages 8–12 years), adolescents (ages 13–17 years), and adults (ages 18–23 years) in each subsample being matched to the fMRI, or behavioral, sample. Second, we assessed developmental changes in the subsample using multiple linear regression models. Third, we repeated the first two steps 1000 times at each sample size. Finally, we calculated the probability of observing a significant age effect with the same direction as the one revealed in the full sample across 1000 runs for each sample size, which was used as the measure of reliability. We defined findings with reliability >0.7 as reliable because it is unlikely (p < 2.2e-16) to observe a significant effect ≥700 times of 1000 runs, assuming equal probability to observe a significant or null effect in a run.

Brain networks.

We randomly drew N participants from the fMRI sample (N = 759) and assessed age-related changes in the subsample using linear mixed-effect model. This was repeated 1000 times at each sample size across a wide range of sample sizes (50 ≤ N ≤ 400). Next, correlation between age effects in regional activity or connectivity across all brain regions from a subsample and that from the full sample was calculated and then averaged across subsamples at each sample size. The resulting average correlation was used as the measure of network-level reliability of overall developmental pattern across all brain regions. We defined reliable findings as those with correlation >0.7 (i.e., R2 > 0.5), the point at which the model explains more variance than is unexplained. Finally, we also constructed empirical null distributions for reliability measured as average correlation, using the same approach described above, with an additional step that age was permuted in each subsample before assessing developmental changes. Average correlation above the 95th percentile of its empirical null distribution was considered as significantly different from null.

Replication analysis of previous developmental findings related to amygdala circuitry

We examined the development of amygdala activity and connectivity in the current PNC cohort using coordinates reported in three published task-fMRI studies using similar emotion face perception tasks, contrasts, and age range as the PNC (Gee et al., 2013; Kujawa et al., 2016; Wu et al., 2016). Tables 1 and 4 provide details of the studies and coordinates used. Moreover, we performed additional generalized psychophysiological interaction (gPPI) analysis to establish amygdala-mPFC connectivity and examine age-related changes as a similar method (gPPI or PPI) was used in the three published studies. Specifically, the gPPI model included one regressor of seed time series, five regressors of task conditions (neutral, fear, anger, sadness, or happiness), and their interaction with seed time series, one regressor of error trials and its interaction with seed time series, six regressors of head movement, and one regressor of constant. Replication analysis was then applied to amygdala-mPFC gPPI connectivity.

View this table:
  • View inline
  • View popup
Table 4.

MNI coordinates of amygdala and PFC regions used in previous developmental studies of face emotion perceptiona

Data and code availability

Raw data associated with this work are available through dbGaP (https://www.ncbi.nlm.nih.gov/projects/gap/cgi-bin/study.cgi?study_id=phs000607.v2.p2).

All data analysis scripts used in the study will be made publicly available upon publication.

Results

Behavioral maturation of emotion identification

We first examined the main effects of age, emotion, and age × emotion interactions on accuracy (i.e., proportion of correct responses) and median RT of emotion identification in the fMRI sample (N = 759), which included participants who had valid behavioral and neuroimaging data.

Accuracy versus age

Our analysis revealed no main effect of age (p > 0.1) but a significant effect of emotion (F(4,3028) = 187.156, p < 2.2e-16) and age × emotion interactions (F(4,3028) = 5.370, p = 0.0003). Further analysis revealed that accuracy increased with age for fear (r = 0.151, p = 4.71e-05) and anger (r = 0.152, p = 3.83e-05) conditions (Fig. 2ai), but not for sad (r = −0.028, p = 0.457), happy (r = 0.064, p = 0.084), or neutral (r = 0.055, p = 0.144) conditions.

Figure 2.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 2.

Developmental changes in behavior and reliability. Accuracy: The ability to correctly identify high arousal-negative (threat-related) emotions (fear and anger) improved with age in both the fMRI (ai) and full behavioral samples (bi). Only reliability of significant effects was assessed. RT: Time to identify an emotion decreased with age across all five emotion categories in both the fMRI (aii) and full behavioral samples (bii). c, Reliability was measured as the probability of observing a significant correlation between accuracy and age or that between RT and age. ci, Accuracy: Reliability of age-accuracy associations increased as sample size increased for conditions that showed significant age-related changes in accuracy in the fMRI (solid line) and the full behavioral (dashed line) samples. cii, RT: Reliability of age-RT associations increased as sample size increased for all five emotion categories in the fMRI (solid line) and the full behavioral (dashed line) samples. In general, a sample size of 300–350 was needed to identify reliable (reliability > 0.7) age-accuracy association and that of 200 was needed to identify reliable age-RT association.

RT versus age

Results revealed a significant age effect (F(1,1785) = 5.370, p = 1.15e-07), showing that median RT decreased with age such that older participants were faster at identifying emotions. Moreover, there is a significant effect of emotion (F (4, 3028) = 397.167, p < 2.2e-16) and age × emotion interactions (F(4,3028) = 4.023, p = 0.003). Further analysis revealed that median RT decreased with age for all five emotions (Fig. 2aii): fear (r = −0.230, p = 4.62e-10), anger (r = −0.173, p = 3.11e-6), sad (r = −0.111, p = 0.003), happy (r = −0.235, p = 1.75e-10), and neutral (r = −0.207, p = 2.01e-08). The significant age × emotion interaction was characterized by differences in slope between the sad and fear conditions and between the sad and happy conditions.

Reliability of age-related changes

We examined the reliability of age-related changes in relation to sample size. For each emotion category, we used multiple linear regression model to assess age-accuracy and age-RT associations across a wide range of sample sizes (50 ≤ N ≤ 700, increased by 50) with the proportion of children (ages 8–12 years), adolescents (ages 13–17 years), and adults (ages 18–23 years) in each subsample matched to the full sample (1000 times per sample size). Reliability was measured as probability of observing a significant correlation between age and accuracy or RT with the same direction as the one revealed in the full sample. For fear and anger, the two emotion categories that showed a significant age-related increase in accuracy in the full sample, reliability increased with sample size (Fig. 2ci). Reliability of negative age-RT associations increased with sample size across all five emotion categories (Fig. 2cii). In general, a sample size of 300–350 was needed to identify reliable age-accuracy associations, and a sample size of 200–300 was needed to identify reliable age-RT association. Results also demonstrate that age-related improvements in emotion identification were strongest for fear and anger, the two high arousal-negative emotions.

Behavioral maturation of emotion identification assessed using the full behavioral sample

Most developmental neuroimaging studies typically restrict analysis of fMRI-task behavioral data to participants with high levels of accuracy and low head movement during scanning, as noted above. The large PNC dataset allowed us to investigate potential biases in age-related effects in a robust manner using a larger sample of 1338 participants.

Accuracy versus age

Results revealed significant main effect of age (F(1,4515) = 53.814, p < 2.6e-13), showing that accuracy increased with age such that older participants were better at identifying emotions. Moreover, there was a significant main effect of emotion (F(4,5344) = 344.866, p < 1.86e-264) and age × emotion interactions (F(4,5344) = 10.434, p < 2.04e-08). Further analysis revealed that accuracy increased with age for neutral (r = 0.078, p = 0.006), fear (r = 0.150, p = 9.32–08), anger (r = 0.129, p = 6.43e-06), and happy (r = 0.058, p = 0.044) conditions, but not for the sad condition (r = 0.036, p = 0.203) (Fig. 2bi). Additional analysis revealed that the age × emotion interaction was driven by slope differences between fear and each of the other four conditions, between anger and happy conditions, and between neutral and happy conditions. While all significant findings revealed in the fMRI sample were replicated in the larger behavioral sample, we also noted a few additional significant effects in the behavioral sample, including a main effect of age as well as associations between accuracy and age under neutral and happy conditions. However, these additional age-related effects during neutral and happy conditions were weaker than those during fear and anger.

RT versus age

Results revealed a significant main age effect (F(1,3091) = 139.818, p = 1.38e-31), showing that median RT decreased with age such that older participants were faster at identifying emotions. Moreover, there was a significant main effect of emotion (F(4,5344) = 594.997, p = 0.000) and age × emotion interactions (F(4,5344) = 9.162, p = 2.25e-07). Further analysis revealed that median RT decreased with age for all five emotions (Fig. 2bii): neutral (r = −0.300, p = 9.57e-28), fear (r = −0.146, p = 1.85e-21), anger (r = −0.221, p = 4.76e-15), sad (r = −0.185, p = 4.84e-11), and happy (r = −0.260, p = 5.66e-21). Additional analysis revealed that age × emotion interaction was driven by slope differences between fear and anger/sad/happy conditions and between neutral and anger/sad/happy conditions. Notably, all significant findings revealed in 759 participants were replicated in this larger behavioral sample.

Reliability of age-related changes

Reliability of age-related changes as a function of sample size were conducted using the same procedures as ones used above for the fMRI sample. For fear and anger, the two emotion categories that showed a significant age-related increase in accuracy in both the fMRI and the full behavioral samples, reliability increased with sample size; and in general, a sample size of 300–350 was needed to identify reliable age-accuracy associations (Fig. 2ci). This finding is not surprising given that the effect size during fear and anger conditions was comparable across the two samples. Moreover, for sad and happy, the two emotion categories that showed a significant age effect only in the full behavioral sample, reliability increased with sample size but remained low (<0.5), even at a sample size of 700, reflecting the small effect size under these two conditions. In addition, reliability of negative age-RT associations increased with sample size across all five emotion categories; and in general, a sample size of 150–200 was needed to identify reliable age-RT associations (Fig. 2cii). Results also demonstrate that age-related improvements in emotion identification were strongest for fear and anger, the two high arousal-negative emotions.

Behavioral and demographic differences between the neuroimaging and excluded samples

Finally, we examined whether participants in the fMRI (N = 759) and excluded (N = 579) samples are similar cross-sections of the overall population in terms of age, sex, and behavioral performance (accuracy and RT). The excluded sample included participants who did not meet our criteria for inclusion in fMRI data analysis but were included in the behavioral analysis. We found a significant difference in age between the fMRI and excluded samples (t(1186) = 11.68, p < 2.2e-16), with participants in the fMRI sample (age: 16.20 ± 3.27 years) older than participants in the excluded sample (age: 13.99 ± 3.56 years). Moreover, sex and exclusion/inclusion were not independent (χ2(1) = 6.52, p = 0.011), with higher female/male ratio in the fMRI sample (F/M = 419/340) than that in the excluded sample (F/M = 278/301). Last, we found significant differences in accuracy (t(781) = 8.83, p < 2.2e-16) and RT (t(998) = −8.87, p < 2.2e-16) between the two samples, with participants in the fMRI sample showing higher accuracy and faster response (accuracy: 0.92 ± 0.05; RT: 2.29 ± 0.36) than participants in the excluded sample (accuracy: 0.88 ± 0.10; RT: 2.51 ± 0.51). These findings are not surprising as children; and boys, in particular, usually tend to move more in the scanner (Yuan et al., 2009; Dosenbach et al., 2017; Engelhardt et al., 2017), so the excluded sample includes more boys and younger participants, leading to age and performance differences between the neuroimaging and excluded samples.

Meta-analysis of brain areas involved in emotion

To take a broad and inclusive view of cortical and subcortical brain regions involved in emotion perception, we proceeded in a two-step manner. First, we used the meta-analysis toolbox Neurosynth (Yarkoni et al., 2011) and the search term “emotion” to identify the most consistently reported cortical and subcortical regions implicated in emotion processing, including vmPFC, dmPFC, vlPFC, dlPFC, lOFC, IPL, SPL, sgACC, pgACC, dACC, PCC, pre-SMA, BLA, vAI, dAI, PI, hippocampus, and FFG (Fig. 1b; Table 3). Second, given recent theoretical focus on the salience network (Menon, 2011), specifically the subdivisions of the insula and the amygdala, we identified additional distinct functional subdivisions of the anterior insula (vAI) and amygdala (CMA) and additional subcortical regions, including the BNST and the NAc, thought to play distinct functional roles in emotion processing (LeDoux, 2007; Deen et al., 2011; Chang et al., 2013; Floresco, 2015; Lebow and Chen, 2016; Namkung et al., 2017). The brain areas identified by this analysis showed strong overlap with salience, central executive, and default mode networks (Seeley et al., 2007; Menon, 2011).

Modular structure of emotion-related circuits is established in childhood and remains developmentally stable

To investigate how the functional organization of emotion perception circuits change with age, we first identified the modular structure of interregional connectivity, computed using β series correlation (Rissman et al., 2004), for each emotion task condition. Next, we determined common patterns of modular structure across all participants for each emotion condition, which was used as a template for further analysis. Across all five emotion categories, we observed three consistent network modules corresponding to a FP module, a mPFC/PCC module, and an subcortical/posterior insula (SPI) module (Fig. 3a). This 3-module structure was stable across emotion categories for all values of gamma > 0.5; results are reported here for gamma = 1, the most commonly used value in most fMRI studies. The modularity value Q for gamma = 1 was highly significant compared with empirical null networks with preserved weight and degree distributions (p < 0.001).

Figure 3.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 3.

Main effects of age and emotion on modular organization and connectivity. ai, Three functional modules were identified across all participants: the FP module (red), mPFC/PCC module (green), and SPI module (yellow). aii, As shown in the group consistency matrix, the FP module (red border) includes bilateral dlPFC, vlPFC, dACC, pre-SMA, IPL, SPL, and FFG. The mPFC/PCC module (blue border) includes bilateral NAc, sgACC, pgACC, PCC, vmPFC, and dmPFC. The SPI module (yellow border) includes BLA, CMA, vAI, PI, BNST, and hippocampus (Hipp). Color bar represents the probability of two nodes being classified in the same module across participants. b, As shown in the group consistency matrices, overall modular structure is stable across all five emotion categories and age groups (children 8–12 years, adolescents 13–17 years, adults 18–23 years). c, Intra-FP connectivity and FP-SPI connectivity increased with age; intra-FP, intra-SPI, and all intermodule connectivity measures varied across emotions; age-related changes in intra-mPFC/PCC connectivity were modulated by emotion category. d, Intramodule and intermodule connectivity varied across emotions. Data are mean ± SEM.

Next, we assessed main effects of age, emotion, and age × emotion interactions on the Jaccard overlap between individual and template modular structure. Results revealed a significant emotion effect (F(4,3028) = 3.656, p = 0.006) but no significant effect of age or age × emotion interactions (p values >0.1), indicating that the overall modular structure for all emotion conditions was stable with age. Additional analysis using the Jaccard overlap between individual and adult-group modular structure revealed similar results. This was further confirmed by findings of modular structure within distinct age groups: children (8–12 years), adolescents (13–17 years), and adults (18–23 years) (Fig. 3b). Notably, this modular architecture maps closely onto the triple-network model (Menon, 2011). Finally, a similar 3-module structure was observed when using the 46 spatially extended clusters, demonstrating the robustness and generalizability of our finding with respect to Brainnetome functional brain parcellations (Fan et al., 2016).

Development of hubs underlying emotion perception

We next identified which nodes served as hubs and examined whether these change with age. Briefly, we identified hub regions for each individual, computed the probability of a brain region being a hub within a 1 year age window for each emotion category, and assessed the significance of hub probability by permutation. We found that hubs resided in the medial prefrontal nodes (pgACC, vmPFC, and dmPFC) of the mPFC/PCC module (Fig. 4a) and were stable over age across all five emotion categories (Fig. 4b,c).

Figure 4.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 4.

Developmentally stable hubs in mPFC. a, ROI nodal degree for each emotion category. Node size is in proportion to integrated nodal degree measure. b, Probability measures averaged across all regions within each module at each age year. Overall, the mPFC/PCC module has a higher probability to be a functional hub across age than the FP and SPI modules. Data are mean ± SEM. c, Multiple regions of the mPFC/PCC module, including pgACC, vmPFC, and dmPFC of the mPFC/PCC module were identified as functional hub regions for all five emotion categories and were stable over development. Here, probability matrices are masked by the 95th percentile of empirical null distribution at each region and age year, with probability values ≤95th percentile set as 0. An age year includes all participants whose age was larger than or equal to the current age year and less than the next age year (e.g., age 8 includes all participants with age ≥8 and <9).

Developmental changes in intramodule and intermodule connectivity

We examined main effects of age, emotion, and age × emotion interactions on intramodule and intermodule connectivity. Results revealed a significant main effect of age for intra-FP connectivity (F(1,2692) = 7.015, p = 0.008) and for connectivity between FP and SPI (F(1,2766) = 5.253, p = 0.022; Fig. 3c), indicating that intra-FP and FP-SPI connectivity increased with age. Results revealed a significant emotion effect in intra-FP (F(4,3028) = 7.487, p = 5.35e-06), intra-SPI (F(4,3028) = 4.184, p = 0.002), between FP and mPFC/PCC (F(4,3028) = 10.546, p = 1.75e-08), between FP and SPI (F(4,3028) = 3.980, p = 0.003), and between mPFC/PCC and SPI (F(4,3028) = 5.531, p = 1.9e-04) connectivity (Fig. 3c,d). Age × emotion interactions are significant for intra-mPFC/PCC connectivity (F(4,3028) = 2.724, p = 0.028). Further analysis revealed that intra-mPFC/PCC connectivity increased with age under fear (F(1,754) = 3.910, p = 0.048) and anger (F(1,754) = 4.579, p = 0.033) but not the other three emotion categories (p values > 0.1).

Developmental changes in interregional connectivity

Using the modular architecture identified in the previous sections, we examined main effects of age, emotion, and age × emotion interactions on interregional connectivity. All results are reported at q < 0.05, FDR corrected for multiple comparisons.

Main effect of age

We found age-related increases within FP and SPI modules, between FP and SPI modules, and between mPFC/PCC and SPI modules, including left dlPFC connectivity with right dAI, right vAI connectivity with right sgACC and bilateral PI, right BNST connectivity with right IPL and SPL, and right BLA connectivity with left PI (Fig. 5a). We found age-related decreases within mPFC/PCC and SPI modules, including right sgACC connectivity with left vmPFC and left CMA connectivity with right CMA and left PI. In addition, we found two links (left NAc connectivity with bilateral dACC), which showed significant quadratic age effects, consistent with findings in the literature regarding enhanced sensitivity of dopaminergic reward circuits in adolescence (Padmanabhan et al., 2011; Padmanabhan and Luna, 2014).

Figure 5.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 5.

Main effects of age and emotion on regional connectivity. a, Connectivity within FP and SPI modules, between FP and SPI modules, and between mPFC/PCC and SPI modules increased with age, including left dlPFC connectivity with right dAI, right vAI connectivity with right sgACC and bilateral PI, right BNST connectivity with right IPL and SPL, and right BLA connectivity with left PI. Connectivity within mPFC/PCC and SPI modules decreased with age, including right sgACC connectivity with left vmPFC and left CMA connectivity with right CMA and left PI. Emotion effects are widespread, especially within FP module, between FP and mPFC/PCC modules, between FP and SPI modules, and between mPFC/PCC and SPI modules. b, Reliability of age-related changes in regional connectivity across all brain regions increased with sample size. A sample size of 50 is sufficient for reliability to surpass the 95th percentile of its corresponding empirical null distribution (dashed line), and a minimum sample size of 200–250 was needed to identify reliable age-related changes. c, Classification analysis showed that it was sufficient to discriminate all pairs of emotion categories using all interregional links, with classification accuracy ranging from 56.2% to 67.2% and significantly higher than chance level as assessed by permutation test.

Main effect of emotion

We found widespread emotion effect, especially within FP module, between FP and mPFC/PCC modules, between FP and SPI modules, and between mPFC/PCC and SPI modules (Fig. 5a). Classification analysis revealed that it was sufficient to discriminate all pairs of emotion categories using all interregional links (Fig. 5c), with classification accuracy ranging from 56.2% to 67.2% and significantly higher than chance level (p values < 0.01) as assessed by permutation test.

Age × emotion interactions

No age × emotion interactions were found.

Reliability of age-related changes

To examine the robustness of our age-related changes and the effect of sample size on reliability, we performed reliability analysis (Fig. 1d). Briefly, we randomly drew N (sample size) participants from the full sample and assessed age-related changes in the subsample using linear mixed-effect model. This was repeated 1000 times at each sample size across a wide range of sample sizes (50 ≤ N ≤ 400, increased by 50). Correlation between age effects from a subsample and that from the full sample was calculated and then averaged across subsamples at each sample size. The resulting average correlation was used to measure the reliability of overall developmental patterns across all interregional links. We found that reliability increased with sample size, that a minimum sample size of 50 was sufficient for reliability to surpass the 95th percentile of its corresponding empirical null distribution, and that a minimum sample size of 200–250 was needed to identify reliable (reliability > 0.7) age-related changes (Fig. 5b). These results highlight the robustness of our main age-related effects and indicate that large samples are needed to produce reliable findings.

Amygdala responses are invariant with age, whereas FP node responses decrease with age

We examined main effects of age, emotion, and age × emotion interactions on regional brain activity in each of the ROIs. All results reported here at q < 0.05, FDR corrected for multiple comparisons.

Main effect of age

We found significant age-related decreases in cognitive control regions, including bilateral pre-SMA, dACC and dlPFC, left SPL, right IPL, and right lOFC (Fig. 6ai).

Figure 6.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 6.

Main effects of age and emotion on regional activity. ai, Brain regions showing age-related changes. Activity in cognitive control regions, including bilateral pre-SMA, dACC, dlPFC, left SPM, right IPL, and right lOFC, decreased with age. Node size was scaled to present effect size of age-related decrease. aii, Reliability of age-related changes across all brain regions. A minimum sample size of 50–100 was needed for reliability to surpass the 95th percentile of its corresponding empirical null distribution (dashed line), and a minimum sample size of 50–100 was needed to identify reliable (correlation > 0.7) age-related changes. bi, Brain regions showing emotion effects. Node size was scaled to present F value of emotion effect. bii, Activity in all brain regions, except bilateral BNST, varied across emotion category.

Main effect of emotion

We found a significant emotion effect in all ROIs, except bilateral BNST (Fig. 6b).

Age × emotion interactions

No age × emotion interactions were found.

Reliability of age-related changes

We performed reliability analysis using the procedure same to that described in Developmental changes in interregional connectivity (Fig. 1d). We found that reliability increased with sample size, that a minimum sample size of 50–100 was sufficient for reliability to surpass the 95th percentile of its corresponding empirical null distribution, and that a minimum sample size of 150–200 was needed to identify reliable (reliability > 0.7) age-related changes (Fig. 6aii). These results highlight the robustness of our main age-related effects and indicate that large samples are needed to produce reliable findings.

Replicability of previous developmental findings related to amygdala circuitry

Given the inconsistencies with regards to developmental changes in amygdala recruitment and connectivity in the extant literature, we further examined age-related changes in the current large sample using precise anatomical coordinates reported in three previously published studies with similar emotion face recognition tasks, experimental contrasts, and age ranges (Table 4) (Gee et al., 2013; Kujawa et al., 2016; Wu et al., 2016).

Amygdala activity

Gee et al. (2013) reported age-related decreases in right amygdala activity during fearful face processing. We first included all five emotion categories in our linear mixed-effect model and did not identify age effect or age × emotion interactions in their reported amygdala region in the current PNC sample (F values < 2, p values > 0.1). We further examined age-related changes for each of the five emotion categories and still did not identify any age-related changes (Table 5). Kujawa et al. (2016) and Wu et al. (2016) reported no age-related changes in amygdala activity during identification of happy, fearful, and angry faces. When we included all five emotion categories in our linear mixed-effect model, we found no age-related changes or age × emotion interactions (F values < 1, p values > 0.1). When we included only fear, anger, and happy, the three emotion categories used in Kujawa et al. (2016) and Wu et al. (2016) studies, we found significant age-related increases (F(1,1886) = 4.357, p = 0.037, effect size = 0.076) and age × emotion interactions (F(2,1514) = 5.804, p = 0.003) in left amygdala using coordinates reported by Kujawa et al. (2016), and significant age-related increases (F(1,1681) = 4.962, p = 0.026, effect size = 0.081) in right amygdala using coordinates reported by Wu et al. (2016). We further examined age-related changes for each of the five emotion categories. Age-related increases were found in the left amygdala under fear, sad, and happy using coordinates reported by Kujawa et al. (2016) and in bilateral amygdala under fear, sad, and/or happy using coordinates reported by Wu et al. (2016) (Table 5). In summary, our replication results from the large sample are partially consistent with Kujawa et al. (2016) and Wu et al. (2016) findings and inconsistent with Gee et al. (2013) findings (see Table 7).

View this table:
  • View inline
  • View popup
Table 5.

Age-related changes in amygdala activity in the PNC sample using coordinates from previous studiesa

Amygdala connectivity

Gee et al. (2013) reported age-related decreases in the right amygdala-vmPFC connectivity during fearful face processing. We included five emotion categories in our linear mixed-effect model and did not identify age effect or age × emotion interactions in their reported amygdala-vmPFC regions in the current PNC sample (F values < 1, p values > 0.1). We further examined age-related changes for each of the five emotion categories and did not identify any age-related changes (Table 6). Kujawa et al. (2016) reported age-related decreases in bilateral amygdala-dACC connectivity during happy, angry, and fearful face identification in typically developing individuals. When we included five emotion categories in linear mixed-effect model, we found no age-related changes or age × emotion interactions using the reported coordinates (F values < 1, p values > 0.1). When we included only fear, anger, and happy, the three emotion categories used in the Kujawa et al. (2016) study, we found a significant age-related increases in right amygdala-dACC connectivity (F(1,2011) = 8.250, p = 0.004, effect size = 0.104). We further examined age-related changes for each of the five emotion categories. Age-related increases were found in left amygdala-dACC under fear and happy and in right amygdala-dACC under fear, anger, and sad (Table 6). Finally, Wu et al. (2016) reported age-related decreases in bilateral amygdala-mPFC/ACC during identification of fearful, angry, and happy faces. When we included all five emotion categories in linear mixed-effect model, we found no age effect or age × emotion interactions (F values < 2, p values > 0.1). When we included only fear, anger, and happy, the three emotion categories used in the Wu et al. (2016) study, we found significant age-related increases in right amygdala connectivity with left mPFC (F(1,2041) = 8.046, p = 0.005, effect size = 0.103) and right ACC (F(1,2037) = 6.749, p = 0.009, effect size = 0.094). We further examined age-related changes for each of the five emotion categories and found age-related increases in bilateral amygdala-mPFC/ACC connectivity under fear and/or anger (Table 6).

View this table:
  • View inline
  • View popup
Table 6.

Age-related changes in amygdala connectivity in the PNC sample using coordinates from previous studiesa

Amygdala connectivity (gPPI analysis)

Because previous developmental studies of amygdala connectivity have used PPI (Gee et al., 2013) or gPPI techniques (Kujawa et al., 2016; Wu et al., 2016), we conducted additional analyses using a similar approach. When we included the five emotion categories in linear mixed-effect model, we did not find a main effect of age, or age × emotion interactions in analyses using coordinates from the three studies (F values < 1.5, p values > 0.1). When we included only fear, anger and happy in linear mixed-effect model, we did not identify age effect or age × emotion interactions in any of the amygdala connectivity using coordinates from Kujawa et al. (2016) and Wu et al. (2016) studies (F values < 2.2, p values > 0.1). Finally, we examined age-related changes for each emotion category. Results revealed no age effect using coordinates reported in Gee et al. (2013) study (F values < 2, p values > 0.1) but significant age-related increases in bilateral amygdala-dACC connectivity under fear (left: F(1,754) = 5.602, p = 0.018, effect size = 0.088; right: F(1,754) = 4.605, p = 0.032, effect size = 0.080) using coordinates reported by Kujawa et al. (2016) as well as in left amygdala-mPFC connectivity under fear (F(1,754) = 7.041, p = 0.008, effect size = 0.099) using coordinates reported by Wu et al. (2016). These results are consistent with those derived using β time series analysis, as described in Amygdala connectivity.

Together, these results point to poor replicability of previous developmental findings on amygdala connectivity associated with emotion processing (Table 7).

View this table:
  • View inline
  • View popup
Table 7.

Replicability of previous developmental findings in amygdala activity and connectivity underlying face emotion perception

Discussion

A large sample of children, adolescents, and young adults with high quality emotion perception task fMRI data from the PNC (Satterthwaite et al., 2014) afforded us an unprecedented opportunity to address critical gaps in our knowledge regarding the development of human emotion identification circuits. We used a multipronged analytical strategy to investigate the development of functional circuits associated with perception and identification of five distinct emotion categories: fear, anger, sadness, happiness, and neutral. Our analysis disentangled aspects of emotion-related brain circuitry that were stable over development and those that changed with age. We found a developmentally stable modular architecture anchored in the salience, default mode, and central executive networks, with hubs in the mPFC and emotion-related reconfiguration of the salience network. Developmental changes were most prominent in FP circuits important for salience detection and cognitive control. Crucially, reliability analyses provided quantitative evidence for the robustness of our findings. Our findings provide a new template for investigation of emotion processing in the developing brain.

Maturation of emotion identification and specificity with respect to high arousal-negative emotions

Behaviorally, facial emotion identification emerges early in infancy with continued improvements through childhood and adolescence (Batty and Taylor, 2006; Thomas et al., 2007; Rodger et al., 2015; Leitzke and Pollak, 2016; Theurel et al., 2016). We found that, although emotion identification accuracy was high for all five emotion categories, even in the youngest individuals (age 8), identification of fear and anger emotion categories improved significantly with age, consistent with previous reports (Gee et al., 2013; Kujawa et al., 2016; Wu et al., 2016). These findings suggest that high arousal-negative (“threat-related”) emotions show more prominent differentiation, allowing for further sharpening of emotion concepts with age (Widen, 2013; Nook et al., 2017).

Architecture and developmental stability of emotion circuitry

Network analysis of interregional connectivity provided novel evidence for a developmentally stable architecture of emotion-related circuitry. We found three distinct communities (FP, mPFC/PCC, and SPI) that shared similarities with canonical intrinsic salience, central executive, and default mode networks (Menon, 2011), with some key differences.

We found significant reconfiguration of the salience network during emotion identification, including segregation of individual insula subdivisions, amygdala, and dACC, into separate modules. The dorsal AI and the dACC grouped with the FP community of cognitive control systems, whereas the ventral AI, PI, and amygdala grouped with the SPI module of subcortical/limbic systems. This is noteworthy because the dorsal, ventral, anterior, and posterior subdivisions of the insula play distinct and integrative roles in cognitive-affective aspects of emotion perception (Craig, 2009; Menon and Uddin, 2010; Uddin et al., 2014). Findings provide novel evidence that the overall functional architecture of emotion identification is largely stable across development and different categories of emotion.

Multiple mPFC regions form a developmentally stable core of emotion circuitry

Network analysis also revealed developmentally stable hubs in mPFC regions pgACC, vmPFC, and dmPFC across all five emotion categories. These regions play central roles in socioemotional processing (Phillips et al., 2003; Ochsner et al., 2004; Peelen et al., 2010) The vmPFC and dmPFC are thought to be important for self-referential processing and mentalizing (Ochsner et al., 2012; Dixon et al., 2017), whereas the pgACC is important for awareness of one's own emotions (Lane et al., 2015; Dixon et al., 2017). Last, our results are in line with the theoretical framework that the mPFC plays a central role in emotion categorization by tuning other brain systems to distinct emotion categories (Heberlein et al., 2008; Roy et al., 2012; Barrett and Satpute, 2013; Satpute et al., 2013, 2016).

Surprisingly, while the PCC was part of the same module as the mPFC, it was not a hub region, despite being consistently identified as hub in intrinsic functional connectivity studies (Buckner et al., 2008; Fransson and Marrelec, 2008; Greicius et al., 2009; Andrews-Hanna et al., 2010). These key differences between intrinsic and task-based network organization argue for the critical importance of characterizing task-dependent brain circuits.

Modular and regional connectivity changes are largely driven by emotion category and are stable with age

Anchored on a stable modular architecture, we found significant differences in intramodule and intermodule and regional connectivity associated with emotion category, and to a lesser degree age. Prominent differences between emotion categories provide evidence that distinct emotions, although anchored in a common modular architecture, may be represented differently in the brain at the network level (Kragel and LaBar, 2015; Saarimäki et al., 2016). Our support vector machine-based classification provides evidence of unique brain connectivity patterns elicited by each emotion category and indicate differential patterns of distributed network connectivity patterns involving the same regions (Barrett, 2017).

While module connectivity was largely developmentally stable, two findings of age-related changes are noteworthy. First, significant age-related increases in FP intramodule connectivity point to continued maturation of FP control systems underlying emotion categorization over development (Ahmed et al., 2015; Guyer et al., 2016). Second, age-related increases in mPFC/PCC intramodule connectivity during identification of fearful and angry faces suggest that maturation of midline DMN systems underlie continued developmental improvements in perception of threat and high emotion-arousal emotions. Last, significant developmental changes in regional connectivity centered predominantly on the insula, a core node of the salience network, highlighting a central and previously underrecognized role of the insula in the development of emotion perception and identification.

Developmental changes in amygdala reactivity and amygdala-PFC circuits

Surprisingly, we did not detect developmental changes in the amygdala and its functional circuity, given that amygdala and its connectivity with the mPFC have been the focus of developmental studies of emotion processing, but with contradictory findings (for a summary, see Table 1). To address these discrepancies, we examined amygdala activity and amygdala-mPFC connectivity in our PNC cohort using specific amygdala seed and mPFC target regions from three published studies with similar emotion face recognition tasks, experimental contrasts, and age ranges (Gee et al., 2013; Kujawa et al., 2016; Wu et al., 2016). We were unable to replicate the findings of these previous studies, suggesting that small samples, and not differences in amygdala and mPFC coordinates, are a major contributor to the discrepancies between the current and previous studies. These findings suggest that a narrow focus on amygdala-mPFC connectivity has precluded characterization of other important brain regions, most notably the insula and other PFC regions, underlying the development of emotion perception and categorization.

Further studies are needed to determine the extent to which differences in experimental design contributed to inconsistent patterns of developmental changes in amygdala activity and connectivity reported in previous studies. Critically, addressing this question will require much larger developmental samples than used in previous studies, along with stability and reliability analyses as in the present study.

Neutral faces engage emotion circuitry in the context of emotion identification

Another surprising finding of our study was that neutral faces showed distributed and strong levels of activity and connectivity across the three modules. Disambiguation of neural faces from other emotions would require perception, evaluation, and decision-making and, as our data indicate, engage emotion perception and categorization circuits. Moreover, the classification rates for neutral faces were no different from those between the other emotions. These findings suggest that previous findings with neutral faces as a control condition in emotion identification tasks should be reassessed and interpreted with caution. This is also an important consideration for future studies of emotion identification.

Reliability analyses highlight robustness of findings

Lack of replication arising from small sample sizes is a significant problem in neuroscience research (Button et al., 2013; Szucs and Ioannidis, 2017). We examined the robustness of our findings by assessing reliability of findings at different sample sizes (Schaer et al., 2015; Moser et al., 2018; Turner et al., 2018). We found that sample sizes of ∼200–300 allowed us to achieve a reliability of ≥0.70, providing strong evidence for the role of sample size in generating potentially reproducible findings and that the modest sample sizes of 25–65 used in previous studies have low reliability (<0.5).

It is also important to note that logistical challenges often preclude individual research groups from collecting large samples of data, which can significantly impede scientific progress (Nee, 2019). The recent curation and sharing of large-scale neurodevelopmental datasets, such as the PNC, provide a promising solution to this challenge and afford the opportunity to begin reconciliation of mixed findings in the extant literature.

In conclusion, emotion identification and categorization are fundamental to affective and cognitive development and involve integration of multiple widely distributed brain systems. We used quantitatively rigorous procedures that span multiple levels of regional, circuit, and network analysis and provide robust evidence for shared, unique, stable, and changing neural fingerprints of emotion perception development from childhood to adulthood. We stress the importance of large sample sizes and a systems-wide brain networks approach for understanding the development of human emotion perception.

Footnotes

  • This work was supported by National Institutes of Health Grants EB022907 and NS086085, the Stanford Child Health Research Institute Transdisciplinary Initiatives Program, and a Stanford Institute for Computational & Mathematical Engineering GPU Computing Seed Grant. We thank Drs. Kaustubh Supekar, Shaozheng Qin, Stacie Warren, and Christina Young for helpful comments on the manuscript; Katherine Duberg for proofreading the manuscript; the PNC consortium for sharing their data; and Drs. Ted Satterthwaite, Daniel Wolf, and Monica Calkins for graciously replying to our queries during the early stages of the study.

  • The authors declare no competing financial interests.

  • Correspondence should be addressed to Yuan Zhang at yuanzh{at}stanford.edu or Vinod Menon at menon{at}stanford.edu

References

  1. ↵
    1. Ahmed SP,
    2. Bittencourt-Hewitt A,
    3. Sebastian CL
    (2015) Neurocognitive bases of emotion regulation development in adolescence. Dev Cogn Neurosci 15:11–25. doi:10.1016/j.dcn.2015.07.006 pmid:26340451
    OpenUrlCrossRefPubMed
  2. ↵
    1. Andrews-Hanna JR,
    2. Reidler JS,
    3. Sepulcre J,
    4. Poulin R,
    5. Buckner RL
    (2010) Functional-anatomic fractionation of the brain's default network. Neuron 65:550–562. doi:10.1016/j.neuron.2010.02.005 pmid:20188659
    OpenUrlCrossRefPubMed
  3. ↵
    1. Avery SN,
    2. Clauss JA,
    3. Winder DG,
    4. Woodward N,
    5. Heckers S,
    6. Blackford JU
    (2014) BNST neurocircuitry in humans. Neuroimage 91:311–323. doi:10.1016/j.neuroimage.2014.01.017 pmid:24444996
    OpenUrlCrossRefPubMed
  4. ↵
    1. Barrett LF
    (2017) The theory of constructed emotion: an active inference account of interoception and categorization. Soc Cogn Affect Neurosci 12:1–23. doi:10.1093/scan/nsw154 pmid:27798257
    OpenUrlCrossRefPubMed
  5. ↵
    1. Barrett LF,
    2. Satpute AB
    (2013) Large-scale brain networks in affective and social neuroscience: towards an integrative functional architecture of the brain. Curr Opin Neurobiol 23:361–372. doi:10.1016/j.conb.2012.12.012 pmid:23352202
    OpenUrlCrossRefPubMed
  6. ↵
    1. Bates D,
    2. Machler M,
    3. Bolker BM,
    4. Walker SC
    (2015) Fitting linear mixed-effects models using lme4. J Stat Softw 67:1–48.
    OpenUrlCrossRefPubMed
  7. ↵
    1. Batty M,
    2. Taylor MJ
    (2006) The development of emotional face processing during childhood. Dev Sci 9:207–220. doi:10.1111/j.1467-7687.2006.00480.x pmid:16472321
    OpenUrlCrossRefPubMed
  8. ↵
    1. Blackford JU,
    2. Pine DS
    (2012) Neural substrates of childhood anxiety disorders: a review of neuroimaging findings. Child Adolesc Psychiatr Clin North Am 21:501–525. doi:10.1016/j.chc.2012.05.002 pmid:22800991
    OpenUrlCrossRefPubMed
  9. ↵
    1. Blakemore SJ
    (2008) The social brain in adolescence. Nat Rev Neurosci 9:267–277. doi:10.1038/nrn2353 pmid:18354399
    OpenUrlCrossRefPubMed
  10. ↵
    1. Blondel VD,
    2. Guillaume JL,
    3. Lambiotte R,
    4. Lefebvre E
    (2008) Fast unfolding of communities in large networks. J Statist Mech: Theory Exp 10:P10008.
    OpenUrl
  11. ↵
    1. Braunstein LM,
    2. Gross JJ,
    3. Ochsner KN
    (2017) Explicit and implicit emotion regulation: a multi-level framework. Soc Cogn Affect Neurosci 12:1545–1557. doi:10.1093/scan/nsx096 pmid:28981910
    OpenUrlCrossRefPubMed
  12. ↵
    1. Buckner RL,
    2. Andrews-Hanna JR,
    3. Schacter DL
    (2008) The brain's default network: anatomy, function, and relevance to disease. Ann N Y Acad Sci 1124:1–38. doi:10.1196/annals.1440.011 pmid:18400922
    OpenUrlCrossRefPubMed
  13. ↵
    1. Buhle JT,
    2. Silvers JA,
    3. Wager TD,
    4. Lopez R,
    5. Onyemekwu C,
    6. Kober H,
    7. Weber J,
    8. Ochsner KN
    (2014) Cognitive reappraisal of emotion: a meta-analysis of human neuroimaging studies. Cereb Cortex 24:2981–2990. doi:10.1093/cercor/bht154 pmid:23765157
    OpenUrlCrossRefPubMed
  14. ↵
    1. Button KS,
    2. Ioannidis JP,
    3. Mokrysz C,
    4. Nosek BA,
    5. Flint J,
    6. Robinson ES,
    7. Munafò MR
    (2013) Power failure: why small sample size undermines the reliability of neuroscience. Nat Rev Neurosci 14:365–376. doi:10.1038/nrn3475 pmid:23571845
    OpenUrlCrossRefPubMed
  15. ↵
    1. Chang LJ,
    2. Yarkoni T,
    3. Khaw MW,
    4. Sanfey AG
    (2013) Decoding the role of the insula in human cognition: functional parcellation and large-scale reverse inference. Cereb Cortex 23:739–749. doi:10.1093/cercor/bhs065 pmid:22437053
    OpenUrlCrossRefPubMed
  16. ↵
    1. Craig AD
    (2009) How do you feel–now? The anterior insula and human awareness. Nat Rev Neurosci 10:59–70. doi:10.1038/nrn2555 pmid:19096369
    OpenUrlCrossRefPubMed
  17. ↵
    1. Deen B,
    2. Pitskel NB,
    3. Pelphrey KA
    (2011) Three systems of insular functional connectivity identified with cluster analysis. Cereb Cortex 21:1498–1506. doi:10.1093/cercor/bhq186 pmid:21097516
    OpenUrlCrossRefPubMed
  18. ↵
    1. Dixon ML,
    2. Thiruchselvam R,
    3. Todd R,
    4. Christoff K
    (2017) Emotion and the prefrontal cortex: an integrative review. Psychol Bull 143:1033–1081. doi:10.1037/bul0000096 pmid:28616997
    OpenUrlCrossRefPubMed
  19. ↵
    1. Dosenbach NU,
    2. Koller JM,
    3. Earl EA,
    4. Miranda-Dominguez O,
    5. Klein RL,
    6. Van AN,
    7. Snyder AZ,
    8. Nagel BJ,
    9. Nigg JT,
    10. Nguyen AL,
    11. Wesevich V,
    12. Greene DJ,
    13. Fair DA
    (2017) Real-time motion analytics during brain MRI improve data quality and reduce costs. Neuroimage 161:80–93. doi:10.1016/j.neuroimage.2017.08.025 pmid:28803940
    OpenUrlCrossRefPubMed
  20. ↵
    1. Dosenbach NU,
    2. Fair DA,
    3. Miezin FM,
    4. Cohen AL,
    5. Wenger KK,
    6. Dosenbach RA,
    7. Fox MD,
    8. Snyder AZ,
    9. Vincent JL,
    10. Raichle ME,
    11. Schlaggar BL,
    12. Petersen SE
    (2007) Distinct brain networks for adaptive and stable task control in humans. Proc Natl Acad Sci U S A 104:11073–11078. doi:10.1073/pnas.0704320104 pmid:17576922
    OpenUrlAbstract/FREE Full Text
  21. ↵
    1. Dwyer DB,
    2. Harrison BJ,
    3. Yücel M,
    4. Whittle S,
    5. Zalesky A,
    6. Pantelis C,
    7. Allen NB,
    8. Fornito A
    (2014) Large-scale brain network dynamics supporting adolescent cognitive control. J Neurosci 34:14096–14107. doi:10.1523/JNEUROSCI.1634-14.2014 pmid:25319705
    OpenUrlAbstract/FREE Full Text
  22. ↵
    1. Eickhoff SB,
    2. Stephan KE,
    3. Mohlberg H,
    4. Grefkes C,
    5. Fink GR,
    6. Amunts K,
    7. Zilles K
    (2005) A new SPM toolbox for combining probabilistic cytoarchitectonic maps and functional imaging data. Neuroimage 25:1325–1335. doi:10.1016/j.neuroimage.2004.12.034 pmid:15850749
    OpenUrlCrossRefPubMed
  23. ↵
    1. Eklund A,
    2. Nichols TE,
    3. Knutsson H
    (2016) Cluster failure: why fMRI inferences for spatial extent have inflated false-positive rates. Proc Natl Acad Sci U S A 113:7900–7905. doi:10.1073/pnas.1602413113 pmid:27357684
    OpenUrlAbstract/FREE Full Text
  24. ↵
    1. Engelhardt LE,
    2. Roe MA,
    3. Juranek J,
    4. DeMaster D,
    5. Harden KP,
    6. Tucker-Drob EM,
    7. Church JA
    (2017) Children's head motion during fMRI tasks is heritable and stable over time. Dev Cogn Neurosci 25:58–68. doi:10.1016/j.dcn.2017.01.011 pmid:28223034
    OpenUrlCrossRefPubMed
  25. ↵
    1. Etkin A
    (2010) Functional neuroanatomy of anxiety: a neural circuit perspective. Curr Top Behav Neurosci 2:251–277. pmid:21309113
    OpenUrlCrossRefPubMed
  26. ↵
    1. Fan L,
    2. Li H,
    3. Zhuo J,
    4. Zhang Y,
    5. Wang J,
    6. Chen L,
    7. Yang Z,
    8. Chu C,
    9. Xie S,
    10. Laird AR,
    11. Fox PT,
    12. Eickhoff SB,
    13. Yu C,
    14. Jiang T
    (2016) The human Brainnetome atlas: a new brain atlas based on connectional architecture. Cereb Cortex 26:3508–3526. doi:10.1093/cercor/bhw157 pmid:27230218
    OpenUrlCrossRefPubMed
  27. ↵
    1. Floresco SB
    (2015) The nucleus accumbens: an interface between cognition, emotion, and action. Annu Rev Psychol 66:25–52. doi:10.1146/annurev-psych-010213-115159 pmid:25251489
    OpenUrlCrossRefPubMed
  28. ↵
    1. Fortunato S,
    2. Barthélemy M
    (2007) Resolution limit in community detection. Proc Natl Acad Sci U S A 104:36–41. doi:10.1073/pnas.0605965104 pmid:17190818
    OpenUrlAbstract/FREE Full Text
  29. ↵
    1. Fransson P,
    2. Marrelec G
    (2008) The precuneus/posterior cingulate cortex plays a pivotal role in the default mode network: evidence from a partial correlation network analysis. Neuroimage 42:1178–1184. doi:10.1016/j.neuroimage.2008.05.059 pmid:18598773
    OpenUrlCrossRefPubMed
  30. ↵
    1. Fusar-Poli P,
    2. Placentino A,
    3. Carletti F,
    4. Landi P,
    5. Allen P,
    6. Surguladze S,
    7. Benedetti F,
    8. Abbamonte M,
    9. Gasparotti R,
    10. Barale F,
    11. Perez J,
    12. McGuire P,
    13. Politi P
    (2009) Functional atlas of emotional faces processing: a voxel-based meta-analysis of 105 functional magnetic resonance imaging studies. J Psychiatry Neurosci 34:418–432. pmid:19949718
    OpenUrlCrossRefPubMed
  31. ↵
    1. Gee DG,
    2. Humphreys KL,
    3. Flannery J,
    4. Goff B,
    5. Telzer EH,
    6. Shapiro M,
    7. Hare TA,
    8. Bookheimer SY,
    9. Tottenham N
    (2013) A developmental shift from positive to negative connectivity in human amygdala-prefrontal circuitry. J Neurosci 33:4584–4593. doi:10.1523/JNEUROSCI.3446-12.2013 pmid:23467374
    OpenUrlAbstract/FREE Full Text
  32. ↵
    1. Greicius MD,
    2. Krasnow B,
    3. Reiss AL,
    4. Menon V
    (2003) Functional connectivity in the resting brain: a network analysis of the default mode hypothesis. Proc Natl Acad Sci U S A 100:253–258. doi:10.1073/pnas.0135058100 pmid:12506194
    OpenUrlAbstract/FREE Full Text
  33. ↵
    1. Greicius MD,
    2. Supekar K,
    3. Menon V,
    4. Dougherty RF
    (2009) Resting-state functional connectivity reflects structural connectivity in the default mode network. Cereb Cortex 19:72–78. doi:10.1093/cercor/bhn059 pmid:18403396
    OpenUrlCrossRefPubMed
  34. ↵
    1. Guyer AE,
    2. Silk JS,
    3. Nelson EE
    (2016) The neurobiology of the emotional adolescent: from the inside out. Neurosci Biobehav Rev 70:74–85. doi:10.1016/j.neubiorev.2016.07.037 pmid:27506384
    OpenUrlCrossRefPubMed
  35. ↵
    1. Gyurak A,
    2. Gross JJ,
    3. Etkin A
    (2011) Explicit and implicit emotion regulation: a dual-process framework. Cogn Emot 25:400–412. doi:10.1080/02699931.2010.544160 pmid:21432682
    OpenUrlCrossRefPubMed
  36. ↵
    1. Heberlein AS,
    2. Padon AA,
    3. Gillihan SJ,
    4. Farah MJ,
    5. Fellows LK
    (2008) Ventromedial frontal lobe plays a critical role in facial emotion recognition. J Cogn Neurosci 20:721–733. doi:10.1162/jocn.2008.20049 pmid:18052791
    OpenUrlCrossRefPubMed
  37. ↵
    1. Ioannidis JP
    (2005) Why most published research findings are false. PLoS Med 2:e124. doi:10.1371/journal.pmed.0020124 pmid:16060722
    OpenUrlCrossRefPubMed
  38. ↵
    1. Kober H,
    2. Barrett LF,
    3. Joseph J,
    4. Bliss-Moreau E,
    5. Lindquist K,
    6. Wager TD
    (2008) Functional grouping and cortical-subcortical interactions in emotion: a meta-analysis of neuroimaging studies. Neuroimage 42:998–1031. doi:10.1016/j.neuroimage.2008.03.059 pmid:18579414
    OpenUrlCrossRefPubMed
  39. ↵
    1. Kohn N,
    2. Eickhoff SB,
    3. Scheller M,
    4. Laird AR,
    5. Fox PT,
    6. Habel U
    (2014) Neural network of cognitive emotion regulation: an ALE meta-analysis and MACM analysis. Neuroimage 87:345–355. doi:10.1016/j.neuroimage.2013.11.001 pmid:24220041
    OpenUrlCrossRefPubMed
  40. ↵
    1. Kragel PA,
    2. LaBar KS
    (2015) Multivariate neural biomarkers of emotional states are categorically distinct. Soc Cogn Affect Neurosci 10:1437–1448. doi:10.1093/scan/nsv032 pmid:25813790
    OpenUrlCrossRefPubMed
  41. ↵
    1. Kujawa A,
    2. Wu M,
    3. Klumpp H,
    4. Pine DS,
    5. Swain JE,
    6. Fitzgerald KD,
    7. Monk CS,
    8. Phan KL
    (2016) Altered development of amygdala-anterior cingulate cortex connectivity in anxious youth and young adults. Biol Psychiatry Cogn Neurosci Neuroimaging 1:345–352. doi:10.1016/j.bpsc.2016.01.006 pmid:27525316
    OpenUrlCrossRefPubMed
  42. ↵
    1. Lancichinetti A,
    2. Fortunato S
    (2012) Consensus clustering in complex networks. Sci Rep 2:336. doi:10.1038/srep00336 pmid:22468223
    OpenUrlCrossRefPubMed
  43. ↵
    1. Lane RD,
    2. Weihs KL,
    3. Herring A,
    4. Hishaw A,
    5. Smith R
    (2015) Affective agnosia: expansion of the alexithymia construct and a new opportunity to integrate and extend Freud's legacy. Neurosci Biobehav Rev 55:594–611. doi:10.1016/j.neubiorev.2015.06.007 pmid:26054794
    OpenUrlCrossRefPubMed
  44. ↵
    1. Lebow MA,
    2. Chen A
    (2016) Overshadowed by the amygdala: the bed nucleus of the stria terminalis emerges as key to psychiatric disorders. Mol Psychiatry 21:450–463. doi:10.1038/mp.2016.1 pmid:26878891
    OpenUrlCrossRefPubMed
  45. ↵
    1. LeDoux J
    (2007) The amygdala. Curr Biol 17:R868–R874. doi:10.1016/j.cub.2007.08.005 pmid:17956742
    OpenUrlCrossRefPubMed
  46. ↵
    1. Leitzke BT,
    2. Pollak SD
    (2016) Developmental changes in the primacy of facial cues for emotion recognition. Dev Psychol 52:572–581. doi:10.1037/a0040067 pmid:26784383
    OpenUrlCrossRefPubMed
  47. ↵
    1. Lv Q,
    2. Yang L,
    3. Li G,
    4. Wang Z,
    5. Shen Z,
    6. Yu W,
    7. Jiang Q,
    8. Hou B,
    9. Pu J,
    10. Hu H,
    11. Wang Z
    (2016) Large-scale persistent network reconfiguration induced by ketamine in anesthetized monkeys: relevance to mood disorders. Biol Psychiatry 79:765–775. doi:10.1016/j.biopsych.2015.02.028 pmid:25837427
    OpenUrlCrossRefPubMed
  48. ↵
    1. Menon V
    (2011) Large-scale brain networks and psychopathology: a unifying triple network model. Trends Cogn Sci 15:483–506. doi:10.1016/j.tics.2011.08.003 pmid:21908230
    OpenUrlCrossRefPubMed
  49. ↵
    1. Menon V
    (2013) Developmental pathways to functional brain networks: emerging principles. Trends Cogn Sci 17:627–640. doi:10.1016/j.tics.2013.09.015 pmid:24183779
    OpenUrlCrossRefPubMed
  50. ↵
    1. Menon V,
    2. Uddin LQ
    (2010) Saliency, switching, attention and control: a network model of insula function. Brain Struct Funct 214:655–667. doi:10.1007/s00429-010-0262-0 pmid:20512370
    OpenUrlCrossRefPubMed
  51. ↵
    1. Moser DA,
    2. Doucet GE,
    3. Lee WH,
    4. Rasgon A,
    5. Krinsky H,
    6. Leibu E,
    7. Ing A,
    8. Schumann G,
    9. Rasgon N,
    10. Frangou S
    (2018) Multivariate associations among behavioral, clinical, and multimodal imaging phenotypes in patients with psychosis. JAMA Psychiatry 75:386–395. doi:10.1001/jamapsychiatry.2017.4741 pmid:29516092
    OpenUrlCrossRefPubMed
  52. ↵
    1. Namkung H,
    2. Kim SH,
    3. Sawa A
    (2017) The insula: an underestimated brain area in clinical neuroscience, psychiatry, and neurology. Trends Neurosci 40:200–207. doi:10.1016/j.tins.2017.02.002 pmid:28314446
    OpenUrlCrossRefPubMed
  53. ↵
    1. Nee DE
    (2019) fMRI replicability depends upon sufficient individual-level data. Commun Biol 2:130. doi:10.1038/s42003-019-0378-6 pmid:30993214
    OpenUrlCrossRefPubMed
  54. ↵
    1. Newman ME
    (2004) Fast algorithm for detecting community structure in networks. Phys Rev E Stat Nonlin Soft Matter Phys 69:066133. doi:10.1103/PhysRevE.69.066133 pmid:15244693
    OpenUrlCrossRefPubMed
  55. ↵
    1. Newman ME
    (2006) Modularity and community structure in networks. Proc Natl Acad Sci U S A 103:8577–8582. doi:10.1073/pnas.0601602103 pmid:16723398
    OpenUrlAbstract/FREE Full Text
  56. ↵
    1. Nook EC,
    2. Sasse SF,
    3. Lambert HK,
    4. McLaughlin KA,
    5. Somerville LH
    (2017) Increasing verbal knowledge mediates development of multidimensional emotion representations. Nat Hum Behav 1:881–889. doi:10.1038/s41562-017-0238-7 pmid:29399639
    OpenUrlCrossRefPubMed
  57. ↵
    1. Ochsner KN,
    2. Knierim K,
    3. Ludlow DH,
    4. Hanelin J,
    5. Ramachandran T,
    6. Glover G,
    7. Mackey SC
    (2004) Reflecting upon feelings: an fMRI study of neural systems supporting the attribution of emotion to self and other. J Cogn Neurosci 16:1746–1772. doi:10.1162/0898929042947829 pmid:15701226
    OpenUrlCrossRefPubMed
  58. ↵
    1. Ochsner KN,
    2. Silvers JA,
    3. Buhle JT
    (2012) Functional imaging studies of emotion regulation: a synthetic review and evolving model of the cognitive control of emotion. Ann N Y Acad Sci 1251:E1–E24. doi:10.1111/j.1749-6632.2012.06751.x pmid:23025352
    OpenUrlCrossRefPubMed
  59. ↵
    1. Padmanabhan A,
    2. Luna B
    (2014) Developmental imaging genetics: linking dopamine function to adolescent behavior. Brain Cogn 89:27–38. doi:10.1016/j.bandc.2013.09.011 pmid:24139694
    OpenUrlCrossRefPubMed
  60. ↵
    1. Padmanabhan A,
    2. Geier CF,
    3. Ordaz SJ,
    4. Teslovich T,
    5. Luna B
    (2011) Developmental changes in brain function underlying the influence of reward processing on inhibitory control. Dev Cogn Neurosci 1:517–529. doi:10.1016/j.dcn.2011.06.004 pmid:21966352
    OpenUrlCrossRefPubMed
  61. ↵
    1. Paulus MP,
    2. Stein MB
    (2006) An insular view of anxiety. Biol Psychiatry 60:383–387. doi:10.1016/j.biopsych.2006.03.042 pmid:16780813
    OpenUrlCrossRefPubMed
  62. ↵
    1. Peelen MV,
    2. Atkinson AP,
    3. Vuilleumier P
    (2010) Supramodal representations of perceived emotions in the human brain. J Neurosci 30:10127–10134. doi:10.1523/JNEUROSCI.2161-10.2010 pmid:20668196
    OpenUrlAbstract/FREE Full Text
  63. ↵
    1. Phillips ML,
    2. Drevets WC,
    3. Rauch SL,
    4. Lane R
    (2003) Neurobiology of emotion perception: II. Implications for major psychiatric disorders. Biol Psychiatry 54:515–528. doi:10.1016/S0006-3223(03)00171-9 pmid:12946880
    OpenUrlCrossRefPubMed
  64. ↵
    1. Power JD,
    2. Fair DA,
    3. Schlaggar BL,
    4. Petersen SE
    (2010) The development of human functional brain networks. Neuron 67:735–748. doi:10.1016/j.neuron.2010.08.017 pmid:20826306
    OpenUrlCrossRefPubMed
  65. ↵
    1. Qin S,
    2. Young CB,
    3. Supekar K,
    4. Uddin LQ,
    5. Menon V
    (2012) Immature integration and segregation of emotion-related brain circuitry in young children. Proc Natl Acad Sci U S A 109:7941–7946. doi:10.1073/pnas.1120408109 pmid:22547826
    OpenUrlAbstract/FREE Full Text
  66. ↵
    1. Qin S,
    2. Young CB,
    3. Duan X,
    4. Chen T,
    5. Supekar K,
    6. Menon V
    (2014) Amygdala subregional structure and intrinsic functional connectivity predicts individual differences in anxiety during early childhood. Biol Psychiatry 75:892–900. doi:10.1016/j.biopsych.2013.10.006 pmid:24268662
    OpenUrlCrossRefPubMed
  67. ↵
    1. Rissman J,
    2. Gazzaley A,
    3. D'Esposito M
    (2004) Measuring functional connectivity during distinct stages of a cognitive task. Neuroimage 23:752–763. doi:10.1016/j.neuroimage.2004.06.035 pmid:15488425
    OpenUrlCrossRefPubMed
  68. ↵
    1. Rodger H,
    2. Vizioli L,
    3. Ouyang X,
    4. Caldara R
    (2015) Mapping the development of facial expression recognition. Dev Sci 18:926–939. doi:10.1111/desc.12281 pmid:25704672
    OpenUrlCrossRefPubMed
  69. ↵
    1. Roy M,
    2. Shohamy D,
    3. Wager TD
    (2012) Ventromedial prefrontal-subcortical systems and the generation of affective meaning. Trends Cogn Sci 16:147–156. doi:10.1016/j.tics.2012.01.005 pmid:22310704
    OpenUrlCrossRefPubMed
  70. ↵
    1. Rubin TN,
    2. Koyejo O,
    3. Gorgolewski KJ,
    4. Jones MN,
    5. Poldrack RA,
    6. Yarkoni T
    (2017) Decoding brain activity using a large-scale probabilistic functional-anatomical atlas of human cognition. Plos Comput Biol 13:e1005649. doi:10.1371/journal.pcbi.1005649 pmid:29059185
    OpenUrlCrossRefPubMed
  71. ↵
    1. Rubinov M,
    2. Sporns O
    (2010) Complex network measures of brain connectivity: uses and interpretations. Neuroimage 52:1059–1069. doi:10.1016/j.neuroimage.2009.10.003 pmid:19819337
    OpenUrlCrossRefPubMed
  72. ↵
    1. Saarimäki H,
    2. Gotsopoulos A,
    3. Jääskelainen IP,
    4. Lampinen J,
    5. Vuilleumier P,
    6. Hari R,
    7. Sams M,
    8. Nummenmaa L
    (2016) Discrete neural signatures of basic emotions. Cereb Cortex 26:2563–2573. doi:10.1093/cercor/bhv086 pmid:25924952
    OpenUrlCrossRefPubMed
  73. ↵
    1. Satpute AB,
    2. Shu J,
    3. Weber J,
    4. Roy M,
    5. Ochsner KN
    (2013) The functional neural architecture of self-reports of affective experience. Biol Psychiatry 73:631–638. doi:10.1016/j.biopsych.2012.10.001 pmid:23146356
    OpenUrlCrossRefPubMed
  74. ↵
    1. Satpute AB,
    2. Nook EC,
    3. Narayanan S,
    4. Shu J,
    5. Weber J,
    6. Ochsner KN
    (2016) Emotions in “Black and White” or shades of gray? How we think about emotion shapes our perception and neural representation of emotion. Psychol Sci 27:1428–1442. doi:10.1177/0956797616661555 pmid:27670663
    OpenUrlCrossRefPubMed
  75. ↵
    1. Satterthwaite TD,
    2. Elliott MA,
    3. Ruparel K,
    4. Loughead J,
    5. Prabhakaran K,
    6. Calkins ME,
    7. Hopson R,
    8. Jackson C,
    9. Keefe J,
    10. Riley M,
    11. Mentch FD,
    12. Sleiman P,
    13. Verma R,
    14. Davatzikos C,
    15. Hakonarson H,
    16. Gur RC,
    17. Gur RE
    (2014) Neuroimaging of the Philadelphia neurodevelopmental cohort. Neuroimage 86:544–553. doi:10.1016/j.neuroimage.2013.07.064 pmid:23921101
    OpenUrlCrossRefPubMed
  76. ↵
    1. Schaer M,
    2. Kochalka J,
    3. Padmanabhan A,
    4. Supekar K,
    5. Menon V
    (2015) Sex differences in cortical volume and gyrification in autism. Mol Autism 6:42. doi:10.1186/s13229-015-0035-y pmid:26146534
    OpenUrlCrossRefPubMed
  77. ↵
    1. Seeley WW,
    2. Menon V,
    3. Schatzberg AF,
    4. Keller J,
    5. Glover GH,
    6. Kenna H,
    7. Reiss AL,
    8. Greicius MD
    (2007) Dissociable intrinsic connectivity networks for salience processing and executive control. J Neurosci 27:2349–2356. doi:10.1523/JNEUROSCI.5587-06.2007 pmid:17329432
    OpenUrlAbstract/FREE Full Text
  78. ↵
    1. Sperduti M,
    2. Makowski D,
    3. Arcangeli M,
    4. Wantzen P,
    5. Zalla T,
    6. Lemaire S,
    7. Dokic J,
    8. Pelletier J,
    9. Piolino P
    (2017) The distinctive role of executive functions in implicit emotion regulation. Acta Psychol (Amst) 173:13–20. doi:10.1016/j.actpsy.2016.12.001 pmid:27978422
    OpenUrlCrossRefPubMed
  79. ↵
    1. Sporns O,
    2. Betzel RF
    (2016) Modular brain networks. Annu Rev Psychol 67:613–640. doi:10.1146/annurev-psych-122414-033634 pmid:26393868
    OpenUrlCrossRefPubMed
  80. ↵
    1. Szucs D,
    2. Ioannidis JP
    (2017) Empirical assessment of published effect sizes and power in the recent cognitive neuroscience and psychology literature. PLoS Biol 15:e2000797. doi:10.1371/journal.pbio.2000797 pmid:28253258
    OpenUrlCrossRefPubMed
  81. ↵
    1. Theurel A,
    2. Witt A,
    3. Malsert J,
    4. Lejeune F,
    5. Fiorentini C,
    6. Barisnikov K,
    7. Gentaz E
    (2016) The integration of visual context information in facial emotion recognition in 5- to 15-year-olds. J Exp Child Psychol 150:252–271. doi:10.1016/j.jecp.2016.06.004 pmid:27367301
    OpenUrlCrossRefPubMed
  82. ↵
    1. Thomas LA,
    2. De Bellis MD,
    3. Graham R,
    4. LaBar KS
    (2007) Development of emotional facial recognition in late childhood and adolescence. Dev Sci 10:547–558. doi:10.1111/j.1467-7687.2007.00614.x pmid:17683341
    OpenUrlCrossRefPubMed
  83. ↵
    1. Tupak SV,
    2. Dresler T,
    3. Guhn A,
    4. Ehlis AC,
    5. Fallgatter AJ,
    6. Pauli P,
    7. Herrmann MJ
    (2014) Implicit emotion regulation in the presence of threat: neural and autonomic correlates. Neuroimage 85:372–379. doi:10.1016/j.neuroimage.2013.09.066 pmid:24096027
    OpenUrlCrossRefPubMed
  84. ↵
    1. Turner BO,
    2. Paul EJ,
    3. Miller MB,
    4. Barbey AK
    (2018) Small sample sizes reduce the replicability of task-based fMRI studies. Commun Biol 1:62. doi:10.1038/s42003-018-0073-z pmid:30271944
    OpenUrlCrossRefPubMed
  85. ↵
    1. Uddin LQ,
    2. Kinnison J,
    3. Pessoa L,
    4. Anderson ML
    (2014) Beyond the tripartite cognition-emotion-interoception model of the human insular cortex. J Cogn Neurosci 26:16–27. doi:10.1162/jocn_a_00462 pmid:23937691
    OpenUrlCrossRefPubMed
  86. ↵
    1. Vink M,
    2. Derks JM,
    3. Hoogendam JM,
    4. Hillegers M,
    5. Kahn RS
    (2014) Functional differences in emotion processing during adolescence and early adulthood. Neuroimage 91:70–76. doi:10.1016/j.neuroimage.2014.01.035 pmid:24468408
    OpenUrlCrossRefPubMed
  87. ↵
    1. Widen SC
    (2013) Children's interpretation of facial expressions: the long path from valence-based to specific discrete categories. Emotion Rev 5:72–77. doi:10.1177/1754073912451492
    OpenUrlCrossRef
  88. ↵
    1. Wolf RC,
    2. Herringa RJ
    (2016) Prefrontal-amygdala dysregulation to threat in pediatric posttraumatic stress disorder. Neuropsychopharmacology 41:822–831. doi:10.1038/npp.2015.209 pmid:26171717
    OpenUrlCrossRefPubMed
  89. ↵
    1. Wu M,
    2. Kujawa A,
    3. Lu LH,
    4. Fitzgerald DA,
    5. Klumpp H,
    6. Fitzgerald KD,
    7. Monk CS,
    8. Phan KL
    (2016) Age-related changes in amygdala-frontal connectivity during emotional face processing from childhood into young adulthood. Hum Brain Mapp 37:1684–1695. doi:10.1002/hbm.23129 pmid:26931629
    OpenUrlCrossRefPubMed
  90. ↵
    1. Xia M,
    2. Wang J,
    3. He Y
    (2013) BrainNet viewer: a network visualization tool for human brain connectomics. PLoS One 8:e68910. doi:10.1371/journal.pone.0068910 pmid:23861951
    OpenUrlCrossRefPubMed
  91. ↵
    1. Yan CG,
    2. Craddock RC,
    3. He Y,
    4. Milham MP
    (2013) Addressing head motion dependencies for small-world topologies in functional connectomics. Front Hum Neurosci 7:910. doi:10.3389/fnhum.2013.00910 pmid:24421764
    OpenUrlCrossRefPubMed
  92. ↵
    1. Yarkoni T,
    2. Poldrack RA,
    3. Nichols TE,
    4. Van Essen DC,
    5. Wager TD
    (2011) Large-scale automated synthesis of human functional neuroimaging data. Nat Methods 8:665–670. doi:10.1038/nmeth.1635 pmid:21706013
    OpenUrlCrossRefPubMed
  93. ↵
    1. Yuan W,
    2. Altaye M,
    3. Ret J,
    4. Schmithorst V,
    5. Byars AW,
    6. Plante E,
    7. Holland SK
    (2009) Quantification of head motion in children during various fMRI language tasks. Hum Brain Mapp 30:1481–1489. doi:10.1002/hbm.20616 pmid:18636549
    OpenUrlCrossRefPubMed
Back to top

In this issue

The Journal of Neuroscience: 39 (36)
Journal of Neuroscience
Vol. 39, Issue 36
4 Sep 2019
  • Table of Contents
  • Table of Contents (PDF)
  • About the Cover
  • Index by author
  • Advertising (PDF)
  • Ed Board (PDF)
Email

Thank you for sharing this Journal of Neuroscience article.

NOTE: We request your email address only to inform the recipient that it was you who recommended this article, and that it is not junk mail. We do not retain these email addresses.

Enter multiple addresses on separate lines or separate them with commas.
Development of Human Emotion Circuits Investigated Using a Big-Data Analytic Approach: Stability, Reliability, and Robustness
(Your Name) has forwarded a page to you from Journal of Neuroscience
(Your Name) thought you would be interested in this article in Journal of Neuroscience.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Print
View Full Page PDF
Citation Tools
Development of Human Emotion Circuits Investigated Using a Big-Data Analytic Approach: Stability, Reliability, and Robustness
Yuan Zhang, Aarthi Padmanabhan, James J. Gross, Vinod Menon
Journal of Neuroscience 4 September 2019, 39 (36) 7155-7172; DOI: 10.1523/JNEUROSCI.0220-19.2019

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Respond to this article
Request Permissions
Share
Development of Human Emotion Circuits Investigated Using a Big-Data Analytic Approach: Stability, Reliability, and Robustness
Yuan Zhang, Aarthi Padmanabhan, James J. Gross, Vinod Menon
Journal of Neuroscience 4 September 2019, 39 (36) 7155-7172; DOI: 10.1523/JNEUROSCI.0220-19.2019
del.icio.us logo Digg logo Reddit logo Twitter logo CiteULike logo Facebook logo Google logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • Abstract
    • Introduction
    • Materials and Methods
    • Results
    • Discussion
    • Footnotes
    • References
  • Figures & Data
  • Info & Metrics
  • eLetters
  • PDF

Keywords

  • Big-Data
  • emotion perception and identification
  • functional networks
  • maturation
  • reliability
  • replicability

Responses to this article

Respond to this article

Jump to comment:

No eLetters have been published for this article.

Related Articles

Cited By...

More in this TOC Section

Research Articles

  • Prelimbic Cortex Activity during a Distress Tolerance Task Predicts Cocaine-Seeking Behavior in Male, But Not Female Rats
  • 2-AG-Mediated Control of GABAergic Signaling Is Impaired in a Model of Epilepsy
  • Identification of the Acid-Sensitive Site Critical for Chloral Hydrate (CH) Activation of the Proton-Activated Chloride Channel
Show more Research Articles

Behavioral/Cognitive

  • Prelimbic Cortex Activity during a Distress Tolerance Task Predicts Cocaine-Seeking Behavior in Male, But Not Female Rats
  • 2-AG-Mediated Control of GABAergic Signaling Is Impaired in a Model of Epilepsy
  • Identification of the Acid-Sensitive Site Critical for Chloral Hydrate (CH) Activation of the Proton-Activated Chloride Channel
Show more Behavioral/Cognitive
  • Home
  • Alerts
  • Visit Society for Neuroscience on Facebook
  • Follow Society for Neuroscience on Twitter
  • Follow Society for Neuroscience on LinkedIn
  • Visit Society for Neuroscience on Youtube
  • Follow our RSS feeds

Content

  • Early Release
  • Current Issue
  • Issue Archive
  • Collections

Information

  • For Authors
  • For Advertisers
  • For the Media
  • For Subscribers

About

  • About the Journal
  • Editorial Board
  • Privacy Policy
  • Contact
(JNeurosci logo)
(SfN logo)

Copyright © 2023 by the Society for Neuroscience.
JNeurosci Online ISSN: 1529-2401

The ideas and opinions expressed in JNeurosci do not necessarily reflect those of SfN or the JNeurosci Editorial Board. Publication of an advertisement or other product mention in JNeurosci should not be construed as an endorsement of the manufacturer’s claims. SfN does not assume any responsibility for any injury and/or damage to persons or property arising from or related to any use of any material contained in JNeurosci.