Skip to main content

Main menu

  • HOME
  • CONTENT
    • Early Release
    • Featured
    • Current Issue
    • Issue Archive
    • Collections
    • Podcast
  • ALERTS
  • FOR AUTHORS
    • Information for Authors
    • Fees
    • Journal Clubs
    • eLetters
    • Submit
  • EDITORIAL BOARD
  • ABOUT
    • Overview
    • Advertise
    • For the Media
    • Rights and Permissions
    • Privacy Policy
    • Feedback
  • SUBSCRIBE

User menu

  • Log in
  • My Cart

Search

  • Advanced search
Journal of Neuroscience
  • Log in
  • My Cart
Journal of Neuroscience

Advanced Search

Submit a Manuscript
  • HOME
  • CONTENT
    • Early Release
    • Featured
    • Current Issue
    • Issue Archive
    • Collections
    • Podcast
  • ALERTS
  • FOR AUTHORS
    • Information for Authors
    • Fees
    • Journal Clubs
    • eLetters
    • Submit
  • EDITORIAL BOARD
  • ABOUT
    • Overview
    • Advertise
    • For the Media
    • Rights and Permissions
    • Privacy Policy
    • Feedback
  • SUBSCRIBE
PreviousNext
Research Articles, Behavioral/Cognitive

Cross-Hemispheric Complementary Prefrontal Mechanisms during Task Switching under Perceptual Uncertainty

Kaho Tsumura, Ryuta Aoki, Masaki Takeda, Kiyoshi Nakahara and Koji Jimura
Journal of Neuroscience 10 March 2021, 41 (10) 2197-2213; DOI: https://doi.org/10.1523/JNEUROSCI.2096-20.2021
Kaho Tsumura
1Department of Biosciences and Informatics, Keio University, Yokohama 223-0061, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Kaho Tsumura
Ryuta Aoki
2Research Center for Brain Communication, Kochi University of Technology, Kami 782-8502, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Ryuta Aoki
Masaki Takeda
2Research Center for Brain Communication, Kochi University of Technology, Kami 782-8502, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Masaki Takeda
Kiyoshi Nakahara
2Research Center for Brain Communication, Kochi University of Technology, Kami 782-8502, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Kiyoshi Nakahara
Koji Jimura
1Department of Biosciences and Informatics, Keio University, Yokohama 223-0061, Japan
2Research Center for Brain Communication, Kochi University of Technology, Kami 782-8502, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Koji Jimura
  • Article
  • Figures & Data
  • Info & Metrics
  • eLetters
  • PDF
Loading

Abstract

Flexible adaptation to changing environments is a representative executive control function implicated in the frontoparietal network that requires appropriate extraction of goal-relevant information through perception of the external environment. It remains unclear, however, how the flexibility is achieved under situations where goal-relevant information is uncertain. To address this issue, the current study examined neural mechanisms for task switching in which task-relevant information involved perceptual uncertainty. Twenty-eight human participants of both sexes alternated behavioral tasks in which they judged motion direction or color of visually presented colored dot stimuli that moved randomly. Task switching was associated with frontoparietal regions in the left hemisphere, and perception of ambiguous stimuli involved contralateral homologous frontoparietal regions. On the other hand, in stimulus-modality-dependent occipitotemporal regions, task coding information was increased during task switching. Effective connectivity analysis revealed that the frontal regions signaled toward the modality-dependent occipitotemporal regions when a relevant stimulus was more ambiguous, whereas the occipitotemporal regions signaled toward the frontal regions when the stimulus was more distinctive. These results suggest that complementary prefrontal mechanisms in the left and right hemispheres help to achieve a behavioral goal when the external environment involves perceptual uncertainty.

SIGNIFICANCE STATEMENT In our daily life, environmental information to achieve a goal is not always certain, but we make judgments in such situations, and change our behavior accordingly. This study examined how the flexibility of behavior is achieved in a situation where goal-relevant information involves perceptual uncertainty. fMRI revealed that the lateral prefrontal cortex (PFC) in the left hemisphere is associated with behavioral flexibility, and the perception of ambiguous stimuli involves the PFC in the right hemisphere. These bilateral PFC signaled to stimulus-modality-dependent occipitotemporal regions, depending on perceptual uncertainty and the task to be performed. These top-down signals supplement task coding in the occipitotemporal regions, and highlight interhemispheric prefrontal mechanisms involved in executive control and perceptual decision-making.

  • behavioral flexibility
  • executive control
  • occipitotemporal
  • perceptual decision-making
  • prefrontal

Introduction

Executive control guides flexible adaptation to changing environments, which has been most developed in humans through evolution (Roberts et al., 1998; Fuster, 2015), and is implemented in distributed frontoparietal cortical regions (Miller and Cohen, 2001; Dosenbach et al., 2006; Duncan, 2010). Shifting between different types of behaviors is a representative executive control function (Jersild, 1927; Allport et al., 1994; Rogers and Monsell, 1995; Monsell, 2003), and task switching paradigms have often been used to investigate neural mechanisms of behavioral flexibility. Previous neuropsychological and neuroimaging studies suggest that the posterior part of the left PFC (lPFC) plays a critical role in task switching (Fig. 1A) (Konishi et al., 1998, 2002; Dove et al., 2000; Rushworth et al., 2002; Crone et al., 2006; Brass and von Cramon, 2004; Derrfuss et al., 2005; Yeung et al., 2006; C. Kim et al., 2012).

Figure 1.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 1.

Study design. A, Behavioral flexibility involves the engagement of the lateral PFC and requires perceptual decision-making implicated in the occipitotemporal regions where modality-dependent mechanisms are distributed. B, Visual stimuli. Coherence of random dot motion and color were independently manipulated. White dots were presented within a donut-shaped display circle as indicated by the dotted lines. Arrow indicates the overall motion direction of each dot. C, Task sequence. After the presentation of a task cue (MOTION or COLOR), the visual stimulus was presented, and participants judged the overall motion or color of the stimuli and pressed a corresponding button. They continued the judgment along the same dimension until the next cue was presented. Only the trials immediately after the cue presentation involved perceptual uncertainty, and subsequent trials did not involve uncertainty (100% coherent). D, Task switch and task repeat. If the presented cue was different from the former one, the task to be performed was switched (left); otherwise, the task was repeated (right).

On the other hand, goal-relevant sensory information from the external environment is perceived and guides a course of action, which is referred to as perceptual decision-making. Studies of perceptual decision-making have used behavioral tasks that demand discrimination of presented sensory stimuli involving perceptual uncertainty (Newsome and Pare, 1988; Corbetta et al., 1991; Erwin et al., 1992; Romo et al., 1998). In one common task, randomly moving dots are presented visually, and participants are required to judge the overall direction of the movement or the overall color of the dot stimuli. It is known that the middle temporal (MT) region plays an important role in perceptual decision-making for moving stimuli (Britten et al., 1992; Shadlen et al., 1996; Beauchamp et al., 1997; Braddick et al., 2001; Corbetta and Shulman, 2002; Huk et al., 2002; Mazurek et al., 2003; Kayser et al., 2010). On the other hand, it has been suggested that ventral visual areas, including V4 and the ventral visual complex (VVC), are associated with the perception of color stimuli (Schein and Desimone, 1990; Motter, 1994; Bartels and Zeki, 2000; Kayser et al., 2010). The MT and VVC/V4 involvements reflect perception of goal-relevant information rather than simple accumulation of stimulus evidence (Kayser et al., 2010). These results suggest stimulus-modality-dependent mechanisms distributed across occipitotemporal regions for the perception of visual information (Fig. 1A).

Executive control depends on the perceived information of the external environment, and the perceived information should be relevant to the achievement of behavioral goals. In other words, executive control presumes that relevant information is appropriately extracted by the perception of the external environment (Fig. 1A). In our daily life, however, goal-relevant environmental information is not always evident. Although most prior studies of executive control have used sensory stimuli that could be perceived distinctively (e.g., Krystal et al., 1994; Rogers and Monsell, 1995; Casey et al., 1997; MacDonald et al., 2000; Miyake et al., 2000; Braver et al., 2003; Aron et al., 2004; Seeley et al., 2007), several studies of perceptual discrimination used stimuli for which multidimensional visual uncertainties were manipulated within a stimulus set (Kayser et al., 2010; Mante et al., 2013; Zhang et al., 2013; Kumano et al., 2016). However, to our knowledge, task switching has been rarely explored in behavioral situations where environmental information involves perceptual uncertainties.

The current study aimed to elucidate relationships between task switching and perceptual decision-making, and to explore the underlying neural mechanisms. We hypothesized three independent mechanisms: (1) a functionally merged single region implements task switching and perceptual uncertainty (e.g., Shackman et al., 2011; Yarkoni et al., 2011); (2) distinct regions for perceptual decision-making and task switching interact to guide task switching (e.g., Konishi et al., 1998; Egner and Hirsch, 2005; Kayser et al., 2010; Waskom et al., 2014); and (3) a hub-like region links the regions for task switching and perceptual decision-making (e.g., Cole et al., 2013; Osada et al., 2015; Nee and D'Esposito, 2016; Jiang et al., 2018).

To test these three hypotheses, fMRI was administered while human participants alternated tasks in which the motion strength and color strength of randomly moving dots were independently manipulated as perceptual uncertainties (Fig. 1B–D). We first explored the brain regions associated with task switching, motion strength, and color strength. Then whole-brain exploratory multivariate pattern analysis (MVPA) was performed to identify brain regions involving task-relevant information. Finally, to examine functional network mechanisms, effective connectivity was examined among the task-related brain regions during task switching under conditions of perceptual uncertainty.

Materials and Methods

Participants

Written informed consent was obtained from 28 healthy right-handed subjects (age range: 18-23 years; 10 females). The experimental procedures were approved by the institutional review boards of Keio University (Yokohama, Japan) and Kochi University of Technology (Kami, Japan). Participants received 2000 yen for participating in each session. One participant was excluded from the analysis because of low behavioral performance. All participants had normal color vision. The number of participants was determined before the collection of the current data based on the effect sizes in relevant previous and pilot behavioral experiments (α = 0.05, β = 0.95, η2 = 0.42).

Experimental design

Behavioral procedures

The experiment consisted of two sessions administered on separate days. The first day was training sessions, in which participants practiced two discrimination tasks (color and motion) and switching between these two tasks. The second day was scanning sessions, and the participants performed the switching task using the motion dot stimuli identical to those used in the training sessions.

Stimuli

All stimuli were generated in MATLAB version 2012a, using the Psychophysics Toolbox extension version 3.0.10 (Brainard, 1997; Pelli, 1997), and were presented visually on a computer screen. The current stimuli were similar to those used in a previous study of perceptual decision-making (Chen et al., 2015) (Fig. 1B), but each dot was colored in red or green. Each motion stimulus involved 75 dots moving inside a donut-shaped display patch with a white cross in the center of the patch on a black background (Fig. 1B). The display patch and cross were centered on the screen and extended from 6 to 12 degrees of visual angle. Within the display patch, every dot moved at a speed of 10 degrees of visual angle per second. Some dots moved coherently in one direction (up or down), whereas the others moved randomly. The percentage of coherently moving dots determined the “motion coherence,” and three levels (20%, 40%, and 80%) of motion coherence were used.

Dot presentation was controlled to remove local motion signals following a standard method for generating motion stimuli (Newsome and Pare, 1988; Britten et al., 1993; Shadlen and Newsome, 1994; Palmer et al., 2005). Namely, on stimulus onset, the dots were presented at new random locations on each of the first three frames. They were relocated after two subsequent frames, such that the dots in frame 1 were repositioned in frame 4, the dots in frame 2 were repositioned in frame 5, etc. When repositioned, each dot was either randomly presented at the new location or aligned with the predetermined motion direction, depending on the predetermined motion strength for that trial. Each stimulus was composed of 18 video frames with 60 Hz refresh rates (i.e., 300 ms presentation).

Each dot was either orange (RGB = [255, 123, 11]; HSV = [27, 95, 100]) or green (RGB = [0, 255, 0]; HSV = [120, 100, 100]), and the two colors were equally bright (V = 100). The percentage of red dots in the dot stimuli was defined as “color coherence,” and three levels (20%, 40%, and 80%) of color coherence were used. Then, the color coherence and motion coherence were independently manipulated for the dot stimuli.

Task procedure

At the beginning of the task, a task cue (MOTION or COLOR) was presented, indicating the dimension of discrimination in subsequent trials (Fig. 1C). Then, the dot patch was presented. In the motion task, participants were required to judge the direction of overall motion of the patch (up or down); in the color task, they were required to judge the overall color (orange or green). They then pressed a corresponding button (right or left) with their right thumb as quickly and accurately as possible. If participants made an incorrect response, or did not respond within 1.8 s from the onset of the dot stimuli, a feedback stimulus indicating the error (X) was presented for 1.0 s, followed by a cue presentation for the same task. The stimulus-response association for the two tasks was identical on days 1 and 2, and was counterbalanced across participants.

For the task switching design, we applied an intermittent cueing paradigm that requires participants to actively maintain a task set until the next cue presentation, which enhances the switching effect (Sakai, 2008). Specifically, after a cue was presented, the dot target trial was repeated 4-6 times, and the participants identified the dot stimulus along the same dimension until the next cue stimulus was presented. Motion and color coherence levels of the dot patch in these trials (second to sixth trials after cue presentation) were set to 100% and did not involve uncertainty, which assured successive correct trials until the next task cue was presented to enhance the task switch effect (see also Behavioral analysis). After the participants gave successive correct responses in 4-6 trials, the next task cue was presented.

One task block lasted ∼90 s, which involved 5-7 task-cue presentations. Fixation blocks were also presented for 20 s between task blocks. One functional run consisted of three task blocks and two fixation blocks. Each run lasted for 305 s.

Practice procedure

On the first day, participants practiced behavioral tasks outside the scanner. They first practiced stimulus discrimination tasks for dot stimuli, where only one task dimension (color or motion) was repeatedly presented (i.e., single-task run). Participants alternatively practiced a motion or color discrimination task for every 1 or 2 practice runs, and completed a total of 8 practice single-task runs.

They then practiced switching tasks, in which a task cue was pseudorandomly alternated (i.e., task-switching run; Fig. 1D). During task-switching runs, the dot target trial that took place immediately after the cue presentation involved perceptual uncertainty manipulated by dot color and motion coherence, as in practice runs; however, after the first target trials until the next cue presentation, the dot target involved no uncertainty (i.e., 100% coherence for both color and motion; Fig. 1C; see also above). Participants performed two practice runs for the task-switching runs.

Behavioral procedure in scanning session

On the second day, after practicing a task-switching run, they performed nine task-switching runs using the same procedure as that was used on day 1 while fMRI was administered.

Imaging procedure

MRI scanning was administered using a 3T MRI scanner (Siemens Verio) with a 32-channel head coil. Functional images were acquired using a multiband acceleration EPI sequence (TR: 0.8 s; TE: 30 ms; flip angle: 45 deg; 80 slices; slice thickness: 2 mm; in-plane resolution: 3 × 3 mm; multiband factor: 8) (Moeller et al., 2010). Each functional run involved 385 volume acquisitions. The first 10 volumes were discarded for analysis to take into account the equilibrium of longitudinal magnetization. High-resolution anatomic images were acquired using an MP-RAGE T1-weighted sequence (TR: 2500 ms; TE = 4.32 ms; flip angle: 8 deg; 192 slices; slice thickness: 1 mm; in-plane resolution: 0.9 × 0.9 mm2]).

Statistical analysis

Behavioral analysis

Two types of target trials were of interest: (1) task-switching trials immediately after cue presentation indicating a task alternation (i.e., switch to the color task from the motion task or vice versa); and (2) task-repeat trials immediately after cue presentation, indicating a repeat of the previous task. These trials were further classified in terms of the performed task (motion and color), and the coherence level of the dot stimulus (20%, 40%, and 80%), entailing a 2 × 2 × 3 factorial model (switch, task, coherence). The trials that occurred after an error were excluded from the entire analysis. Trials with 100% coherence after the task switching and repeat trials were classified as either motion or color trials. Then, accuracy and reaction time were calculated for each condition. Statistical tests were performed based on repeated-measures ANOVAs implemented using SPSS Statistics 24 (IBM).

Image preprocessing

MRI data were analyzed using SPM12 software (https://www.fil.ion.ucl.ac.uk/spm/). All functional images were first temporally realigned across volumes and runs, and the anatomic image was coregistered to a mean image of the functional images. The functional images were then spatially normalized to a standard MNI template with normalization parameters estimated for the anatomic scans. The images were resampled into 2 mm isotropic voxels, and spatially smoothed with a 6 mm FWHM Gaussian kernel.

Imaging analysis: General linear model First level analysis

A GLM approach (Worsley and Friston, 1995) was used to estimate parameter values for task events. The events of interest were correct switch, repeat, and 100% coherent trials, and were coded for motion and color tasks separately. For switch and repeat trials, the normalized (demeaned and divided by SD) coherence level of relevant stimuli (motion coherence for motion task or color coherence for color task) was added as a parametrical effect of interest. Error trials were coded in GLM as nuisance effects. Those task events were time-locked to the onset of random dot stimuli and then convolved with a canonical HRF implemented in SPM. Additionally, six axis head movement parameters, white matter signal, CSF signal, and the parametrical effect of reaction times were included in GLM as nuisance effects. Then, parameters were estimated for each voxel across the whole brain.

Group-level analysis

Maps of parameter estimates were first contrasted within individual participants. The contrasted maps were collected from participants and were subjected to group-mean tests. Voxel clusters were first identified using a voxelwise uncorrected threshold of p < 0.001. The voxel clusters were then tested for a significance across the whole brain with a threshold of p < 0.05 corrected by family-wise error rate based on permutation methods (5000 permutations) implemented in randomize in FSL suite (www.fmrib.ox.ac.uk/fsl/), which was empirically validated to appropriately control the false positive rate in a previous study (Eklund et al., 2016). To identify occipitotemporal cortical regions specifically associated with the color task (color minus motion tasks), a mask obtained from Neurosynth (http://neurosynth.org/) for the search word “color” (z > 3.0, for uniformity test) was used. Peaks of significant clusters were then identified and listed in tables. If multiple peaks were identified within 12 mm, the most significant peak was kept.

Exploration of hemispheric laterality

To examine the hemispheric laterality of the task effects, we explored brain regions showing greater task effects than the contralateral homologous regions. For each participant, contrast maps were flipped along the x (left-right) axis and were subtracted from the original nonflipped maps on a voxel-by-voxel basis (Konishi et al., 2002). Then, the group-level statistical significance was tested within the right hemisphere. Statistical correction was performed within one hemisphere because the subtracted maps show sign-flipped symmetry along the x axis.

We applied this procedure to the maps of the coherence effect (motion and color collapsed) and the switch effect (switch vs repeat). For the coherence effect, the maps were sign-flipped and had a greater signal in the low-coherent trial. Thus, positive values of hemispheric laterality indicate a greater signal in low-coherent trials in the right hemisphere and/or a lower signal in high coherent trials in the left hemisphere. Likewise, for the switch effect, positive values indicate greater activation during switch versus repeat trials in the right hemisphere and/or lower activation switch versus repeat trials in the left hemisphere. The negative values indicate the reverse effects.

ROI analysis for hemispheric laterality

The exploratory analysis above assumes a homology of the brain regions in the right and left hemispheres. We next performed an ROI analysis without assuming hemispheric homology. ROIs were defined as brain regions identified as a multiple demand network (Camilleri et al., 2018). Specifically, ROIs were classified as being in the left or right regions based on the x axis coordinates (Camilleri et al., 2018, their Table 2). ROI images were created with spheres that had a radius of 6 mm and were centered at the coordinates. Then, for each of the left and right ROIs, the estimation contrast of switch effect (switch vs repeat) and the parametric effect of the coherence were extracted from each participant. Group-level statistics were calculated treating participants as a random effect.

View this table:
  • View inline
  • View popup
Table 1.

Brain regions showing significant signal increase in the contrast of switch versus repeat trialsa

To test the robustness of the ROI analysis against the ROI definition, we redefined ROIs. Image maps of meta-analyses were obtained from Neurosynth (Yarkoni et al., 2011) using the terms “switching” (https://neurosynth.org/analyses/terms/switching/) and “task demands” (https://neurosynth.org/analyses/terms/task%20demands/). A threshold of p < 0.01 (uniformity test with whole-brain correction based on false discovery rate) was set for each map. Then, an image map of the logical sum of the two maps with thresholds was created, and ROIs were defined as being in the left or right hemisphere based on the x axis coordinates. Regions with X = 0 were excluded from the analysis. The same statistical tests were performed using these ROIs.

MVPA

To explore brain regions representing task-related information, an MVPA was performed. Bivariate classification based on a support vector machine was used to decode a performed task (motion or color). A searchlight procedure (Kriegeskorte et al., 2006) with a 5 voxel radius was used to provide a measure of decoding accuracy in the neighborhood of each voxel. Training and testing were performed based on the Decoding Toolbox (TDT; version 3.95; https://sites.google.com/site/tdtdecodingtoolbox/).

For each functional run, a single-level GLM analysis was first performed within the standard brain space with regressors identical to those in the univariate analysis. For each run, the classifier in each searchlight was trained using β maps for 100% coherent trials. To calculate the training data, we used the third and later trials after cue presentation and eliminated data from the second trials, to avoid potential confounds derived from cue-related effect.

Next, from β maps for switch and repeat trials (i.e., immediately after cue presentation), image data were extracted within the same searchlight and scanning run. Then, the trained classifier was tested for whether it correctly classified the performed task (motion or color tasks) based on the extracted data (i.e., switch or repeat trials) for each run. It is important to note that training and tested maps were independent. Then, classification performance was collected from all functional runs and averaged within participants for each searchlight. A linear kernel was used and the C parameter was set to 1.0 (default).

For group-level analysis, accuracy maps were first contrasted between switch and repeat trials, and the contrasted accuracy maps were collected from all participants. Then voxelwise group-mean tests were performed, and the significance was tested based on the permutation method (5000 permutations) implemented in randomize in FSL. To exclude brain regions that showed a classification accuracy below the chance level in either of the switch or repeat trials, voxels with t values <0.0 (uncorrected) in the group-level accuracy map of a switch or repeat trial were masked out when testing statistical significance. In other words, tested voxels showed classification accuracy above the chance level for both the switch and repeat trials.

ROI analyses were also performed for classification accuracy. ROIs in occipitotemporal regions were defined as being in the MT or VVC regions identified by univariate analysis (Fig. 2B; see Table 2). ROIs in the frontoparietal regions were independent of the current data to avoid circular analysis (Kriegeskorte et al., 2009) because, in the current study, the frontoparietal regions were identified based on switch and repeat trials involving perceptual uncertainty. Specifically, ROIs were defined based on the multiple demand network identified in a previous study (Camilleri et al., 2018). ROI images were created similarly to another ROI analysis for hemispheric laterality (see ROI analysis for hemispheric laterality), but separately for frontal and parietal regions. To test the robustness of the differential accuracy against the definition of ROI, we redefined ROIs based on the meta-analysis maps of Neurosynth, similarly to the analysis performed above. Then for each participant and ROI, classification accuracy was calculated for switch and repeat trials, and statistical significance was tested treating participants as a random effect.

Effective connectivity analysis

A dynamic causal modeling (DCM) (Friston et al., 2003) analysis was performed to examine functional network mechanisms associated with task switching during the perception of a motion or color stimulus. In particular, we hypothesized that functional connectivity among brain regions associated with (1) task switching, (2) perceptual decision-making, (3) motion perception, and (4) color perception is modulated by task manipulations and brain signals.

DCM allows us to explore effective connectivity among brain regions under the premise of the brain as a deterministic dynamic system that is subject to environmental inputs and produces outputs based on the space-state model. The model constructs a nonlinear system involving intrinsic connectivity, task-induced connectivity, and extrinsic inputs. Parameters of the nonlinear system are estimated based on fMRI signal (system states) and task events.

Four ROIs were first defined based on univariate activation contrasts:

  1. Motion effect (MT; Fig. 3B) (Newsome and Pare, 1988; Britten et al., 1992, 1993; Shadlen et al., 1996; Beauchamp et al., 1997; Britten and Newsome, 1998; Braddick et al., 2001; Corbetta and Shulman, 2002; Huk et al., 2002; Mazurek et al., 2003; Kayser et al., 2010);

  2. Color effect (VVC; Fig. 3B) (Zeki, 1973; Schein and Desimone, 1990; Zeki et al., 1991; Bartels and Zeki, 2000; Kayser et al., 2010);

  3. Switching effect (lPFC; Fig. 3A) (Konishi et al., 1998, 2002; Dove et al., 2000; Rushworth et al., 2002; Braver et al., 2003; Crone et al., 2006; Brass and von Cramon, 2004; Jimura et al., 2004; Derrfuss et al., 2005; Yeung et al., 2006; C. Kim et al., 2011, 2012);

  4. Perceptual uncertainty effect [right PFC (rPFC); Fig. 3C,D] (Kayser et al., 2010), with 6 mm radius spheres centered in the peak coordinates in group-level activation maps.

To avoid circular analysis (Kriegeskorte et al., 2009), the coordinates of ROIs were defined with a leave-one-subject-out procedure, where ROIs for 1 participant were determined based on other participants. ROIs in MT and VVC were defined based on a group-level statistical map for the contrast of motion and color trials with 100% coherence, respectively. lPFC ROI was defined based on a group-level statistical map for the contrast of switch and repeat trials. rPFC ROI was defined based on a group-level statistical map for the coherence effect of switch and repeat trials.

Then, signal time courses of four ROIs and regressors in the events of interest were extracted from first-level GLMs. The events of interest were correct trials immediately after cue presentation (switch and repeat) and subsequent 100% coherence trials. For switch and repeat trials, the contrast of the two trials and the normalized coherence level of stimuli were also added as a parametrical effect of interest. Nuisance effects of head motion, white matter signal, ventricle signal, functional run, and contrast were subtracted from the ROI time courses.

For each trial effect, causal models were defined as those that differed in external inputs and modulatory effects among ROIs. As the current analysis involved three ROIs, the tested models entailed 512 types (i.e., 23 inputs and 26 connection effects). Then, connectivity matrices reflecting (1) first-order connectivity, (2) effective change in coupling induced by the inputs, and (3) extrinsic inputs on the MRI signal in ROIs were estimated for each of the 512 models based on DCM analysis implemented in SPM12. A parametric regressor (switch vs repeat/coherence) was used as the extrinsic effect for effective connectivity between ROIs and ROI inputs.

To estimate the effective connectivity strength, a Bayesian model reduction method (Friston et al., 2016) was used. The reduction method enables the calculation of posterior densities of all possible reduced models, which was then inverted to a fully connected model. Then the reduced models were supplemented with second-level parametric empirical Bayes (Friston et al., 2016) to apply empirical priors that remove subject variability from each model.

Subsequently, parameters of these models were estimated based on Bayesian model averaging (Penny et al., 2010) to estimate connectivity changes. Because the current analysis aimed to identify the average effective connectivity observed across participants, we used a fixed-effect estimation assuming that every participant uses the same model, rather than a random-effect estimation assuming that different participants use different models, which has been often used to examine group differences in effective connectivity (Penny et al., 2010).

The significance of connectivity was then tested by thresholding at a posterior probability of 95% CI (uncorrected), as the current analysis aimed to test whether connectivity between two specific brain regions was enhanced depending on task manipulation and brain activity, but did not aim to explore one model involving connectivity among multiple brain regions that best fits to imaging and behavioral data.

Additionally, to test the robustness of the functional connectivity, we also examined Bayesian model averaging-based DCM without model reduction or without empirical prior, and confirmed the overall results were consistent across these estimation methods.

The number of trials for each condition (see Behavioral results) was comparable to those in recently published relevant studies examining cognitive control using DCM (∼16-40 trials for each condition) (Nee and D'Esposito, 2016; He et al., 2019; Bowling et al., 2020). We used a high temporal resolution sequence for functional imaging (Moeller et al., 2010) (TR = 0.8; see also Imaging procedures), which is >2 times higher than these recent studies (TR =1.9–2.0 s), enabling us to collect more scan frames to increase the signal-to-noise ratio of the DCM estimation (Penny et al., 2004; Stephan et al., 2010).

Results

Behavioral results

Participants gave correct responses for 35.56 ± 4.90 (mean ± SD) switch trials and 38.70 ± 6.41 repeat trials in the motion task; in the color task, they gave correct responses for 36.07 ± 3.74 switch trials and 33.70 ± 4.68 repeat trials. In the motion task, participants gave correct responses for 27.89 ± 2.56 high-coherence trials, 25.26 ± 4.53 middle-coherence trials, and 21.11 ± 5.06 low-coherence trials; in the color task, they gave correct responses for 23.30 ± 2.97 high-coherence trials, 25.63 ± 3.54 middle-coherence trials, and 20.85 ± 3.27 low-coherence trials.

Accuracy became lower in the lower coherent (i.e., more uncertain) trials (F(1,26) = 149.4, p < 0.001, η2 = 0.85), and became lower in switch trials than in repeat trials (F(1,26) = 22.8; p < 0.001, η2 = 0.47) (Fig. 2A). The interaction effect of trial type (switch/repeat) and coherence levels was not significant (F(1,26) = 2.1, p = 0.16, η2 = 0.08). Because dots were presented in the periphery visual field (see Materials and Methods), participants needed a higher signal-to-noise ratio compared with the centrally presented dots used in the previous studies (e.g., Palmer et al., 2005; Gold and Shadlen, 2007). This seems to be a major reason why the accuracy levels observed in this study were within the usual range despite very high coherence levels. Accordingly, reaction times became longer in lower coherent trials (F(1,26) = 126.1; p < 0.001, η2 = 0.83), and became longer in switch trials than in repeat trials (F(1,26) = 19.9; p < 0.001, η2 = 0.43) (Fig. 2B). The interaction effect of trial type (switch/repeat) and coherence levels was not significant (F(1,26) = 3.9, p = 0.058, η2 = 0.13). These behavioral results suggest that the current behavioral task successfully manipulated task switching (Dove et al., 2000; Braver et al., 2003; Crone et al., 2006; Jimura et al., 2014) and perceptual decision-making (Shadlen et al., 1996; J. N. Kim and Shadlen, 1999; Mazurek et al., 2003; Palmer et al., 2005). In 100% coherent trials, reaction times also became longer in the color task than in the motion task (F(1,26) = 10.1, p < 0.005, η2 = 0.28).

Figure 2.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 2.

Behavioral results. A, Accuracy for task as a function of motion and color coherence. B, Reaction time for task as a function of motion and color coherence. Solid lines with filled circles indicate switch trials. Dotted lines with open circles indicate repeat trials. Red lines indicate motion tasks. Blue lines indicate color tasks. Data of 100% coherence trials were derived from the trials presented after the switch and repeat trials, and not from the switch or repeat trials (Fig. 1C,D). Error bars indicate SEM across participants.

Imaging results: univariate activation

We first explored brain regions associated with task switching, motion perception, and color perception.

Figure 3A shows brain regions with a significant increase and decrease in brain activity during task switching (switch trials vs repeat trials). Robust activation increases were observed in the left frontal regions, including the inferior frontal cortex (IFC), the dorsolateral PFC (DLPFC), the anterior PFC (aPFC), the inferior frontal junction (IFJ), and the pre-supplementary motor area (pre-SMA), and in the left parietal regions including the posterior parietal cortex (PPC). These left hemisphere-dominant frontoparietal activations are consistent with previous studies of task switching (Konishi et al., 1998, 2002; Dove et al., 2000; Rushworth et al., 2002; Braver et al., 2003; Crone et al., 2006; Brass and von Cramon, 2004; Jimura et al., 2004; Asari et al., 2005; Derrfuss et al., 2005; Yeung et al., 2006; C. Kim et al., 2011, 2012). A full list of brain regions is shown in Table 1.

Figure 3.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 3.

Statistical activation map of univariate analysis. Maps are overlaid onto 3D surface of the brain. Hot colors represent positive effects. Cool colors represent negative effects. A, Switch versus repeat trials. B, Motion versus color tasks. C, Motion coherence effect. Hot colors represent a greater signal in high-coherence trials. Cool colors represent a greater signal in low-coherence trials. D, Color coherence effect. The format is similar to those in C.

View this table:
  • View inline
  • View popup
Table 2.

Brain regions showing significant signal increase in the contrast of motion versus color trialsa

Next, we explored brain regions associated with motion and color tasks during the task switching and repeat trials (Fig. 3B; Table 2). Activity became greater in the MT area during motion tasks, whereas in color tasks, greater activity was observed in VVC (Glasser et al., 2016). These results are also consistent with prior studies examining perceptual decision-making for motion (Newsome and Pare, 1988; Britten et al., 1992, 1993; Shadlen et al., 1996; Beauchamp et al., 1997; Britten and Newsome, 1998; Braddick et al., 2001; Corbetta and Shulman, 2002; Huk et al., 2002; Mazurek et al., 2003; Kayser et al., 2010) and color (Zeki, 1973; Schein and Desimone, 1990; Zeki et al., 1991; Motter, 1994; Bartels and Zeki, 2000; Kayser et al., 2010).

We then examined coherence effect. Whole-brain activation maps for the coherence effect in motion and color tasks are shown in Figure 3C and Figure 3D, respectively. In both the color and motion tasks, activations became greater in low coherent trials in multiple frontoparietal regions, including the IFC, DLPFC, aPFC, IFJ, pre-SMA, and PPC (Fig. 3C,D; Tables 3 and 4) (Kayser et al., 2010). Interestingly, in both tasks, the coherence effect in frontoparietal regions looked prominent, especially in the right hemisphere.

View this table:
  • View inline
  • View popup
Table 3.

Brain regions showing significant parametrical effect with motion coherence in motion trialsa

View this table:
  • View inline
  • View popup
Table 4.

Brain regions showing significant parametrical effect with color coherence in color trialsa

To test this possibility, we first examined conjunction and disjunction of univariate maps for switch effect and negative motion coherence effect (motor and color tasks collapsed) (p < 0.05 corrected; Fig. 4A). Frontoparietal regions in the right hemisphere showed the coherence effect predominantly, but the switch effect was almost absent in the right hemisphere. On the other hand, in the left frontoparietal regions, both of the switch and coherence effects were observed, but the switch effect showed more broadly. These results suggest a double dissociation in the frontoparietal regions, with switch and coherence effects involving the left and right frontoparietal regions, respectively.

Figure 4.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 4.

Hemispheric laterality. A, Conjunction and disjunction maps. Statistical significance maps for switch and negative coherence effects (p < 0.05 corrected across the whole brain) were mapped on the 3D surface image of the brain, and then color-coded. Orange represents switch effect only. Blue represents negative coherence effect only. Yellow represents both of switch and negative coherence effects. B, Exploratory analysis procedure for hemispheric asymmetry. Contrast maps were flipped along the x axis (left-right), then subtracted from the original nonflipped maps before being entered into voxelwise group-level analyses. C, Statistical map of brain regions showing a differential coherence effect between the right and left hemispheres (top). Hot colors represent a greater signal in low-coherent trials in the right hemisphere and/or a lower signal in high-coherent trials in the left hemisphere. Cool colors represent the reverse effect. Statistical map of brain regions showing differential activation for switch versus repeat trials between the right and left hemispheres (bottom). Hot colors represent greater activation for switch versus repeat trials in the right hemisphere and/or smaller activation for switch versus repeat trials in the left hemisphere. Cool color represents the reverse effect. Formats are similar to those in B. D, ROI analysis. ROIs in the frontoparietal cortex were defined independently of the current data, and then switch and negative coherence effects were compared between the right and left hemispheres. ***p < 0.001. L, Left; R, right.

Then, we explored brain regions to show the double dissociation. We contrasted the maps of the coherence effect between the right and left hemispheres on a voxel-by-voxel basis by flipping maps along the x axis, and explored the brain regions showing a differential coherence effect between hemispheres by calculating group-level statistics (Fig. 4B; see also Materials and Methods). Figure 4C (top) and Table 5 show brain regions with the differential effect. Positive effects were observed in multiple frontoparietal regions, including the DLPFC, pre-SMA, and PPC. Technically, a positive effect indicates greater activation in low-coherent trials in the right hemisphere, and/or lower activation in high-coherent trials in the left hemisphere. These positive hemispheric laterality effects can be considered to be derived from greater activation in low-coherent trials in the right hemisphere, which was weaker in the contralateral (left) hemisphere, given the prominent coherence effects (greater activations in low-coherence trials) in those frontoparietal regions in the right hemisphere (Fig. 3C,D; Tables 3 and 4).

View this table:
  • View inline
  • View popup
Table 5.

Brain regions showing significant difference in the low-coherence effect for the right hemisphere versus left hemisphere in switch and repeat trialsa

Similarly, to confirm the left-lateralized switch effect in frontoparietal regions, we contrasted the maps of the switching effect (switch vs repeat) between the right and left hemispheres. Figure 4C (bottom) and Table 6 show a prominent negative effect in multiple frontoparietal regions, including the IFC, DLPFC, aPFC, IFJ, and PPC. Technically, again, a negative effect indicated greater switch-related activation in the left hemisphere and/or weaker switch-related activation in the right hemisphere; however, given the greater switch related activation in the left hemisphere (Fig. 3; Table 1), the negative effects were derived from greater switch-related activity in the left hemisphere, which was weaker in the contralateral hemisphere. This result was consistent with prior studies (Konishi et al., 2002; Jimura et al., 2004).

View this table:
  • View inline
  • View popup
Table 6.

Brain regions showing significant difference for the right hemisphere versus left hemisphere in contrast of switch versus repeat trialsa

Finally, we performed ROIs analysis to further demonstrate the double dissociation. Frontoparietal ROIs in the left and right hemispheres were defined based on a previous study (Camilleri et al., 2018) (see also Materials and Methods); and for each of the left and right ROIs, the estimation contrast of the switch effect (switch vs repeat) and the parametric effect of the coherence were extracted for each participant. The switch effect was significant in both hemispheres (left: t(26) = 8.5, p < 0.001, r2 = 0.74; right: t(26) = 5.2, p < 0.001, r2 = 0.51), but was greater in the left hemisphere (left > right: t(26) = 5.3, p < 0.001, r2 = 0.52) (Fig. 4D). The negative coherence effect (greater signal in low coherence trial) was also significant in both hemispheres (left: t(26) = 12.8, p < 0.001, r2 = 0.86; right: t(26) = 10.64 p < 0.001, r2 = 0.81), but conversely, the coherence effect was greater in the right hemisphere (right > left: t(26) = 4.7, p < 0.001, r2 = 0.46). To test the robustness of the hemispheric dissociations against the definition of ROIs, we redefined ROIs based on the meta-analysis maps (Neurosynth; see Materials and Methods) (Yarkoni et al., 2011). The switch effect was significant in both hemispheres (left: t(26) = 8.5, p < 0.001, r2 = 0.74; right: t(26) = 5.5, p < 0.001, r2 = 0.54), but was greater in the left hemisphere than the right hemisphere (left > right: t(26) = 3.7, p < 0.01, r2 = 0.34). The negative coherence effect was also significant in both hemispheres (left: t(26) = 9.8, p < 0.01, r2 = 0.79; right: t(26) = 10.7, p < 0.001, r2 = 0.81), but was greater in the right hemisphere (right > left: t(26) = 6.4, p < 0.001, r2 = 0.61).

These collective results clearly demonstrate hemispheric asymmetries in the frontoparietal regions: task switching and perceptual decision-making are associated with the left and right hemispheres, respectively, suggesting distinctive neural mechanisms across hemispheres. No regions showed an interaction between the switch and coherence effects.

Searchlight MVPA

Given the brain regions associated with tasks to be performed, switching tasks, and perceptual demand identified by univariate activation analysis, we next explored brain regions involving task-related neural representation that may reflect appropriate neural coding of the task to be performed. More specifically, brain activity patterns were examined if the pattern involved discriminable information of motion and color tasks based on searchlight MVPA (Kriegeskorte et al., 2006). Importantly, in the current analysis, training and test data were independent; training and test data were based on 100% coherent trials and switch/repeat trials, respectively (Fig. 1B; see also Materials and Methods).

Occipitotemporal regions showed greater accuracy in the switch trials (Fig. 5A, left) but not in the repeat trials (Fig. 5A, middle). Then, to identify brain regions showing enhanced task coding during task switching, classification accuracy maps were contrasted between switch and repeat trials on a voxel-by-voxel basis (Jimura et al., 2014); and a group-level analysis was performed. The occipitotemporal regions showed a differential effect (Fig. 5A, right; Table 7). As stated above, in this region, there is a greater amount of information about performed tasks in switch trials relative to repeat trials. Of interest, this region is located spatially between the MT region (showing greater activity during motion tasks; Fig. 5B, blue) and the VVC region (showing greater activity during the color task; Fig. 5B, green), which were identified in a univariate activation analysis (Fig. 2B; Table 2). Thus, the occipitotemporal region adjacent to the stimulus-modality-dependent MT/VVC areas showed enhanced task coding during task switching. It is possible that enhanced task coding in this middle region reflects enhanced task coding in the MT/VVC areas during task switching (see Discussion). To examine this possibility, an ROI analysis was performed. ROIs were defined as MT and VVC regions that were identified by univariate analysis (Fig. 2B; Table 2); the classification accuracy was averaged for each of the ROIs for switch and repeat trials. The MT region showed greater classification accuracy in both the switch and the repeat trials than the chance level (switch: t(26) = 6.3, p < 0.001, r2 = 0.60; repeat: t(26) = 3.1, p < 0.01, r2 = 0.27), but the accuracy was greater in the switch than in the repeat trial (t(26) = 5.8; p < 0.001, r2 = 0.42). In the VVT region, classification accuracy was greater in the switch trial (t(26) = 7.1, p < 0.001, r2 = 0.66), but not in the repeat trial (t(26) = −0.2, p = 0.83, r2 = 0.00), compared with the chance level. The accuracy difference was also significant (t(26) = 4.7, p < 0.001, r2 = 0.46).

View this table:
  • View inline
  • View popup
Table 7.

Brain regions showing a significant difference in accuracy to classify task dimension (motion/color) between the switch and repeat trialsa

Figure 5.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 5.

Searchlight MVPA. A, Statistical significance maps of classification accuracy for motion and color tasks in searchlight MVPA. Switch trial (left), repeat trial (middle), and switch versus repeat trials (right). Hot colors represent greater accuracy in switch and repeat trials (relative to chance; left and middle) and in switch relative to repeat trials (right). Cool colors represent the reverse effect. B, The statistical maps were overlaid on a 2D section as indicated by the y axis on the left. Black solid square on the section (left) represents the area magnified on the right. Hot colors represent brain regions showing greater classification accuracy for switch trials relative to repeat trials in the searchlight MVPA. Cool and green colors represent brain regions with greater activation during motion relative to color tasks, and during color relative to motion tasks in univariate analyses, respectively. Yellow arrowheads indicate major anatomic landmarks on the 2D section at left. ITC, Inferior temporal sulcus; OTS, occipitotemporal sulcus; CLS, collateral sulcus. C, ROI analysis. For switch (SW) and repeat (RP) trials, voxelwise accuracy was averaged within MT and VVC identified by the univariate analysis in A (top), and also within the PFC and PPC ROIs defined independently of the current data (bottom). Error bars indicate SEM across participants. *p < 0.05; **p < 0.01; ***p < 0.001.

We also performed an ROI analysis for the frontoparietal regions. ROI images were created similarly to the hemispheric laterality analysis, but for the frontal and parietal regions, separately (Fig. 4D; see also Materials and Methods). In the frontal ROI, the accuracy was higher than the chance level in the switch and repeat trials (switch: t(26) = 9.0, p < 0.001, r2 = 0.75; repeat: t(26) = 2.3, p < 0.05, r2 = 0.17), but was higher in the switch trial than in the repeat trial (switch > repeat: t(26) = 4.7, p < 0.001, r2 = 0.45). In the parietal ROI, the accuracy was higher than the chance level in the switch and repeat trials (switch: t(26) = 8.4, p < 0.001, r2 = 0.72; repeat: t(26) = 4.5, p < 0.001, r2 = 0.43), but was higher in the switch trial than in the repeat trial (switch > repeat: t(26) = 2.3, p < 0.05, r2 = 0.17). To test the robustness of the differential accuracy against the definition of ROI, we redefined ROIs based on the meta-analysis maps of Neurosynth, similar to the analysis above. Consistent results were obtained in the frontal ROI (switch: t(26) = 9.1, p < 0.001, r2 = 0.76; repeat: t(26) = 1.9, p = 0.07, r2 = 0.12; switch > repeat: t(26) = 4.4, p < 0.001, r2 = 0.43) and parietal ROI (switch: t(26) = 10.3, p < 0.001, r2 = 0.80; repeat: t(26) = 5.3, p < 0.001, r2 = 0.51; switch > repeat: t(26) = 3.7, p < 0.001, r2 = 0.35). These results suggest that the frontoparietal regions implicated in task switching and perceptual uncertainty also enhanced task coding in the switch relative to the repeat trials.

Effective connectivity analysis

The whole-brain exploratory analyses identified three types of brain regions: (1) occipitotemporal MT and VVC regions associated with motion and color perception, respectively; (2) lPFC associated with task switching; and (3) rPFC associated with perceptual uncertainty. In addition, searchlight MVPA identified an occipitotemporal region between MT and VVC where task information was increased during task switching. One possible mechanism to comprehensively explain these results is that the MT/VVC regions received task-switching signals from the lPFC, and the task information was complemented by signaling from the rPFC when task-relevant information involved uncertainty. To test this hypothesis, we performed interregional effective connectivity analysis for switch and coherence effects during task switching based on DCM (Friston et al., 2003), which allowed us to examine the directionality of task-related functional connectivity via the state-space model (see also Materials and Methods).

As shown in Figure 6A, the connectivity was enhanced from lPFC toward MT in the switch-to-motion trials. By contrast, connectivity in the reverse direction (i.e., from MT toward lPFC) was enhanced in repeat-motion trials. On the other hand, in color tasks, the connectivity was enhanced from lPFC toward VVC in the switch-to-color trials, and the connectivity was enhanced in the opposite direction during the repeat-color trials (Fig. 6B). These results suggest that modality-specialized occipitotemporal regions receive and send signals toward the switch-related prefrontal region, depending on whether the task was switched or repeated.

Figure 6.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 6.

Effective connectivity analysis based on DCM. A, Effective connectivity and extrinsic inputs modulated in switch trials relative to repeat trials during motion tasks. Red arrows indicate enhancements of connectivity in switch trials. Blue arrows indicate enhancements of connectivity in repeat trials. Solid and dotted lines indicate effective connectivity that is statistically significant (p < 0.05; uncorrected) and insignificant, respectively. Positive values indicate connectivity enhancements in switch trials. Negative values indicate connectivity enhancements in and repeat trials. B, Effective connectivity and extrinsic inputs modulated in switch relative to repeat trials during color tasks. The formats are similar to those in A. C, Effective connectivity and extrinsic inputs modulated by motion coherence during motion tasks. Red arrows indicate enhancements in high-coherence trials. Blue arrows indicate enhancements in low-coherence trials. Solid and dotted lines indicate effective connectivity that was statistically significant (p < 0.05; uncorrected) and insignificant, respectively. Positive values indicate connectivity enhancements in high-coherence trials. Negative values indicate connectivity enhancements in low-coherence trials. D, Effective connectivity and extrinsic inputs modulated by color coherence during color tasks. The formats are similar to those in C.

In low coherence motion trials, the connectivity was enhanced from rPFC toward MT, and from rPFC toward lPFC (Fig. 6C). In contrast, in the high-coherence motion trials, the connectivity was enhanced from MT to lPFC and rPFC, and also from lPFC to rPFC. On the other hand, in the low-coherence color trials, the connectivity was also enhanced from rPFC toward VVC, from rPFC toward lPFC, and from V4 toward lPFC (Fig. 6D). In the high-coherence color trials, the connectivity was enhanced from lPFC toward VVC and rPFC. These results suggest that rPFC has a key role in signaling the switch-related lPFC and modality-specialized occipitotemporal regions when perceptual demand increases because of the increased the perceptual uncertainty.

Together, during task switching in a situation where external perceptual information involves more uncertainty, the top-down signal from the prefrontal regions associated with task switching and perceptual uncertainty becomes stronger toward the stimulus-modality-dependent occipitotemporal regions. On the other hand, the bottom-up signal from the occipitotemporal regions to the prefrontal region becomes stronger during repeat trials. These results collectively suggest complementary prefrontal mechanisms during task switching, with perceptual uncertainty with the lPFC and rPFC for task switching and perceptual decision-making, respectively. Then, the prefrontal mechanisms increase task-related information in the occipitotemporal regions.

Discussion

The current study examined neural mechanisms during task switching in a situation where goal-relevant information involved perceptual uncertainty. The lPFC, MT/VVC, and rPFC were associated with task switching, perception of the target stimulus of an engaged task, and perceptual demands, respectively. During task switching, the lPFC signaled to the MT and VVC regions, and task-related neural pattern information in the cortical region increased in an occipitotemporal region between MT and VVC. On the other hand, when goal-relevant information involved more perceptual uncertainty, the lPFC and MT/VVC received a signal from the rPFC. These collective results suggest distributed cortical mechanisms during task switching under perceptual uncertainty, where cross-hemispheric prefrontal mechanisms complementarily signal to task-dependent perceptual regions in the occipitotemporal cortex (Fig. 7).

Figure 7.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 7.

Schematic diagrams of neural mechanisms among the lPFC, rPFC, MT, and VVC during task switching with perceptual uncertainty. Arrows indicate signal directions.

Behaviorally, the interaction effect of switching and coherence levels was not strong, as it failed to reach statistical significance. In contrast, both of the two main effects (switching and coherence) were statistically reliable. In univariate imaging analyses, the two main effects were predominantly observed across the whole brain, but the interaction effect was absent. These behavioral and imaging results suggest that the main effects of switching and coherence are dominant. Thus, for putative mechanisms for successful task switching under perceptual uncertainty, the current study suggests that distinct mechanisms for perceptual decision-making and task switching cooperatively guide successful task switching. More specifically, when target information involves uncertainty, activation in the right prefrontal region becomes greater, and the cross-hemispheric signal from the right prefrontal region toward the left prefrontal region is enhanced (Fig. 7). These results may suggest that the perceptual decision-making mechanism involves the right frontoparietal regions and helps to achieve task switching involving the left frontoparietal regions.

Previous studies of task switching have focused on perceptual decision-making and demand, where the target stimulus involved uncertainty, and revealed occipitotemporal and frontoparietal mechanisms (Kayser et al., 2010; Mante et al., 2013; Zhang et al., 2013; Kumano et al., 2016). More recent studies examined task switching involving perceptual uncertainty where the relevant task was not explicitly cued and the switch to an alternative task was guided by feedback to the response (Purcell and Kiani, 2016), and identified medial prefrontal mechanisms critical for voluntary switching (Sarafyazd and Jazayeri, 2019). In contrast, the current study focused on cue-guided switching when a perceptually ambiguous stimulus was presented. Two neural mechanisms (one associated with task switching involving the lPFC and the other associated with perceptual decision-making involving the rPFC, MT, and VVC) cooperatively guide flexible adaptation to changing environments.

DCM analyses revealed a top-down signal from the lPFC to the MT and VVC regions during task switching, depending on the task that was switched. More specifically, the lPFC signaled to the MT during a switch from the color to motion tasks, and to VVC during a switch from the motion to color tasks. This top-down mechanism may reflect supplemental attention to a visual stimulus required to collect task-related information to make a decision, with the prefrontal region complementing stimulus-modality-dependent perceptual information in the occipitotemporal region (Desimone and Duncan, 1995; Tomita et al., 1999; Kastner and Ungerleider, 2000; Miller and Cohen, 2001; Corbetta and Shulman, 2002). The current study extends this view that the top-down signal from the prefrontal to occipitotemporal regions is enhanced when the stimulus involves perceptual uncertainty, and the enhanced prefrontal signal was supplemented from the contralateral hemisphere (Fig. 7).

A searchlight MVPA analysis identified an occipitotemporal region showing enhanced task coding in the middle of the MT and VVC. It can be speculated that, during task switching, task coding was enhanced in the MT and VVC regions, which reciprocally increased the amount of discriminable task information in this middle region, which is consistent with the follow-up ROI analysis (Fig. 5B). This interpretation is also compatible with DCM results showing an enhanced top-down signal from the lPFC to the MT or VVC depending on the task to be switched. It is well known that occipitotemporal regions involve stimulus-modality specialized patchy regions (e.g., Shadlen and Newsome, 1994; Treisman and Kanwisher, 1998). The exploratory searchlight MVPA (Fig. 5A) result is dependent on these patchy characteristics; and for this result to occur, it may be important for the MT and VVC to be located relatively close (∼25 mm apart; Table 2) within the occipitotemporal region.

In the current study, the decoding accuracy in the occipitotemporal regions may be lower for visual sensory regions. One possible reason for this is that the visual stimulus was identical in the motion and color tasks, which may have attenuated the sensitivity of visual cortical areas that are sensitive to visual evidence. Another possibility is that the classifier was not optimized to classify the trials immediately after cue presentation involving perceptual uncertainty because the classifier was trained based on 100% coherence trials that do not involve perceptual uncertainty.

A recent MVPA study of task switching suggested that task coding in frontoparietal regions is attenuated in a switch trial (Qiao et al., 2017), whereas another study suggested that task coding is independent of task switching (Loose et al., 2017). On the other hand, in the current study, the classification accuracy in the frontoparietal regions was greater in the switch trial. The variability of accuracy patterns in the previous and current studies may be because of the differences in behavioral design and cognitive demands of task switching. In previous studies, a task-cueing paradigm was used, where a task cue was presented in each trial (Loose et al., 2017; Qiao et al., 2017); conversely, the current study used an intermittent cue paradigm in which the switch trial occurred after successive correct trials for the alternative task without presenting a cue (Fig. 1; see also Materials and Methods). In the latter paradigm, the cue stimulus is presented less frequently, and participants actively maintain the task set for a longer period until the next cue is presented. Thus, in the switch trial, the effect of a cue presentation of the previous task is diminished, but the interference of the previous task set becomes greater (Sakai, 2008). The greater demand in the switch trial and the weaker effect of cue presentation of the previous task may be attributable to the greater classification accuracy of the switch trial observed in the current study.

Several previous studies have shown that switching alternative tasks was associated with the frontoparietal region in the left hemisphere (Konishi et al., 1998, 2002; Dove et al., 2000; Rushworth et al., 2002; Braver et al., 2003; Crone et al., 2006; Brass and von Cramon, 2004; Asari et al., 2005; Derrfuss et al., 2005; Yeung et al., 2006; Jimura and Braver, 2010; C. Kim et al., 2011, 2012). In the current study, when a stimulus involved perceptual uncertainty, prefrontal activity in the contralateral hemisphere became stronger, which may supplement top-down signaling to stimulus-modality-dependent occipitotemporal regions (Fig. 7), suggesting a compensatory mechanism across hemispheres. Indeed, such contralateral compensation has been reported in neuropsychological studies of patients with hemispheric stroke (Buckner et al., 1996; Cramer et al., 1997; Gold and Kertesz, 2000), which may be compatible with the complementary activation and top-down signaling under perceptual uncertainty in the current study. Interestingly, it is suggested that the right prefrontal and parietal regions are associated with stimulus-driven attention (Corbetta and Shulman, 2002), consistent with increased perceptual demand during low-coherence trials in the current study.

Previous electrophysiological studies have shown that MT activity becomes greater when subjects are perceiving random dot motion with greater coherence (Britten et al., 1992, 1993; Britten and Newsome, 1998; Mazurek et al., 2003). On the other hand, similarly to the current study, under conditions where visual stimuli involved both color and motion perceptual uncertainty, MT activity increased in high-motion coherence trials when subjects did not attend to the motion (Kayser et al., 2010); this was consistent with the previous electrophysiological studies (Britten et al., 1992, 1993; Britten and Newsome, 1998; Mazurek et al., 2003). However, when subjects did attend to motion, the direction of motion coherence modulation reversed, with MT activity becoming greater in low-motion coherence trials, suggesting top-down signaling from the frontoparietal regions (Kayser et al., 2010). The current study suggests that the top-down signal is enhanced during task switching in low-coherence trials, and that the top-down signal is associated with supplemental attention to task-relevant information when the stimulus involves multiple dimensional uncertainties (Fig. 7). Notably, consistent with a previous study (Kayser et al., 2010), in the current study, such enhanced MT activation was not observed during high-coherence trials, but rather MT activity increased in low-coherence trials (p < 0.05 corrected within small volume in the MT region defined with contrast of motion vs color trials in a univariate analysis).

In conclusion, the current study elucidated one aspect of executive control. Specifically, behavioral flexibility and perceptual decision-making interact to guide goal-directed behavior, which is implemented as a distributed cortical network in the frontal and occipitotemporal regions.

Footnotes

  • This work was supported by Japan Society for the Promotion of Science Kakenhi 26350986, 26120711, 17H05957, 17K01989, and 20K07727 to K.J.; 17H00891to K.N.; 20H00521 to M.T.; Uehara Memorial Foundation to K.J.; and Takeda Science Foundation to K.J. We thank Maoko Yamanaka for administrative assistance; and Tetsumi Tokita for technical assistance.

  • The authors declare no competing financial interests.

  • Correspondence should be addressed to Koji Jimura at jimura{at}bio.keio.ac.jp

SfN exclusive license.

References

  1. ↵
    1. Allport A,
    2. Styles EA,
    3. Hsieh S
    (1994) Shifting intentional set: exploring the dynamic control of tasks. In: Conscious and nonconscious information processing: attention and performance, VolXV. (Umilta C, Moscovitch M eds), pp 421–452. Cambridge, MA: Massachusetts Institute of Technology.
    OpenUrl
  2. ↵
    1. Aron AR,
    2. Monsell S,
    3. Sahakian BJ,
    4. Robbins TW
    (2004) A componential analysis of task-switching deficits associated with lesions of left and right frontal cortex. Brain 127:1561–1573. doi:10.1093/brain/awh169 pmid:15090477
    OpenUrlCrossRefPubMed
  3. ↵
    1. Asari T,
    2. Konishi S,
    3. Jimura K,
    4. Miyashita Y
    (2005) Multiple components of lateral posterior parietal activation associated with cognitive set shifting. Neuroimage 26:694–702. doi:10.1016/j.neuroimage.2004.12.063 pmid:15955479
    OpenUrlCrossRefPubMed
  4. ↵
    1. Bartels A,
    2. Zeki S
    (2000) The architecture of the colour centre in the human visual brain: new results and a review. Eur J Neurosci 12:172–193. doi:10.1046/j.1460-9568.2000.00905.x pmid:10651872
    OpenUrlCrossRefPubMed
  5. ↵
    1. Beauchamp MS,
    2. Cox RW,
    3. Deyoe EA
    (1997) Graded effects of spatial and featural attention on human area MT and associated motion processing areas. J Neurophysiol 78:516–520. doi:10.1152/jn.1997.78.1.516 pmid:9242299
    OpenUrlCrossRefPubMed
  6. ↵
    1. Bowling JT,
    2. Friston KJ,
    3. Hopfinger JB
    (2020) Top-down versus bottom-up attention differentially modulate frontal-parietal connectivity. Hum Brain Mapp 41:928–942. doi:10.1002/hbm.24850 pmid:31692192
    OpenUrlCrossRefPubMed
  7. ↵
    1. Braddick OJ,
    2. O'Brien JM,
    3. Wattam-Bell J,
    4. Atkinson J,
    5. Hartley T,
    6. Turner R
    (2001) Brain areas sensitive to coherent visual motion. Perception 30:61–72. doi:10.1068/p3048 pmid:11257978
    OpenUrlCrossRefPubMed
  8. ↵
    1. Brainard DH
    (1997) The psychophysics toolbox. Spat Vis 10:433–436. doi:10.1163/156856897X00357 pmid:9176952
    OpenUrlCrossRefPubMed
  9. ↵
    1. Brass M,
    2. von Cramon DY
    (2004) Decomposing components of task preparation with functional magnetic resonance imaging. J Cogn Neurosci 16:609–620. doi:10.1162/089892904323057335 pmid:15165351
    OpenUrlCrossRefPubMed
  10. ↵
    1. Braver TS,
    2. Reynolds JR,
    3. Donaldson DI
    (2003) Neural mechanisms of transient and sustained cognitive control during task switching. Neuron 39:713–726. doi:10.1016/s0896-6273(03)00466-5 pmid:12925284
    OpenUrlCrossRefPubMed
  11. ↵
    1. Britten KH,
    2. Newsome WT
    (1998) Tuning bandwidths for near-threshold stimuli in area MT. J Neurophysiol 80:762–770. doi:10.1152/jn.1998.80.2.762 pmid:9705467
    OpenUrlCrossRefPubMed
  12. ↵
    1. Britten KH,
    2. Shadlen MN,
    3. Newsome WT,
    4. Movshon JA
    (1992) The analysis of visual motion: a comparison of neuronal and psychophysical performance. J Neurosci 12:4745–4765. pmid:1464765
    OpenUrlAbstract/FREE Full Text
  13. ↵
    1. Britten KH,
    2. Shadlen MN,
    3. Newsome WT,
    4. Movshon JA
    (1993) Responses of neurons in macaque MT to stochastic motion signals. Vis Neurosci 10:1157–1169. doi:10.1017/s0952523800010269 pmid:8257671
    OpenUrlCrossRefPubMed
  14. ↵
    1. Buckner RL,
    2. Corbetta M,
    3. Schatz J,
    4. Raichle ME,
    5. Petersen SE
    (1996) Preserved speech abilities and compensation following prefrontal damage. Proc Natl Acad Sci USA 93:1249–1253. doi:10.1073/pnas.93.3.1249 pmid:8577749
    OpenUrlAbstract/FREE Full Text
  15. ↵
    1. Camilleri JA,
    2. Müller VI,
    3. Fox P,
    4. Laird AR,
    5. Hoffstaedter F,
    6. Kalenscher T,
    7. Eickhoff SB
    (2018) Definition and characterization of an extended multiple-demand network. Neuroimage 165:138–147. doi:10.1016/j.neuroimage.2017.10.020 pmid:29030105
    OpenUrlCrossRefPubMed
  16. ↵
    1. Casey BJ,
    2. Trainor RJ,
    3. Orendi JL,
    4. Schubert AB,
    5. Nystrom LE,
    6. Giedd JN,
    7. Castellanos FX,
    8. Haxby JV,
    9. Noll DC,
    10. Cohen JD,
    11. Forman SD,
    12. Dahl RE,
    13. Rapoport JL
    (1997) A developmental functional MRI study of prefrontal activation during performance of a Go-No-Go task. J Cogn Neurosci 9:835–847. doi:10.1162/jocn.1997.9.6.835 pmid:23964603
    OpenUrlCrossRefPubMed
  17. ↵
    1. Chen MY,
    2. Jimura K,
    3. White CN,
    4. Maddox WT,
    5. Poldrack RA
    (2015) Multiple brain networks contribute to the acquisition of bias in perceptual decision-making. Front Neurosci 9:63. doi:10.3389/fnins.2015.00063 pmid:25798082
    OpenUrlCrossRefPubMed
  18. ↵
    1. Cole MW,
    2. Reynolds JR,
    3. Power JD,
    4. Repovs G,
    5. Anticevic A,
    6. Braver TS
    (2013) Multi-task connectivity reveals flexible hubs for adaptive task control. Nat Neurosci 16:1348–1355. doi:10.1038/nn.3470 pmid:23892552
    OpenUrlCrossRefPubMed
  19. ↵
    1. Corbetta M,
    2. Miezin FM,
    3. Dobmeyer S,
    4. Shulman GL,
    5. Petersen SE
    (1991) Selective and divided attention during visual discriminations of shape, color, and speed: functional-anatomy by positron emission tomography. J Neurosci 11:2383–2402. pmid:1869921
    OpenUrlAbstract/FREE Full Text
  20. ↵
    1. Corbetta M,
    2. Shulman GL
    (2002) Control of goal-directed and stimulus-driven attention in the brain. Nat Rev Neurosci 3:201–215. doi:10.1038/nrn755 pmid:11994752
    OpenUrlCrossRefPubMed
  21. ↵
    1. Cramer SC,
    2. Nelles G,
    3. Benson RR,
    4. Kaplan JD,
    5. Parker RA,
    6. Kwong KK,
    7. Kennedy DN,
    8. Finklestein SP,
    9. Rosen BR
    (1997) A functional MRI study of subjects recovered from hemiparetic stroke. Stroke 28:2518–2527. doi:10.1161/01.STR.28.12.2518
    OpenUrlAbstract/FREE Full Text
  22. ↵
    1. Crone EA,
    2. Wendelken C,
    3. Donohue SE,
    4. Bunge SA
    (2006) Neural evidence for dissociable components of task-switching. Cereb Cortex 16:475–486. doi:10.1093/cercor/bhi127 pmid:16000652
    OpenUrlCrossRefPubMed
  23. ↵
    1. Derrfuss J,
    2. Brass M,
    3. Neumann J,
    4. von Cramon DY
    (2005) Involvement of the inferior frontal junction in cognitive control: meta-analyses of switching and Stroop studies. Hum Brain Mapp 25:22–34. doi:10.1002/hbm.20127 pmid:15846824
    OpenUrlCrossRefPubMed
  24. ↵
    1. Desimone R,
    2. Duncan J
    (1995) Neural mechanisms of selective visual-attention. Annu Rev Neurosci 18:193–222.
    OpenUrlCrossRefPubMed
  25. ↵
    1. Dosenbach NUF,
    2. Visscher KM,
    3. Palmer ED,
    4. Miezin FM,
    5. Wenger KK,
    6. Kang HSC,
    7. Burgund ED,
    8. Grimes AL,
    9. Schlaggar BL,
    10. Petersen SE
    (2006) A core system for the implementation of task sets. Neuron 50:799–812.
    OpenUrlCrossRefPubMed
  26. ↵
    1. Dove A,
    2. Pollmann S,
    3. Schubert T,
    4. Wiggins CJ,
    5. von Cramon DY
    (2000) Prefrontal cortex activation in task switching: an event-related fMRI study. Brain Res Cogn Brain Res 9:103–109. doi:10.1016/s0926-6410(99)00029-4 pmid:10666562
    OpenUrlCrossRefPubMed
  27. ↵
    1. Duncan J
    (2010) The multiple-demand (MD) system of the primate brain: mental programs for intelligent behaviour. Trends Cogn Sci 14:172–179. doi:10.1016/j.tics.2010.01.004
    OpenUrlCrossRefPubMed
  28. ↵
    1. Egner T,
    2. Hirsch J
    (2005) Cognitive control mechanisms resolve conflict through cortical amplification of task-relevant information. Nat Neurosci 8:1784–1790. doi:10.1038/nn1594 pmid:16286928
    OpenUrlCrossRefPubMed
  29. ↵
    1. Eklund A,
    2. Nichols TE,
    3. Knutsson H
    (2016) Cluster failure: inflated false positives for fMRI. Proc Natl Acad Sci USA 113:7900–7905. doi:10.1073/pnas.1602413113 pmid:27357684
    OpenUrlAbstract/FREE Full Text
  30. ↵
    1. Erwin RJ,
    2. Gur RC,
    3. Gur RE,
    4. Skolnick B,
    5. Mawhinney-Hee M,
    6. Smailis J
    (1992) Facial emotion discrimination: I. Task construction and behavioral findings in normal subjects. Psychiatry Res 42:231–240. doi:10.1016/0165-1781(92)90115-J
    OpenUrlCrossRefPubMed
  31. ↵
    1. Friston KJ,
    2. Harrison L,
    3. Penny W
    (2003) Dynamic causal modelling. Neuroimage 19:1273–1302. doi:10.1016/S1053-8119(03)00202-7
    OpenUrlCrossRefPubMed
  32. ↵
    1. Friston KJ,
    2. Litvak V,
    3. Oswal A,
    4. Razi A,
    5. Stephan KE,
    6. Wijk BC,
    7. Ziegler G,
    8. Zeidman P
    (2016) Bayesian model reduction and empirical Bayes for group (DCM) studies. Neuroimage 128:413–431. doi:10.1016/j.neuroimage.2015.11.015 pmid:26569570
    OpenUrlCrossRefPubMed
  33. ↵
    1. Fuster JM
    (2015) The prefrontal Cortex, Ed 5. London: Academic Press.
  34. ↵
    1. Glasser MF,
    2. Coalson TS,
    3. Robinson EC,
    4. Hacker CD,
    5. Harwell J,
    6. Yacoub E,
    7. Ugurbil K,
    8. Andersson J,
    9. Beckmann CF,
    10. Jenkinson M,
    11. Smith SM,
    12. van Essen DC
    (2016) A multi-modal parcellation of human cerebral cortex. Nature 536:171–178. doi:10.1038/nature18933 pmid:27437579
    OpenUrlCrossRefPubMed
  35. ↵
    1. Gold BT,
    2. Kertesz A
    (2000) Right hemisphere semantic processing of visual words in an aphasic patient: an fMRI study. Brain Lang 73:456–465. doi:10.1006/brln.2000.2317 pmid:10860566
    OpenUrlCrossRefPubMed
  36. ↵
    1. Gold JI,
    2. Shadlen MN
    (2007) The neural basis of decision making. Annu Rev Neurosci 30:535–574. doi:10.1146/annurev.neuro.29.051605.113038 pmid:17600525
    OpenUrlCrossRefPubMed
  37. ↵
    1. He Q,
    2. Huang X,
    3. Zhang S,
    4. Turel O,
    5. Ma L,
    6. Bechara A
    (2019) Dynamic causal modeling of insular, striatal, and prefrontal cortex activities during a food-specific Go/NoGo task. Biol Psychiatry Cogn Neurosci Neuroimaging 4:1080–1089. doi:10.1016/j.bpsc.2018.12.005 pmid:30691967
    OpenUrlCrossRefPubMed
  38. ↵
    1. Huk AC,
    2. Dougherty RF,
    3. Heeger DJ
    (2002) Retinotopy and functional subdivision of human areas MT and MST. J Neurosci 22:7195–7205. pmid:20026661 pmid:12177214
    OpenUrlAbstract/FREE Full Text
  39. ↵
    1. Jersild AT
    (1927) Mental set and shift. Arch Psychol 89:5–82.
    OpenUrl
  40. ↵
    1. Jiang J,
    2. Wagner AD,
    3. Egner T
    (2018) Integrated externally and internally generated task predictions jointly guide cognitive control in prefrontal cortex. eLife 16:e39497.
    OpenUrl
  41. ↵
    1. Jimura K,
    2. Braver TS
    (2010) Age-related shifts in brain activity dynamics during task switching. Cereb Cortex 20:1420–1431. doi:10.1093/cercor/bhp206 pmid:19805420
    OpenUrlCrossRefPubMed
  42. ↵
    1. Jimura K,
    2. Konishi S,
    3. Miyashita Y
    (2004) Dissociable concurrent activity of lateral and medial frontal lobe during negative feedback processing. Neuroimage 22:1578–1586. doi:10.1016/j.neuroimage.2004.04.012 pmid:15275914
    OpenUrlCrossRefPubMed
  43. ↵
    1. Jimura K,
    2. Cazalis F,
    3. Stover ER,
    4. Poldrack RA
    (2014) The neural basis of task switching changes with skill acquisition. Front Hum Neurosci 8:339. doi:10.3389/fnhum.2014.00339 pmid:24904378
    OpenUrlCrossRefPubMed
  44. ↵
    1. Kastner S,
    2. Ungerleider LG
    (2000) Mechanisms of visual attention in the human cortex. Annu Rev Neurosci 23:315–341.
    OpenUrlCrossRefPubMed
  45. ↵
    1. Kayser AS,
    2. Erickson DT,
    3. Buchsbaum BR,
    4. D'Esposito M
    (2010) Neural representations of relevant and irrelevant features in perceptual decision making. J Neurosci 30:15778–15789. doi:10.1523/JNEUROSCI.3163-10.2010 pmid:21106817
    OpenUrlAbstract/FREE Full Text
  46. ↵
    1. Kim C,
    2. Johnson NF,
    3. Cilles SE,
    4. Gold BT
    (2011) Common and distinct mechanisms of cognitive flexibility in prefrontal cortex. J Neurosci 31:4771–4779. doi:10.1523/JNEUROSCI.5923-10.2011 pmid:21451015
    OpenUrlAbstract/FREE Full Text
  47. ↵
    1. Kim C,
    2. Cilles SE,
    3. Johnson NF,
    4. Gold BT
    (2012) Domain general and domain preferential brain regions associated with different types of task switching: a meta-analysis. Hum Brain Mapp 33:130–142. doi:10.1002/hbm.21199 pmid:21391260
    OpenUrlCrossRefPubMed
  48. ↵
    1. Kim JN,
    2. Shadlen MN
    (1999) Neural correlates of a decision in the dorsolateral prefrontal cortex of the macaque. Nat Neurosci 2:176–185. doi:10.1038/5739 pmid:10195203
    OpenUrlCrossRefPubMed
  49. ↵
    1. Konishi S,
    2. Nakajima K,
    3. Uchida I,
    4. Kameyama M,
    5. Nakahara K,
    6. Sekihara K,
    7. Miyashita Y
    (1998) Transient activation of inferior prefrontal cortex during cognitive set shifting. Nat Neurosci 1:80–84. doi:10.1038/283 pmid:10195114
    OpenUrlCrossRefPubMed
  50. ↵
    1. Konishi S,
    2. Hayashi T,
    3. Uchida I,
    4. Kikyo H,
    5. Takahashi E,
    6. Miyashita Y
    (2002) Hemispheric asymmetry in human lateral prefrontal cortex during cognitive set shifting. Proc Natl Acad Sci USA 99:7803–7808. doi:10.1073/pnas.122644899 pmid:12032364
    OpenUrlAbstract/FREE Full Text
  51. ↵
    1. Kriegeskorte N,
    2. Goebel R,
    3. Bandettini P
    (2006) Information-based functional brain mapping. Proc Natl Acad Sci USA 103:3863–3868. doi:10.1073/pnas.0600244103 pmid:16537458
    OpenUrlAbstract/FREE Full Text
  52. ↵
    1. Kriegeskorte N,
    2. Simmons WK,
    3. Bellgowan PS,
    4. Baker CI
    (2009) Circular analysis in systems neuroscience: the dangers of double dipping. Nat Neurosci 12:535–540. doi:10.1038/nn.2303 pmid:19396166
    OpenUrlCrossRefPubMed
  53. ↵
    1. Krystal JH,
    2. Karper LP,
    3. Seibyl JP,
    4. Freeman GK,
    5. Delaney R,
    6. Bremner JD,
    7. Heninger GR,
    8. Bowers MB,
    9. Charney DS
    (1994) Subanesthetic effects of the noncompetitive NMDA antagonist, ketamine, in humans: psychotomimetic, perceptual, cognitive, and neuroendocrine responses. Arch Gen Psychiatry 51:199–214. doi:10.1001/archpsyc.1994.03950030035004 pmid:8122957
    OpenUrlCrossRefPubMed
  54. ↵
    1. Kumano H,
    2. Suda Y,
    3. Uka T
    (2016) Context-dependent accumulation of sensory evidence in the parietal cortex underlies flexible task switching. J Neurosci 36:12192–12202. doi:10.1523/JNEUROSCI.1693-16.2016 pmid:27903728
    OpenUrlAbstract/FREE Full Text
  55. ↵
    1. Loose LS,
    2. Wisniewski D,
    3. Rusconi M,
    4. Goschke T,
    5. Haynes JD
    (2017) Switch-independent task representations in frontal and parietal cortex. J Neurosci 37:8033–8042. doi:10.1523/JNEUROSCI.3656-16.2017 pmid:28729441
    OpenUrlAbstract/FREE Full Text
  56. ↵
    1. MacDonald AW,
    2. Cohen JD,
    3. Stenger VA,
    4. Carter CS
    (2000) Dissociating the role of the dorsolateral prefrontal and anterior cingulate cortex in cognitive control. Science 288:1835–1838. doi:10.1126/science.288.5472.1835 pmid:10846167
    OpenUrlAbstract/FREE Full Text
  57. ↵
    1. Mante V,
    2. Sussillo D,
    3. Shenoy KV,
    4. Newsome WT
    (2013) Context-dependent computation by recurrent dynamics in prefrontal cortex. Nature 503:78–84. doi:10.1038/nature12742 pmid:24201281
    OpenUrlCrossRefPubMed
  58. ↵
    1. Mazurek ME,
    2. Roitman JD,
    3. Ditterich J,
    4. Shadlen MN
    (2003) A role for neural integrators in perceptual decision making. Cereb Cortex 13:1257–1269. doi:10.1093/cercor/bhg097 pmid:14576217
    OpenUrlCrossRefPubMed
  59. ↵
    1. Miller EK,
    2. Cohen JD
    (2001) An integrative theory of prefrontal cortex function. Annu Rev Neurosci 24:167–202. doi:10.1146/annurev.neuro.24.1.167 pmid:11283309
    OpenUrlCrossRefPubMed
  60. ↵
    1. Miyake A,
    2. Friedman NP,
    3. Emerson MJ,
    4. Witzki AH,
    5. Howerter A,
    6. Wager TD
    (2000) The unity and diversity of executive functions and their contributions to complex “frontal lobe” tasks: a latent variable analysis. Cogn Psychol 41:49–100. doi:10.1006/cogp.1999.0734 pmid:10945922
    OpenUrlCrossRefPubMed
  61. ↵
    1. Moeller S,
    2. Yacoub E,
    3. Olman CA,
    4. Auerbach E,
    5. Strupp J,
    6. Harel N,
    7. Uğurbil K
    (2010) Multiband multislice GE-EPI at 7 tesla, with 16-fold acceleration using partial parallel imaging with application to high spatial and temporal whole-brain fMRI. Magn Reson Med 63:1144–1153. doi:10.1002/mrm.22361 pmid:20432285
    OpenUrlCrossRefPubMed
  62. ↵
    1. Monsell S
    (2003) Task switching. Trends Cogn Sci 7:134–140. doi:10.1016/s1364-6613(03)00028-7 pmid:12639695
    OpenUrlCrossRefPubMed
  63. ↵
    1. Motter BC
    (1994) Neural correlates of attentive selection for color or luminance in extrastriate area V4. J Neurosci 14:2178–2189. doi:10.1523/JNEUROSCI.14-04-02178.1994
    OpenUrlAbstract/FREE Full Text
  64. ↵
    1. Nee DE,
    2. D'Esposito M
    (2016) The hierarchical organization of the lateral prefrontal cortex. eLife 5:e12112. doi:10.7554/eLife.12112
    OpenUrlCrossRefPubMed
  65. ↵
    1. Newsome WT,
    2. Pare EB
    (1988) A selective impairment of motion perception following lesions of the middle temporal visual area (MT). J Neurosci 8:2201–2211. pmid:3385495
    OpenUrlAbstract/FREE Full Text
  66. ↵
    1. Osada T,
    2. Adachi Y,
    3. Miyamoto K,
    4. Jimura K,
    5. Setsuie R,
    6. Miyashita Y
    (2015) Dynamically allocated hub in task-evoked network predicts the vulnerable prefrontal locus for contextual memory retrieval in macaques. PLoS Biol 13:e1002177. doi:10.1371/journal.pbio.1002177 pmid:26125513
    OpenUrlCrossRefPubMed
  67. ↵
    1. Palmer J,
    2. Huk AC,
    3. Shadlen MN
    (2005) The effect of stimulus strength on the speed and accuracy of a perceptual decision. J Vis 5:376–404.
    OpenUrlCrossRefPubMed
  68. ↵
    1. Pelli DG
    (1997) The VideoToolbox software for visual psychophysics: transforming numbers into movies. Spat Vis 10:437–442. pmid:9176953
    OpenUrlCrossRefPubMed
  69. ↵
    1. Penny WD,
    2. Stephan KE,
    3. Mechelli A,
    4. Friston KJ
    (2004) Comparing dynamic causal models. Neuroimage 22:1157–1172. doi:10.1016/j.neuroimage.2004.03.026 pmid:15219588
    OpenUrlCrossRefPubMed
  70. ↵
    1. Penny WD,
    2. Stephan KE,
    3. Daunizeau J,
    4. Rosa MJ,
    5. Friston KJ,
    6. Schofield TM,
    7. Leff AP
    (2010) Comparing families of dynamic causal models. PLoS Comput Biol 6:e1000709. doi:10.1371/journal.pcbi.1000709 pmid:20300649
    OpenUrlCrossRefPubMed
  71. ↵
    1. Purcell BA,
    2. Kiani R
    (2016) Hierarchical decision processes that operate over distinct timescales underlie choice and changes in strategy. Proc Natl Acad Sci USA 113:E4531–E4540. doi:10.1073/pnas.1524685113 pmid:27432960
    OpenUrlAbstract/FREE Full Text
  72. ↵
    1. Qiao L,
    2. Zhang L,
    3. Chen A,
    4. Egner T
    (2017) Dynamic trial-by-trial recoding of task-set representations in the frontoparietal cortex mediates behavioral flexibility. J Neurosci 37:11037–11050. doi:10.1523/JNEUROSCI.0935-17.2017 pmid:28972126
    OpenUrlAbstract/FREE Full Text
  73. ↵
    1. Roberts AC,
    2. Robbins TW,
    3. Weiskrantz L
    (1998) The prefrontal cortex: executive and cognitive functions. Oxford:Oxford University Press.
  74. ↵
    1. Rogers RD,
    2. Monsell S
    (1995) Costs of a predictable switch between simple cognitive tasks. J Exp Psychol Gen 124:207–231. doi:10.1037/0096-3445.124.2.207
    OpenUrlCrossRef
  75. ↵
    1. Romo R,
    2. Hernandez A,
    3. Zainos A,
    4. Salinas E
    (1998) Somatosensory discrimination based on cortical microstimulation. Nature 392:387–390. doi:10.1038/32891 pmid:9537321
    OpenUrlCrossRefPubMed
  76. ↵
    1. Rushworth MF,
    2. Passingham RE,
    3. Nobre AC
    (2002) Components of switching intentional set. J Cogn Neurosci 14:1139–1150. doi:10.1162/089892902760807159 pmid:12495521
    OpenUrlCrossRefPubMed
  77. ↵
    1. Sakai K
    (2008) Task set and prefrontal cortex. Annu Rev Neurosci 31:129–245.
    OpenUrl
  78. ↵
    1. Sarafyazd M,
    2. Jazayeri M
    (2019) Hierarchical reasoning by neural circuits in the frontal cortex. Science 364:eaav8911. doi:10.1126/science.aav8911
    OpenUrlAbstract/FREE Full Text
  79. ↵
    1. Schein SJ,
    2. Desimone R
    (1990) Spectral properties of V4 neurons in the macaque. J Neurosci 10:3369–3389. pmid:2213146
    OpenUrlAbstract/FREE Full Text
  80. ↵
    1. Shackman AJ,
    2. Salomons TV,
    3. Slagter HA,
    4. Fox AS,
    5. Winter JJ,
    6. Davidson RJ
    (2011) The integration of negative affect, pain and cognitive control in the cingulate cortex. Nat Rev Neurosci 12:154–167. doi:10.1038/nrn2994 pmid:21331082
    OpenUrlCrossRefPubMed
  81. ↵
    1. Seeley WW,
    2. Menon V,
    3. Schatzberg AF,
    4. Keller J,
    5. Glover GH,
    6. Kenna H,
    7. Reiss AL,
    8. Greicius MD
    (2007) Dissociable intrinsic connectivity networks for salience processing and executive control. J Neurosci 27:2349–2356. doi:10.1523/JNEUROSCI.5587-06.2007 pmid:17329432
    OpenUrlAbstract/FREE Full Text
  82. ↵
    1. Shadlen MN,
    2. Newsome WT
    (1994) Noise, neural codes and cortical organization. Curr Opin Neurobiol 4:569–579. doi:10.1016/0959-4388(94)90059-0
    OpenUrlCrossRefPubMed
  83. ↵
    1. Shadlen MN,
    2. Britten KH,
    3. Newsome WT,
    4. Movshon JA
    (1996) A computational analysis of the relationship between neuronal and behavioral responses to visual motion. J Neurosci 16:1486–1510. doi:10.1523/JNEUROSCI.16-04-01486.1996
    OpenUrlAbstract/FREE Full Text
  84. ↵
    1. Stephan KE,
    2. Penny WD,
    3. Moran RJ,
    4. den Ouden HE,
    5. Daunizeau J,
    6. Friston KJ
    (2010) Ten simple rules for dynamic causal modeling. Neuroimage 49:3099–3109. doi:10.1016/j.neuroimage.2009.11.015 pmid:19914382
    OpenUrlCrossRefPubMed
  85. ↵
    1. Tomita H,
    2. Ohbayashi M,
    3. Nakahara K,
    4. Hasegawa I,
    5. Miyashita Y
    (1999) Top-down signal from prefrontal cortex in executive control of memory retrieval. Nature 401:699–703
    OpenUrlCrossRefPubMed
  86. ↵
    1. Treisman AM,
    2. Kanwisher NG
    (1998) Perceiving visually presented objects: recognition, awareness, and modularity. Curr Opin Neurobiol 8:218–226. doi:10.1016/S0959-4388(98)80143-8
    OpenUrlCrossRefPubMed
  87. ↵
    1. Waskom ML,
    2. Kumaran D,
    3. Gordon AM,
    4. Rissman J,
    5. Wagner AD
    (2014) Frontoparietal representations of task context support the flexible control of goal-directed cognition. J Neurosci 34:10743–10755. doi:10.1523/JNEUROSCI.5282-13.2014 pmid:25100605
    OpenUrlAbstract/FREE Full Text
  88. ↵
    1. Worsley DB,
    2. Friston KJ
    (1995) Analysis of fMRI time-series revisited again. Neuroimage 2:173–181. doi:10.1006/nimg.1995.1023 pmid:9343600
    OpenUrlCrossRefPubMed
  89. ↵
    1. Yarkoni T,
    2. Poldrack RA,
    3. Nichols TE,
    4. van Essen DC,
    5. Wager TD
    (2011) Large-scale automated synthesis of human functional neuroimaging data. Nat Methods 8:665–670. doi:10.1038/nmeth.1635 pmid:21706013
    OpenUrlCrossRefPubMed
  90. ↵
    1. Yeung N,
    2. Nystrom LE,
    3. Aronson JA,
    4. Cohen JD
    (2006) Between-task competition and cognitive control in task switching. J Neurosci 26:1429–1438. doi:10.1523/JNEUROSCI.3109-05.2006 pmid:16452666
    OpenUrlAbstract/FREE Full Text
  91. ↵
    1. Zeki S
    (1973) Colour coding in rhesus monkey prestriate cortex. Brain Res 53:422–427. doi:10.1016/0006-8993(73)90227-8 pmid:4196224
    OpenUrlCrossRefPubMed
  92. ↵
    1. Zeki S,
    2. Watson JD,
    3. Lueck CJ,
    4. Friston KJ,
    5. Kennard C,
    6. Frackowiak RS
    (1991) A direct demonstration of functional specialization in human visual cortex. J Neurosci 11:641–649. pmid:2002358
    OpenUrlAbstract/FREE Full Text
  93. ↵
    1. Zhang J,
    2. Kriegeskorte N,
    3. Carlin JD,
    4. Rowe JB
    (2013) Choosing the rules: distinct and overlapping frontoparietal representations of task rules for perceptual decisions. J Neurosci 33:11852–11862. doi:10.1523/JNEUROSCI.5193-12.2013 pmid:23864675
    OpenUrlAbstract/FREE Full Text
Back to top

In this issue

The Journal of Neuroscience: 41 (10)
Journal of Neuroscience
Vol. 41, Issue 10
10 Mar 2021
  • Table of Contents
  • Table of Contents (PDF)
  • About the Cover
  • Index by author
  • Ed Board (PDF)
Email

Thank you for sharing this Journal of Neuroscience article.

NOTE: We request your email address only to inform the recipient that it was you who recommended this article, and that it is not junk mail. We do not retain these email addresses.

Enter multiple addresses on separate lines or separate them with commas.
Cross-Hemispheric Complementary Prefrontal Mechanisms during Task Switching under Perceptual Uncertainty
(Your Name) has forwarded a page to you from Journal of Neuroscience
(Your Name) thought you would be interested in this article in Journal of Neuroscience.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Print
View Full Page PDF
Citation Tools
Cross-Hemispheric Complementary Prefrontal Mechanisms during Task Switching under Perceptual Uncertainty
Kaho Tsumura, Ryuta Aoki, Masaki Takeda, Kiyoshi Nakahara, Koji Jimura
Journal of Neuroscience 10 March 2021, 41 (10) 2197-2213; DOI: 10.1523/JNEUROSCI.2096-20.2021

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Respond to this article
Request Permissions
Share
Cross-Hemispheric Complementary Prefrontal Mechanisms during Task Switching under Perceptual Uncertainty
Kaho Tsumura, Ryuta Aoki, Masaki Takeda, Kiyoshi Nakahara, Koji Jimura
Journal of Neuroscience 10 March 2021, 41 (10) 2197-2213; DOI: 10.1523/JNEUROSCI.2096-20.2021
del.icio.us logo Digg logo Reddit logo Twitter logo Facebook logo Google logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • Abstract
    • Introduction
    • Materials and Methods
    • Results
    • Discussion
    • Footnotes
    • References
  • Figures & Data
  • Info & Metrics
  • eLetters
  • PDF

Keywords

  • behavioral flexibility
  • executive control
  • occipitotemporal
  • perceptual decision-making
  • prefrontal

Responses to this article

Respond to this article

Jump to comment:

No eLetters have been published for this article.

Related Articles

Cited By...

More in this TOC Section

Research Articles

  • Neuromedin B-expressing neurons in the retrotrapezoid nucleus regulate respiratory homeostasis and promote stable breathing in adult mice
  • Distinct features of interictal activity predict seizure localization and burden in a mouse model of childhood epilepsy
  • A visual pathway into central complex for high frequency motion-defined bars in Drosophila
Show more Research Articles

Behavioral/Cognitive

  • The Differential Weights of Motivational and Task Performance Measures on Medial and Lateral Frontal Neural Activity
  • Prior Movement of One Arm Facilitates Motor Adaptation in the Other
  • Intracranial Electroencephalography and Deep Neural Networks Reveal Shared Substrates for Representations of Face Identity and Expressions
Show more Behavioral/Cognitive
  • Home
  • Alerts
  • Visit Society for Neuroscience on Facebook
  • Follow Society for Neuroscience on Twitter
  • Follow Society for Neuroscience on LinkedIn
  • Visit Society for Neuroscience on Youtube
  • Follow our RSS feeds

Content

  • Early Release
  • Current Issue
  • Issue Archive
  • Collections

Information

  • For Authors
  • For Advertisers
  • For the Media
  • For Subscribers

About

  • About the Journal
  • Editorial Board
  • Privacy Policy
  • Contact
(JNeurosci logo)
(SfN logo)

Copyright © 2023 by the Society for Neuroscience.
JNeurosci Online ISSN: 1529-2401

The ideas and opinions expressed in JNeurosci do not necessarily reflect those of SfN or the JNeurosci Editorial Board. Publication of an advertisement or other product mention in JNeurosci should not be construed as an endorsement of the manufacturer’s claims. SfN does not assume any responsibility for any injury and/or damage to persons or property arising from or related to any use of any material contained in JNeurosci.