Trial-by-Trial Coupling of Concurrent Electroencephalogram and Functional Magnetic Resonance Imaging Identifies the Dynamics of Performance Monitoring

The selected ICs are equivalent to the scalp-recorded ERN. a, Identified components were characterized by a radial central topography. Depicted is the grand mean IC topography, after root-mean-square normalization (arbitrary units). b, Grand average (n = 13 subjects) IC activation ERPs for the vertex electrode (Cz), time-locked to response-onset times, revealed the ERN in the incompatible error condition. Negativity is plotted upwards. c, Informed dipole seeding of the grand mean IC topography shown in a, at Talairach coordinates (x, y, z) = 0, 20, 30. This location was derived from standard analysis of the concurrently recorded fMRI contrasting incompatible error and incompatible correct trials. The equivalent current dipole, which explained 90.2% of the variance, is plotted on a canonical magnetic resonance image template of the human head. RV, Residual variance. d, ERP-image plot of IC incompatible error trials at vertex electrode (Cz) aligned to stimulus onset (0). Sorting the trials by reaction time (sigmoid white line) and smoothing with a moving average across 30 trials visualizes the ERN–reaction time relationship. e, Time–frequency analysis of the total power difference (in decibels) between IC incompatible error and incompatible correct trials. Significantly more theta activity for the error condition is indicated by the black contour line. The white vertical lines denote the stimulus onset time (0 ms) and mean reaction time for erroneous responses, respectively.

a, Quantification of IC single-trial amplitudes exemplified for three trials from the three different conditions. The color code is as in d. The mean of the ERN preceding (–80–0 ms) and after (85–240 ms) positive peaks was subtracted from the negative peak occurring after each button-press (15–85 ms), giving an amplitude for every single trial. The numbers state the corresponding single-trial amplitude. b, Resulting single-trial amplitudes for a representative subject over the course of ∼250 trials (of 400 trials in total). For visualization, the single single-trial amplitude values are color-coded according to the stimulus–response condition. The color code is as in d. Note the considerable amount of variance within each experimental condition presumably reflecting the varying strength of performance monitoring. c, Single-subject example showing for the incompatible error condition the relationship between single-trial amplitude and reaction time, separately for the current trial (open circles; dashed regression curve) and for the reaction time of the following trial (filled squares; solid regression curve). d, Second-level result across all n = 13 subjects, showing the mean reaction time to single-trial amplitudes slope (+SEM) for all three conditions after removal of outlier (>3 SD) and late feedback trials, separately for the same trial and for the next trial. ^*p < 0.05.

Result of the EEG-informed parametric fMRI analysis based on IC single-trial amplitudes, plotted on an individual brain. fMRI signals correlated with single-trial amplitudes solely in the RCZ along the banks of the cingulate sulcus [center of gravity at coordinates (x, y, z) = 0, 17, 42; z =–3.86]. The left part shows coronal view; the right part shows the sagittal view on the right hemisphere. The red lines on the middle top view inset indicate slice sections. R, Right; L, left; A, anterior; P, posterior.