Abstract
We remember information that is congruent instead of incongruent with prior knowledge better, but the underlying neural mechanisms related to this enhancement are still relatively unknown. Recently, this memory enhancement due to a prior schema has been suggested to be based on rapid neocortical assimilation of new information, related to optimized encoding and consolidation processes. The medial prefrontal cortex (mPFC) is thought to be important in mediating this process, but its role in retrieval of schema-consistent information is still unclear. In this study, we regarded multisensory congruency with prior knowledge as a schema and used this factor to probe retrieval of consolidated memories either consistent or inconsistent with prior knowledge. We conducted a visuotactile learning paradigm in which participants studied visual motifs randomly associated with word–fabric combinations that were either congruent or incongruent with common knowledge. The next day, participants were scanned using functional magnetic resonance imaging while their memory was tested. Congruent associations were remembered better than incongruent ones. This behavioral finding was parallelized by stronger retrieval-related activity in and connectivity between medial prefrontal and left somatosensory cortex. Moreover, we found a positive across-subject correlation between the connectivity enhancement and the behavioral congruency effect. These results show that successful retrieval of congruent compared to incongruent visuotactile associations is related to enhanced processing in an mPFC–somatosensory network, and support the hypothesis that new information that fits a preexisting schema is more rapidly assimilated in neocortical networks, a process that may be mediated, at least in part, by the mPFC.
Introduction
New information that is consistent with prior knowledge is remembered better. Why this enhancement arises, and how it is expressed in the brain, however, is still relatively unknown. Prior knowledge is suggested to lead to easier assimilation within an interrelated set of neocortical representations, or schema, when this new information finds multiple links within such a schema (Wang and Morris, 2010). Neural processes related to optimized encoding (van Kesteren et al., 2010) and consolidation (Tse et al., 2007; Wang and Morris, 2010) have been suggested to play an important role in this enhancement. However, how prior knowledge affects processes related to memory retrieval has not yet been investigated.
Along with the hippocampus, an important brain region that is indicated to be involved in the retrieval of consolidated memories is the medial prefrontal cortex (mPFC) (Frankland and Bontempi, 2006; Takashima et al., 2006; Takehara-Nishiuchi and McNaughton, 2008). Moreover, the interaction between the hippocampus and the mPFC is believed to be important already in early stages of memory formation, as discovered in rodents (Benchenane et al., 2010), as well as humans (van Kesteren et al., 2010). Specifically, hippocampal–mPFC coupling is found to decrease during encoding of new information that fits prior knowledge (van Kesteren et al., 2010), suggesting that along with hippocampal involvement, the mPFC may play an important role already during initial processing of schema-related information. Based on these insights, the pointer function of the hippocampus, binding distributed memory representations (Marr, 1970; Rasch and Born, 2007), has been suggested to gradually shift to the mPFC (Frankland and Bontempi, 2006; Takashima et al., 2006), a process that is potentially facilitated by a preexisting schema (van Kesteren et al., 2010). Consequently, retrieval of a stimulus consistent with prior schema is expected to lead to improved memory performance (Bransford and Johnson, 1972; Staresina et al., 2009), related to enhanced mPFC activity and connectivity with specific brain areas, representing elements of the learned information (Wheeler et al., 2000).
In this study, we investigated the effect of preexisting schema on retrieval-related brain activity by manipulating semantic congruency of multisensory stimuli (Kim et al., 2008; Shams and Seitz, 2008). We chose for this setup, because multisensory stimuli that fit with prior knowledge can be regarded as schema-congruent, and remembering multisensory information is easier if it represents a feature combination congruent with prior experience (Kim et al., 2008; Yuval-Greenberg and Deouell, 2009). This semantic congruency can be regarded as information that can readily be assimilated into preexisting mental schemata. If this hypothesis holds, semantic congruency of multisensory stimuli will act as a schema and lead to enhanced memory performance along with enhanced activity in and connectivity between the mPFC and specific sensory cortices at retrieval (Harris et al., 2001). Concomitant with this mPFC enhancement, hippocampal involvement at retrieval is expected to decrease.
Materials and Methods
Participants.
Twenty-six native Dutch female right-handed students participated in this study. All were healthy and had normal or corrected-to-normal vision. They were paid to participate and were told that they could earn extra money for better performance. Three participants were excluded after data acquisition, one because of excessive movement during scanning, and two because of poor item memory performance (total item recognition hits < 30), which left 23 participants for analyses. This sample covered an age range of 18–30 years, with a mean age of 22.65 years. They self-reported to have slept on average 7.67 h in between the 2 examination days (ranging from 6 to 9 h). We decided to recruit women only, because they generally have more interest in and knowledge about fashion-like stimuli, and they are shown to have more tactile spatial acuity in their fingertips than men (Peters et al., 2009). Ethical approval was obtained from the institutional review board (CMO Region Arnhem-Nijmegen, The Netherlands), and all participants gave written informed consent.
Stimuli.
Participants learned a series of triplets of simultaneously presented stimuli that, when associated with each other, formed an object likely to be present in real life. These associations consisted of (1) motifs (200), visually presented as a two-dimensional, pictorial square without tactile information; (2) visually presented object words (20) describing objects primarily composed of fabrics; and (3) fabric samples (20) that could be linked to the object words. Motifs (400 in total, including lures) were obtained from the Internet, and were equalized in size (256 × 256 pixels, 28.35 pixels/cm, indexed color mode) and autocontrasted using Adobe Photoshop CS3, version 10.0.1 (Adobe). Fabric samples were cut into squares of 5 × 5 cm, and object–fabric combinations were categorized as being either semantically congruent (for example, a leather jacket) or semantically incongruent (for example, a lace umbrella). The (in)congruency of these combinations was verified in an independent behavioral pilot, where participants (n = 12) were asked to rate the congruency of word–fabric combinations from 1 to 6. Combinations rated on average 2.5 or lower were considered incongruent, and combinations rated on average 3.5 or higher were considered congruent. Combinations in between these ratings were altered to either fit a congruent or incongruent representation.
Design and general procedure.
Participants were tested using a within-subject 2 × 3 factorial design with congruency (congruent items vs incongruent items) and memory (associatively remembered items vs associatively forgotten items vs completely forgotten items) as within-subject factors (see Fig. 1). They were invited to come to the center on 2 consecutive days with on average 19.83 h between the two visits (ranging from 18.5 to 21 h). On day 1, participants were instructed to memorize simultaneously presented triplets of visual motifs, visual object words, and tactile fabric samples by imagining how the combination of these features would look. They were told that their memory would be tested in the MR scanner on the next day, but they received no information about the specifics of this memory test. Using Presentation 10.2 (Neurobehavioral Systems), the motif and the word were visually presented on a computer screen for 6 s, the word situated above the motif. Concurrently, participants were instructed in a practice session to tactilely explore a fabric for the complete 6 s, and imagine how the combination of motif, word, and fabric would look. The fabric was presented by the experimenter underneath a heightened plateau on which the computer screen was placed, and was not visible to the participant. After presentation of each stimulus combination, participants were asked to indicate whether they thought the triplet characterizing the imagined object was either pretty or ugly (see Fig. 1).
In total, participants memorized 200 sequentially presented combinations, 100 congruent and 100 incongruent, divided into three sessions of consecutively 80, 80, and 40 trials. The 20 object words and 20 fabric samples were combined into 80 possible combinations, with each object word linked to two congruent and two incongruent fabrics. For the last session of 40 presentations, only one congruent and one incongruent object–fabric combination were used instead of two. Within each session, object–fabric associations were randomly divided, but equal for each participant, while motifs were randomly shuffled for each participant. Thus, every participant learned the same object–fabric combinations, but for each participant these were differently associated with the motifs.
On the second day, participants were scanned while they performed an item recognition memory test (with confidence rating) for the motifs presented the day before. Participants lay supine in the scanner, wore headphones (Commander XG, Magnetic Resonance Technology), and responded using left and right button boxes, which were fastened with tape to the upper legs so they would not move. They viewed the screen through a mirror positioned on top of the head coil. They were instructed to respond within the 3 s presentation time, try to move as little as possible, and keep their fingers as still as possible to avoid involvement of somatosensory stimulation during button presses. Participants received a practice session before starting the experiment. Stimuli were presented in the center of the screen for 3 s, and were followed by a fixation cross, presented for 3–6 s. Furthermore, 10 fixation cross baseline trials of 10 s duration were included. These baseline trials were distributed so that within every 40 trials, a baseline trial was presented. After the item recognition memory test, which lasted 51 min and 20 s, a structural scan of 9 min and 38 s was made. Finally, a localizer for the somatosensory cortex (six cycles of a simple blocked design; 15 s on, 15 s off) was performed where participants received somatosensory stimulation on all fingers of both hands by simultaneously moving two cotton swabs across their fingers. This localizer scan lasted 3 min and 15 s in total, and was performed to identify a region of interest (ROI) for further analyses, since the somatosensory cortex has been suggested to be the primary location of somatosensory memories (Burton and Sinclair, 2000; Gallace and Spence, 2009). After the scan session, participants were taken to another room to perform an associative retrieval task additionally.
Memory tests and analyses.
Item recognition memory was tested in the MR scanner using a confidence level approach (six levels) in which participants were instructed to indicate whether a perceived stimulus (200 old and 200 new) was old or new. Six answer options were provided: sure old, nearly sure old, not sure old, not sure new, nearly sure new, and sure new. Answers were given with left and right ring fingers, middle fingers, and index fingers, with the old/new side counterbalanced across participants. The order of the motifs was pseudorandom; no more than four consecutive old or new stimuli were presented. Participants could only answer once and were given feedback on which button they pressed. Answers that were given too late (i.e., after the 3 s presentation time) or were indicated as not sure were not included in the analyses.
Subsequent to the item recognition memory test, participants performed a self-paced, three-alternative forced-choice associative memory task outside the scanner, in which they were instructed to indicate which object word was associated with a certain motif on the previous day. All 200 memorized motifs were randomly and sequentially presented on a computer screen as cues, together with three words, of which one word was the correct answer, and the two other words were randomly sampled from the other 19 words. After participants finished this test, they filled out a study-specific questionnaire.
Behavioral measures of item recognition scores were analyzed using SPSS 15.0 (SPSS) by calculating the percentage of hits and false alarms (both sure old and nearly sure old confidence levels) for both conditions (congruent and incongruent). Next, these values were z-transformed and subtracted from each other to calculate d′ for both conditions. Subsequently, Student's t tests were performed to determine differences from chance level (0; one-sample t test) and differences between the congruent and incongruent conditions (paired-sample t test). Associative memory was analyzed using only the items that were correctly recognized during item recognition. Of these items, percentage correct was calculated for both conditions, and again one-sample (with chance level 1/3) and paired-sample Student's t tests were performed to determine congruency differences. Also, in both memory tests, reaction time differences between both conditions were assessed using the same statistical tests. α was set at 0.05 throughout.
MRI scanning parameters.
Participants were scanned using a 1.5 tesla Siemens Magnetom Avanto system equipped with an eight-channel phased array head coil (MRI Devices). For blood oxygen level-dependent (BOLD) functional magnetic resonance imaging (fMRI) images, we used a T2*-weighted gradient echo planar imaging sequence with the following parameters: repetition time (TR): 2.48 s, echo time: 35 ms, 34 slices, ascending slice order, 3.5 mm slice thickness, 0.35 mm slice gap, matrix size: 64 × 64, field of view (FOV): 212 × 212 mm, flip angle: 90°, and voxel size: 3.3 × 3.3 × 3.5. Slices were angulated in an oblique axial manner to reach whole-brain coverage. To ensure reaching a steady-state condition, the first five scans were discarded. Additionally, T1-weighted anatomical scans at 1 mm isotropic resolution were acquired with TR of 2250 ms, inversion time of 850 ms, flip angle of 15°, and FOV of 256 × 256 × 176 mm.
fMRI data preprocessing and analyses.
Raw fMRI data were preprocessed using SPM5 (http://www.fil.ion.ucl.ac.uk/spm). First, motion correction was performed by using iterative rigid body realignment to minimize the residual sum of squares between the first and all further functional scans. Then, ascending slice timing correction was performed such that all slices were corrected to the time of acquisition of the reference slice (i.e., the middle slice, 17). Subsequently, rigid body coregistration to corresponding individual T1 images was performed using mutual information optimization. Hereafter, data were spatially normalized into a common space, defined by the Montreal Neurological Institute 152 T1 image (voxel size = 2 × 2 × 2), and smoothed by convolving the data with an 8 mm full-width at half-maximum three-dimensional kernel. The first five scans were excluded, which left 1242 scans for analysis.
After preprocessing, statistical parametric maps were generated by modeling the evoked BOLD response for each memory bin (associative hits: item hit + association remembered; associative misses: item hit + association forgotten; forgotten: item forgotten) as a boxcar function of 3 s convolved with a hemodynamic response function. Furthermore, individual movement regressors were added to each first-level model. Subsequently, a random-effects 2 × 3 factorial design was constructed in which congruency (congruent and incongruent) could be tested against memory (item hit + association remembered; item hit + association forgotten; item forgotten). Whole-brain activity for main and interaction effects was considered significant at p < 0.05 corrected at cluster level, after creating a p < 0.001 uncorrected map or small volume corrected (SVC) at p < 0.05 based on a p < 0.001 uncorrected map, with independently determined regions of interests: bilateral hippocampi taken from the AAL template (Tzourio-Mazoyer et al., 2002) and the somatosensory localizer (left side).
The localizer scans were processed using the same procedures as the experimental scans, but without slice time correction. Hemodynamic responses were modeled using a statistical parametric map in which blocks of 15 s on/off were modeled as boxcar functions convolved with a hemodynamic response function, and individual movement regressors were again added to each first-level model. To assess a random-effects analysis of somatosensory stimulation, a one-sample t test was performed. Because activity appeared very strong, we used a threshold of p < 0.00005 uncorrected for this analysis. To determine whether activation was close to the region in the somatosensory cortex dedicated to the fingers, we furthermore used coordinates from a previous study revealing these regions for the separate fingers (Weibull et al., 2008), surrounded by a 6 mm sphere, as ROI (p < 0.001 uncorrected; p < 0.05 SVC).
Psychophysiological interactions (PPIs) were calculated to assess functional connectivity between regions. They were executed using SPM5 (http://www.fil.ion.ucl.ac.uk/spm) in combination with in-house software, written in Matlab 7.5 (The MathWorks). Psychophysiological interaction analyses probe differences in coactivation of a certain seed region (physiological factor) with the rest of the brain modulated by an external factor (psychological factor). Here, we examined coactivation differences that were significantly larger for congruent than for incongruent items and vice versa. Only voxels that were significantly active in an effect of interest analysis were used for this analysis. The single-subject general linear model (GLM) constructed for previous analyses was extended with two regressors: the general deconvolved signal from the seed region, and the deconvolved signal from the seed region for the contrast congruent hits versus incongruent hits. For each subject, this second physiological activity was used as input for the second-level random-effects analysis. The seeds in mPFC and somatosensory cortex, present in the congruency × subsequent associative memory interaction, were defined by taking the peak voxel surrounded by a 5 mm sphere. Connectivity was again considered significant at p < 0.001 uncorrected at voxel level and p < 0.05 corrected at cluster level or at p < 0.001 uncorrected at voxel level and SVC at p < 0.05 with the somatosensory localizer.
To determine correlations between PPI strength and behavior across participants, PPI measures were extracted from SPM and analyzed using SPSS. A two-tailed Pearson correlation test between PPI measures and congruency benefit of associatively remembered items (congruent/incongruent), was performed. α was again set at 0.05.
Results
Memory performance
Memory performance measures showed a semantic congruency effect on associative memory (t(22) = 4.09, p < 0.001), with both measures different from chance level [congruent items: t(22) = 8.16, p < 0.001 (mean = 0.51; SD = 0.11), incongruent items: t(22) = 5.30, p < 0.001 (mean = 0.43; SD = 0.09)]. Also, item recognition memory for the visually presented motifs showed a congruency effect (t(22) = 2.13, p < 0.05), and were different from chance [congruent items: t(22) = 9.97, p < 0.001 (mean = 0.80; SD = 0.38), incongruent items: t(22) = 9.32; p < 0.001 (mean = 0.71; SD = 0.36)]. Reaction times during both item recognition and associative memory were not different in either of these bins (t(22) = 0.52, p > 0.05, n.s.; t(22) = 1.67, p > 0.05, n.s.).
Neuroimaging results: differential activity
When analyzing fMRI data related to successful recognition memory differing in terms of correct associative retrieval (associative hits vs associative misses) we revealed a set of brain regions encompassing bilateral hippocampus (peaks [−32, −10, −12] and [22, −22, −10]; SVC corrected) (Fig. 2), areas in the dorsal and ventral visual streams, inferior parietal sulci, dorsolateral and ventrolateral prefrontal cortices, and basal ganglia (cluster-level corrected) (Fig. 2). When performing a congruency × associative memory ANOVA, testing activity differences for congruent > incongruent and associatively remembered > associatively forgotten, an interaction in the mPFC, extending from anterior cingulate cortex [Brodmann's area (BA) 32] into BA 10 was found. This interaction was based on larger differential responses for congruent as opposed to incongruent trials (peak = [−6, 34, 12]; cluster-level corrected) (Fig. 3). Another cluster of interacting voxels was found within the left hemispheric region activated by the somatosensory localizer scan (peak [−50, −20, 32]; cluster-level corrected) (Fig. 3). This cluster was located within a sphere with 6 mm radius surrounding an area in the somatosensory cortex previously found to be related to sensory sensation in the thumb [−52, −19, 42] (Weibull et al., 2008). No significant effects were observed for the opposite contrast.
Neuroimaging results: differential connectivity
To assess connectivity differences, we performed PPI analyses on the mPFC cluster found in the congruency × subsequent associative memory interaction for congruent versus incongruent associative hits. This seed region revealed significant coactivation with the left somatosensory cortex (peak [−56, −16, 48]; SVC corrected) (Fig. 3), which was stronger for congruent associative hits than incongruent associative hits. Again, this cluster was within a sphere with 6 mm radius surrounding the areas in the somatosensory cortex related to sensory sensation in the thumb (Weibull et al., 2008). No significant effects were observed for the opposite contrast.
Brain–behavior relation
We next tested whether across participants this congruency effect on mPFC connectivity predicted the behavioral benefit in terms of memory performance. Here, we found that the PPI between the mPFC and the left somatosensory cortex for the congruent versus the incongruent associatively remembered items predicted the congruency benefit of associatively remembered items (congruent/incongruent) (r(22) = 0.531; p < 0.01) (Fig. 3).
Discussion
The current results show that mPFC activity and connectivity with a specific representational cortical area is enhanced when multisensory learned information is retrieved that is congruent with a general, preexisting mental schema. Additionally, this increase in functional connectivity was found to be positively correlated to the behavioral benefit associated with this preexisting knowledge across participants. These results are in line with a model in which the mPFC is involved in readily assimilating new information into preexisting schemata during memory formation and consolidation (van Kesteren et al., 2010; Wang and Morris, 2010).
Behaviorally, our results show enhanced memory for semantically congruent compared to incongruent multisensory associations. This memory-enhancing effect of semantic congruency has previously been identified (Yuval-Greenberg and Deouell, 2009), but its underlying neural mechanisms were largely unknown. This effect has previously been suggested to be related to working memory mechanisms (Zwaan and Radvansky, 1998), or intertwined encoding and consolidation processes during and immediately after learning (van Kesteren et al., 2010). The present data show congruency effects in the mPFC during retrieval processes. Therefore, along with working memory, encoding, and postlearning consolidation, distinct retrieval processes may be related to this behavioral advantage. Our results can thus be explained by adopting a framework where modulation of both learning and postlearning processes leads to long-term modulation of memory traces, with semantic congruency allowing new information to be faster and better embedded into an existing associative mnemonic network (Tse et al., 2007; van Kesteren et al., 2010; Wang and Morris, 2010).
The congruency effect that we found at the behavioral level was expressed in within-subject activity and connectivity differences in mPFC and left somatosensory cortex, and was additionally related to connectivity differences between these regions across participants. These results confirm that the mPFC plays a key role in retrieving consolidated memories (Frankland and Bontempi, 2006; Takashima et al., 2006; Takehara-Nishiuchi and McNaughton, 2008). Additionally, since semantic congruency reflects the degree to which the newly learned information fits to preexisting knowledge (i.e., schema) (Kim et al., 2008), and given the assumption that such congruent information is more rapidly assimilated than information that does not fit a prior schema (Tse et al., 2007; van Kesteren et al., 2010), our data further support the view that such a fast track in memory consolidation might also be present in humans.
Additionally, our results partly support the hypothesis that the pointer function of the hippocampus, binding distributed memory representations (Marr, 1970; Rasch and Born, 2007), shifts to the mPFC (Frankland and Bontempi, 2006; Takashima et al., 2006). This functional balance is suggested to be facilitated by prior knowledge (van Kesteren et al., 2010). However, this hypothesis predicts a reduction in hippocampal contribution to memory retrieval of congruent stimuli along with an increase in mPFC contribution, which we did not find. One explanation for this null finding related to hippocampal processing and connectivity may be that we scanned memory retrieval processes after only one day/night cycle (on average 20 h later). Although systems consolidation mechanisms have been indicated to be more rapid than previously assumed (Takashima et al., 2006; Diekelmann and Born, 2010), and facilitated by prior knowledge (Tse et al., 2007; van Kesteren et al., 2010), these mechanisms are still very likely to abide in an early phase as observed here. Therefore, retrieving the memory trace still requires hippocampal mediation for both congruent and incongruent associations. Further research will be needed to reveal whether hippocampal activity will decrease in time (Takashima et al., 2006, 2009), or whether the hippocampus remains activated while such associative memories are retrieved (Moscovitch et al., 2006), regardless of the occurrence of a (partial) shift of its pointer function to the mPFC.
Similar to the hippocampus, the function of the mPFC in consolidation is broadly investigated while many questions remain. Along with its putative role in systems consolidation and retrieval (Maguire, 2001; Frankland and Bontempi, 2006; Takashima et al., 2006; Takehara-Nishiuchi and McNaughton, 2008), the mPFC has been indicated as a region involved in a diversity of functions, among which many with a mnemonic nature. The prefrontal cortex in general is believed to be involved in updating, maintenance, and manipulation of memory traces (Buckner and Wheeler, 2001; Fletcher and Henson, 2001), and the mPFC in particular is thought to be related to feeling of knowing (Kikyo et al., 2002), conceptual knowledge integration (Kumaran et al., 2009), perceptual matching (Summerfield and Koechlin, 2008), comprehension (Maguire et al., 1999; Mar, 2004), and remote associative memory (Takashima et al., 2007; Takehara-Nishiuchi and McNaughton, 2008), and is shown to actively replay learning-related neuronal spiking patterns during sleep (Takehara-Nishiuchi and McNaughton, 2008; Peyrache et al., 2009). Furthermore, mPFC lesions lead to specific retrieval impairments for remote, presumably consolidated memories (Takehara-Nishiuchi et al., 2006; Gilboa et al., 2009), and an absence of semantic congruency memory enhancement (Kan et al., 2009). Finally, its connectivity to several other brain regions makes it very well suited to retrieve distributed memory traces (Miyashita, 2004). This accumulating line of evidence clearly shows the critical importance of the (m)PFC in all stages of mnemonic brain functioning.
In contrast with its mnemonic function, more dorsal parts of the mPFC have also been suggested to be involved in rather general control mechanisms such as error monitoring and effort related to task difficulty (Ridderinkhof et al., 2004). However, since enhanced memory performance in our study is positively related to larger mPFC activity, it is unlikely that the mPFC activity observed during remote memory retrieval in this and previous studies (Takashima et al., 2006, 2007) is related to such general control function of the mPFC. In sum, our findings extend current literature on the mnemonic function of the mPFC by showing its congruency-dependent involvement in remote memory retrieval, and support the view that the mPFC offers a fast track into consolidated memories if newly stored information fits preexisting schemata (Frankland and Bontempi, 2006; van Kesteren et al., 2010).
The presence of prior knowledge is widely known to enhance memory of new information that fits this knowledge (Bransford and Johnson, 1972), but hitherto one could only speculate on the actualization of this memory enhancement. Our data elucidate some of the underlying neural mechanisms of this process. How a prior associative schema enhances memory formation, however, remains to be determined. A plausible hypothesis is that two different learning systems (focused/fast learning vs interleaved/slow learning) are present in the brain, as proposed by McClelland et al. (1995). We suggest, based on this theory and our data, that when new information is inconsistent with prior knowledge, more interleaved learning is necessary to assimilate this information in preexisting memory networks. In turn, consistent information needs less interleaved learning to be adequately integrated, speeding up assimilation and concurrent mPFC involvement. In this view, the presence of prior knowledge can modulate the processing speed of consistent incoming information due to less necessity to interleave it with inconsistent prior memory networks.
Learning of multisensory perceived stimuli, as applied here, is a relatively underinvestigated area of learning and memory (Shams and Seitz, 2008). Here, by modulating congruency, multisensory learning proved a very efficient tool to investigate mnemonic mechanisms at retrieval, but might accordingly also be used to investigate encoding and consolidation mechanisms. In particular, since associative sensory features of a learned stimulus are found to reactivate sensory areas at retrieval (Harris et al., 2001), even when only one sensory modality is cued (Nyberg et al., 2000; von Kriegstein and Giraud, 2006), these reactivations can reliably probe binding of modality-specific distributed brain regions while retrieving relevant information, either hippocampally (Staresina et al., 2009; Takashima et al., 2009) or neocortically mediated (as reported here). Furthermore, the assimilation of multisensory perceived stimuli into one coherent whole (Amedi et al., 2005; Driver and Noesselt, 2008), can be more thoroughly investigated when considering long-term consequences of these assimilative mechanisms (Shams and Seitz, 2008), and the mediating effect of (semantic) congruency (Kim et al., 2008; Yuval-Greenberg and Deouell, 2009). Finally, since training can modify congruency judgments (Ernst, 2007), sometimes even modulated by other modalities (Fredembach et al., 2009), these findings can be very helpful when designing educational programs where multisensory learning is an integral part of the curriculum (Lasry and Aulls, 2007) [e.g., in medical education (Patel et al., 2009)].
These results provide support for the view that the mPFC is crucially involved in retrieval of consolidated associative memories, and the role of prior knowledge in these mechanisms. By modulating prior knowledge, this paradigm shows that we can gain more insight into how new information is assimilated in preexisting knowledge networks. This insight is of crucial importance to advance mnemonic research to memory formation, consolidation, and retrieval. Furthermore, the memory-enhancing effect related to the facilitatory nature of prior knowledge is of great importance to educational strategies. If educators understand more about the mechanisms underlying this facilitation, educational programs can be better structured, leading to more efficient learning in classroom settings (Bransford et al., 2000).
Footnotes
We thank Vincent Schoots for graphical assistance.
- Correspondence should be addressed to Marlieke T. R. van Kesteren, Donders Institute for Brain, Cognition, and Behaviour, Centre for Cognitive Neuroimaging, P.O. Box 9101, 6500 HB Nijmegen, The Netherlands. marlieke.vankesteren{at}donders.ru.nl