Skip to main content

Main menu

  • HOME
  • CONTENT
    • Early Release
    • Featured
    • Current Issue
    • Issue Archive
    • Collections
    • Podcast
  • ALERTS
  • FOR AUTHORS
    • Information for Authors
    • Fees
    • Journal Clubs
    • eLetters
    • Submit
    • Special Collections
  • EDITORIAL BOARD
    • Editorial Board
    • ECR Advisory Board
    • Journal Staff
  • ABOUT
    • Overview
    • Advertise
    • For the Media
    • Rights and Permissions
    • Privacy Policy
    • Feedback
    • Accessibility
  • SUBSCRIBE

User menu

  • Log out
  • Log in
  • My Cart

Search

  • Advanced search
Journal of Neuroscience
  • Log out
  • Log in
  • My Cart
Journal of Neuroscience

Advanced Search

Submit a Manuscript
  • HOME
  • CONTENT
    • Early Release
    • Featured
    • Current Issue
    • Issue Archive
    • Collections
    • Podcast
  • ALERTS
  • FOR AUTHORS
    • Information for Authors
    • Fees
    • Journal Clubs
    • eLetters
    • Submit
    • Special Collections
  • EDITORIAL BOARD
    • Editorial Board
    • ECR Advisory Board
    • Journal Staff
  • ABOUT
    • Overview
    • Advertise
    • For the Media
    • Rights and Permissions
    • Privacy Policy
    • Feedback
    • Accessibility
  • SUBSCRIBE
PreviousNext
Journal Club

Dissociating Hippocampal and Cortical Contributions to Predictive Processing

Anna Mynick and Adam Steel
Journal of Neuroscience 11 January 2023, 43 (2) 184-186; https://doi.org/10.1523/JNEUROSCI.1840-22.2022
Anna Mynick
Department of Psychological and Brain Sciences, Dartmouth College, Hanover, New Hampshire 03755
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Adam Steel
Department of Psychological and Brain Sciences, Dartmouth College, Hanover, New Hampshire 03755
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Info & Metrics
  • eLetters
  • PDF
Loading

Playing an unfamiliar sport initially feels chaotic and reactive. But as it becomes familiar, players learn to anticipate each other's movements and the game falls into neat order. The ability to predict upcoming visual information based on past experience underlies many of the complex behaviors humans can perform: predictive processing biases our perception of ambiguous stimuli toward probable interpretations (Hansen et al., 2006) and quickens stimulus detection (Stokes et al., 2012; Cravo et al., 2017). One central question in neuroscience is how the brain instantiates memory-based predictions when faced with complex visual input.

One framework for considering the neural basis for memory-based predictions is predictive coding, which proposes that memory-related brain areas exert top-down influence on lower-level sensory areas to bias sensory processing toward probable stimuli (Lee and Mumford, 2003; Albright, 2012; Bastos et al., 2012). Recent work using fMRI and electrophysiology support this view. Early visual cortex represents the typical color of an object (i.e., banana as yellow) even when it is presented in grayscale (Bannert and Bartels, 2013), and neurons in macaque MT represent learned motion associated with static shapes (Schlack and Albright, 2007). Meanwhile, predictions made from learned co-occurrence of stimuli recruit the hippocampus. For instance, one study showed that after participants learned to associate a visual stimulus with a specific sound, the hippocampus represented the predicted visual stimulus in response to its associated auditory cue (Kok and Turk-Browne, 2018). In related work, after participants learned to associate pairs of abstract fractals, the hippocampus represented the action–outcome association (i.e., stimulus A + action X yields stimulus B), while visual cortex represented the identity of the upcoming stimulus predicted from the learned association (Hindy et al., 2016).

Two important questions emerge from this work. First, although the literature above and other work (Kok et al., 2020; Aitken and Kok, 2022) show that the brain uses learned associations to predict upcoming stimuli (i.e., first-order associations), many phenomena unfold over a sequence of events. Do predictive processes in the visual system operate over longer sequences of stimuli (i.e., secondary and higher-order associations)? Second, past work suggests that hippocampus and visual cortex contain representations of upcoming visual stimuli, but the relationship between these representations is not clear. Do these predictions come about concurrently, or is the prediction in visual cortex dependent on the hippocampal representation?

In a recent article in The Journal of Neuroscience, Clarke et al. (2022) address how predictions occur in the brain during perception of complex stimulus sequences. Participants learned the layouts of two “zoos” that contained the same set of animal images. Animals appeared one at a time in a sequence, and participants advanced through the sequence by indicating a direction (up/down/left/right) based on the learned layout of the current zoo. The zoos had identical sequence relationships between neighboring animals but moving through the same sequence required different actions. For example, both zoos contained the sequence: “horse-rabbit-tiger,” but moving from a horse to a rabbit required an “up” response in one zoo and “left” in the other. In the fMRI scanner, participants saw a cue depicting a starting animal and a goal animal, and indicated the action sequence required to move between them. Critically, one-quarter of the trials were “catch” trials, which ended before participants reached the goal animal. This enabled the authors to isolate neural activity produced during stimulus prediction from neural activity produced during stimulus perception, because catch trials displayed no visual content after ending early.

Clarke et al. (2022) focused their analyses on regions likely to represent the current stimulus [including primary visual cortex (V1)/secondary visual cortex (V2)], as well as regions that would likely harbor predictive representations of upcoming stimuli (i.e., hippocampus and posterior medial cortical network). Multivoxel pattern similarity analysis (i.e., the correlation in the pattern of activation across voxels within a region of interest; Haxby et al., 2001) was used to identify representations of stimuli at the item (single animal), sequence (ordered set of animals), and prediction (upcoming single animal) level.

What brain regions contained predictive representations? Clarke et al. (2022) reasoned that predictions would occur in the same regions that represent the current stimulus (i.e., item-level representation). Using pattern similarity analysis, they found that V1/V2, posterior medial cortex, and posterior hippocampus represented the current stimulus. Next, using data from the catch trials, the authors asked whether the same regions represented the upcoming, predicted stimulus by looking for a representation of the stimulus that should have appeared next in the sequence (but was omitted). Interestingly, V1/V2 and posteromedial cortex (PMC) represented the predicted (but omitted) stimulus, but posterior hippocampus did not. The finding that V1/V2 and PMC represented the predicted stimulus aligned with the authors' expectations, since these regions also contained item-level representations. However, the absence of prediction in posterior hippocampus was somewhat surprising given that it contained item-level representations and previous reports suggested that hippocampus represented predicted visual stimuli (Kok and Turk-Browne, 2018; Kok et al., 2020).

What might explain the failure to detect a representation of the predicted stimulus in the posterior hippocampus? Past studies investigating prediction have used first-order associations between pairs of stimuli, and stimuli only occurred within their specific pair. In contrast, Clarke et al. (2022) used two contexts (i.e., zoos), which encouraged an abstract representation of the sequence regardless of context. Indeed, Clarke et al. (2022) found that rather than representing the predicted stimulus, the posterior hippocampus represented the current sequence, regardless of zoo. This suggests that posterior hippocampus represents high-level information about the overarching event structure, rather than predictions, per se.

Discovering a distinction between the representation of the sequence and that of the predicted stimulus led to a second question: do stimulus predictions in cortical regions arise from hippocampal sequence representations? Clarke et al. (2022) reasoned that the sequence representation in posterior hippocampus could provide the context needed for lower-level regions to represent individual predicted stimuli. To test this hypothesis, the authors used a representational connectivity analysis to investigate the temporal relationship between the sequence and predictive representations. Specifically, they compared the strength of the sequence representation in posterior hippocampus at a key decision point before a stimulus was omitted with the strength of the representation of the omitted (predicted) stimulus in V1/V2 and PMC. Consistent with their hypothesis, the strength of the sequence representation in posterior hippocampus was correlated with the strength of subsequent prediction representations in V1/V2 and PMC. This result suggests that cortical predictions may depend on contextual representation in hippocampus.

Together, the findings of Clarke et al. (2022) significantly extend our understanding of how predictive representations are instantiated in the brain and demonstrate a clear distinction between the contribution of hippocampus and cortex to predictive processing. Specifically, in complex environments, hippocampus represents the context for the prediction, while cortex represents the prediction, per se. Moreover, the authors' representational connectivity analysis suggests a systems-level mechanism for predictive coding in the brain, whereby the representation of context in the hippocampus drives prediction representation in cortex.

Translating the predictive mechanism proposed by Clarke et al. (2022) to real-world contexts raises several intriguing questions. Notably, we experience the visual world as a relatively continuous stream of information during wakefulness. Given this continuity, what time window does hippocampus integrate over to represent event sequences? One possibility is that a sequence representation integrates over an extended time frame by strategically sampling past information (Shankar and Howard, 2013). The hippocampus might also integrate over many timescales simultaneously. Although Clarke et al. (2022) find sequence representation only in posterior hippocampus, recent evidence suggests that hippocampus could represent information at multiple timescales, organized from short-to-long timescales along the posterior-to-anterior hippocampal axis (Brunec and Momennejad, 2022). Future work could use sequences of stimuli with variable relevant time windows to explore the interaction between sequence representation and prediction.

A second open question concerns how sequence representations are transformed into prediction representations. During perception, information is transmitted through the visual hierarchy from V1 to the hippocampus via the ventral stream (Tanaka, 1996). Does generating a prediction representation from memory engage the whole visual system, or are predictions instantiated directly in V1 from hippocampus? Several recent studies suggest that intermediate regions could be involved. For example, activity propagates backward through the visual hierarchy during explicit memory recall (Favila et al., 2019; Breedlove et al., 2020; Dijkstra et al., 2020). In addition, recent evidence using immersive scenes has shown that scene-selective visual areas not only represent the current field of view, but also memory of the broader visuospatial context (Robertson et al., 2016; Berens et al., 2021). For example, the retrosplenial complex (Maguire et al., 1998; Bar and Aminoff, 2003) and occipital place area (Malach et al., 2002; Dilks et al., 2013) represent two scene views more similarly when the viewer knows their overlapping spatial context (Robertson et al., 2016). These results suggest that these areas play a role in integrating perceptual and mnemonic information, but whether these regions are involved in predictive processing is not clear. Ultimately, it will be important to consider the role of intermediate and high-level visual areas—in addition to hippocampus and early visual cortex—to understand how memory-based predictions are instantiated in the brain (Steel et al., 2021).

In conclusion, Clarke et al. (2022) significantly enhances our understanding of both the content of predictive representations during goal-oriented behavior and the temporal dynamics of those representations. Future studies should continue to investigate the neural mechanisms underpinning predictive processing and should work to elucidate what information is contained in prediction representations in cortex and how they are distinct from sequence representations in the hippocampus. Addressing these points will improve our understanding of how memory-based predictions support efficient perception as we move through complex, real-world events.

Footnotes

  • Editor's Note: These short reviews of recent JNeurosci articles, written exclusively by students or postdoctoral fellows, summarize the important findings of the paper and provide additional insight and commentary. If the authors of the highlighted article have written a response to the Journal Club, the response can be found by viewing the Journal Club at www.jneurosci.org. For more information on the format, review process, and purpose of Journal Club articles, please see http://jneurosci.org/content/jneurosci-journal-club.

  • A.S. is funded by the Neukom Center for Computational Science.

  • The authors declare no competing financial interests.

  • Correspondence should be addressed to Adam Steel at adam.steel{at}dartmouth.edu

SfN exclusive license.

References

  1. ↵
    1. Aitken F,
    2. Kok P
    (2022) Hippocampal representations switch from errors to predictions during acquisition of predictive associations. Nat Commun 13:3294. doi:10.1038/s41467-022-31040-w
    OpenUrlCrossRef
  2. ↵
    1. Albright TD
    (2012) On the perception of probable things: neural substrates of associative memory, imagery, and perception. Neuron 74:227–245. doi:10.1016/j.neuron.2012.04.001 pmid:22542178
    OpenUrlCrossRefPubMed
  3. ↵
    1. Bannert MM,
    2. Bartels A
    (2013) Decoding the yellow of a gray banana. Curr Biol 23:2268–2272. doi:10.1016/j.cub.2013.09.016 pmid:24184103
    OpenUrlCrossRefPubMed
  4. ↵
    1. Bar M,
    2. Aminoff E
    (2003) Cortical analysis of visual context. Neuron 38:347–358. doi:10.1016/S0896-6273(03)00167-3 pmid:12718867
    OpenUrlCrossRefPubMed
  5. ↵
    1. Bastos AM,
    2. Usrey WM,
    3. Adams RA,
    4. Mangun GR,
    5. Fries P,
    6. Friston KJ
    (2012) Canonical microcircuits for predictive coding. Neuron 76:695–711. doi:10.1016/j.neuron.2012.10.038 pmid:23177956
    OpenUrlCrossRefPubMed
  6. ↵
    1. Berens SC,
    2. Joensen BH,
    3. Horner AJ
    (2021) Tracking the emergence of location-based spatial representations in human scene-selective cortex. J Cogn Neurosci 33:445–462. doi:10.1162/jocn_a_01654 pmid:33284080
    OpenUrlCrossRefPubMed
  7. ↵
    1. Breedlove JL,
    2. St-Yves G,
    3. Olman CA,
    4. Naselaris T
    (2020) Generative feedback explains distinct brain activity codes for seen and mental images. Curr Biol 30:2211–2224.e6. doi:10.1016/j.cub.2020.04.014 pmid:32359428
    OpenUrlCrossRefPubMed
  8. ↵
    1. Brunec IK,
    2. Momennejad I
    (2022) Predictive representations in hippocampal and prefrontal hierarchies. J Neurosci 42:299–312. doi:10.1523/JNEUROSCI.1327-21.2021 pmid:34799416
    OpenUrlAbstract/FREE Full Text
  9. ↵
    1. Clarke A,
    2. Crivelli-Decker J,
    3. Ranganath C
    (2022) Contextual expectations shape cortical reinstatement of sensory representations. J Neurosci 42:5956–5965. doi:10.1523/JNEUROSCI.2045-21.2022
    OpenUrlAbstract/FREE Full Text
  10. ↵
    1. Cravo AM,
    2. Rohenkohl G,
    3. Santos KM,
    4. Nobre AC
    (2017) Temporal anticipation based on memory. J Cogn Neurosci 29:2081–2089. doi:10.1162/jocn_a_01172
    OpenUrlCrossRefPubMed
  11. ↵
    1. Dijkstra N,
    2. Ambrogioni L,
    3. Vidaurre D,
    4. van Gerven M
    (2020) Neural dynamics of perceptual inference and its reversal during imagery. Elife 9:e53588. doi:10.7554/eLife.53588
    OpenUrlCrossRef
  12. ↵
    1. Dilks DD,
    2. Julian JB,
    3. Paunov AM,
    4. Kanwisher N
    (2013) The occipital place area is causally and selectively involved in scene perception. J Neurosci 33:1331–1336a. doi:10.1523/JNEUROSCI.4081-12.2013 pmid:23345209
    OpenUrlAbstract/FREE Full Text
  13. ↵
    1. Favila SE,
    2. Kuhl BA,
    3. Winawer J
    (2019) Perception and memory have distinct spatial tuning properties in human visual cortex. Neuroscience. Advance online publication. Retrieved November 25, 2022. doi:https://doi.org/10.1101/811331. doi:10.1101/811331
    OpenUrlCrossRef
  14. ↵
    1. Hansen T,
    2. Olkkonen M,
    3. Walter S,
    4. Gegenfurtner KR
    (2006) Memory modulates color appearance. Nat Neurosci 9:1367–1368. doi:10.1038/nn1794 pmid:17041591
    OpenUrlCrossRefPubMed
  15. ↵
    1. Haxby JV,
    2. Gobbini MI,
    3. Furey ML,
    4. Ishai A,
    5. Schouten JL,
    6. Pietrini P
    (2001) Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science 293:2425–2430. doi:10.1126/science.1063736 pmid:11577229
    OpenUrlAbstract/FREE Full Text
  16. ↵
    1. Hindy NC,
    2. Ng FY,
    3. Turk-Browne NB
    (2016) Linking pattern completion in the hippocampus to predictive coding in visual cortex. Nat Neurosci 19:665–667. doi:10.1038/nn.4284 pmid:27065363
    OpenUrlCrossRefPubMed
  17. ↵
    1. Kok P,
    2. Turk-Browne NB
    (2018) Associative prediction of visual shape in the hippocampus. J Neurosci 38:6888–6899. doi:10.1523/JNEUROSCI.0163-18.2018 pmid:29986875
    OpenUrlAbstract/FREE Full Text
  18. ↵
    1. Kok P,
    2. Rait LI,
    3. Turk-Browne NB
    (2020) Content-based dissociation of hippocampal involvement in prediction. J Cogn Neurosci 32:527–545. doi:10.1162/jocn_a_01509 pmid:31820676
    OpenUrlCrossRefPubMed
  19. ↵
    1. Lee TS,
    2. Mumford D
    (2003) Hierarchical Bayesian inference in the visual cortex. J Opt Soc Am A Opt Image Sci Vis 20:1434–1448. doi:10.1364/josaa.20.001434 pmid:12868647
    OpenUrlCrossRefPubMed
  20. ↵
    1. Maguire EA,
    2. Burgess N,
    3. Donnett JG,
    4. Frackowiak RSJ,
    5. Frith CD,
    6. O'Keefe J
    (1998) Knowing where and getting there: a human navigation network. Science 280:921–924. doi:10.1126/science.280.5365.921 pmid:9572740
    OpenUrlAbstract/FREE Full Text
  21. ↵
    1. Malach R,
    2. Levy I,
    3. Hasson U
    (2002) The topography of high-order human object areas. Trends Cogn Sci 6:176–184. doi:10.1016/S1364-6613(02)01870-3 pmid:11912041
    OpenUrlCrossRefPubMed
  22. ↵
    1. Robertson CE,
    2. Hermann KL,
    3. Mynick A,
    4. Kravitz DJ,
    5. Kanwisher N
    (2016) Neural representations integrate the current field of view with the remembered 360° panorama in scene-selective cortex. Curr Biol 26:2463–2468. doi:10.1016/j.cub.2016.07.002 pmid:27618266
    OpenUrlCrossRefPubMed
  23. ↵
    1. Schlack A,
    2. Albright TD
    (2007) Remembering visual motion: neural correlates of associative plasticity and motion recall in cortical area MT. Neuron 53:881–890. doi:10.1016/j.neuron.2007.02.028 pmid:17359922
    OpenUrlCrossRefPubMed
  24. ↵
    1. Shankar KH,
    2. Howard MW
    (2013) Optimally fuzzy temporal memory. arXiv:1211.5189. doi:https://doi.org/10.48550/arXiv.1211.5189. doi:10.48550/arXiv.1211.5189
    OpenUrlCrossRef
  25. ↵
    1. Steel A,
    2. Billings MM,
    3. Silson EH,
    4. Robertson CE
    (2021) A network linking scene perception and spatial memory systems in posterior cerebral cortex. Nat Commun 12:2632. doi:10.1038/s41467-021-22848-z pmid:33976141
    OpenUrlCrossRefPubMed
  26. ↵
    1. Stokes MG,
    2. Atherton K,
    3. Patai EZ,
    4. Nobre AC
    (2012) Long-term memory prepares neural activity for perception. Proc Natl Acad Sci U|S|A 109:E360–E367. doi:10.1073/pnas.1108555108
    OpenUrlAbstract/FREE Full Text
  27. ↵
    1. Tanaka K
    (1996) Inferotemporal cortex and object vision. Annu Rev Neurosci 19:109–139. doi:10.1146/annurev.ne.19.030196.000545
    OpenUrlCrossRefPubMed
Back to top

In this issue

The Journal of Neuroscience: 43 (2)
Journal of Neuroscience
Vol. 43, Issue 2
11 Jan 2023
  • Table of Contents
  • Table of Contents (PDF)
  • About the Cover
  • Index by author
  • Masthead (PDF)
Email

Thank you for sharing this Journal of Neuroscience article.

NOTE: We request your email address only to inform the recipient that it was you who recommended this article, and that it is not junk mail. We do not retain these email addresses.

Enter multiple addresses on separate lines or separate them with commas.
Dissociating Hippocampal and Cortical Contributions to Predictive Processing
(Your Name) has forwarded a page to you from Journal of Neuroscience
(Your Name) thought you would be interested in this article in Journal of Neuroscience.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Print
View Full Page PDF
Citation Tools
Dissociating Hippocampal and Cortical Contributions to Predictive Processing
Anna Mynick, Adam Steel
Journal of Neuroscience 11 January 2023, 43 (2) 184-186; DOI: 10.1523/JNEUROSCI.1840-22.2022

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Respond to this article
Request Permissions
Share
Dissociating Hippocampal and Cortical Contributions to Predictive Processing
Anna Mynick, Adam Steel
Journal of Neuroscience 11 January 2023, 43 (2) 184-186; DOI: 10.1523/JNEUROSCI.1840-22.2022
Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • Footnotes
    • References
  • Info & Metrics
  • eLetters
  • PDF

Responses to this article

Respond to this article

Jump to comment:

No eLetters have been published for this article.

Related Articles

Cited By...

More in this TOC Section

  • Obesity and Gut–Brain Communication: The Cholinergic-Endocannabinoid Link
  • Unraveling Pallido-Retrorubral Circuits Linking the Basal Ganglia to Limbic Areas
  • µ-Opioid Receptor Control of Glutamate/GABA Coreleasing SUM and VTA Projections to the Dentate Gyrus
Show more Journal Club
  • Home
  • Alerts
  • Follow SFN on BlueSky
  • Visit Society for Neuroscience on Facebook
  • Follow Society for Neuroscience on Twitter
  • Follow Society for Neuroscience on LinkedIn
  • Visit Society for Neuroscience on Youtube
  • Follow our RSS feeds

Content

  • Early Release
  • Current Issue
  • Issue Archive
  • Collections

Information

  • For Authors
  • For Advertisers
  • For the Media
  • For Subscribers

About

  • About the Journal
  • Editorial Board
  • Privacy Notice
  • Contact
  • Accessibility
(JNeurosci logo)
(SfN logo)

Copyright © 2025 by the Society for Neuroscience.
JNeurosci Online ISSN: 1529-2401

The ideas and opinions expressed in JNeurosci do not necessarily reflect those of SfN or the JNeurosci Editorial Board. Publication of an advertisement or other product mention in JNeurosci should not be construed as an endorsement of the manufacturer’s claims. SfN does not assume any responsibility for any injury and/or damage to persons or property arising from or related to any use of any material contained in JNeurosci.