Skip to main content
SpringerLink
Log in

Agents of the mind

  • Published:
Biological Cybernetics Aims and scope Submit manuscript

Abstract

The higher order circuitry of the brain is comprised of a large-scale network of cerebral cortical areas that are individually regulated by loops through subcortical structures, particularly through the basal ganglia and cerebellum. These subcortical loops have powerful computational architectures. Using, as an example, the relatively well-understood processing that occurs in the cortical/basal ganglionic/cerebellar distributed processing module that generates voluntary motor commands, I postulate that a network of analogous agents is an appropriate framework for exploring the dynamics of the mind.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • JS Albus (1981) Brains, behavior and robotics Byte Books Petersborough NH

    Google Scholar 

  • NC Andreasen (1999) ArticleTitleA unitary model of schizophrenia: bleuler’s “fragmented phrene” as schizencephaly Arch Gen Psychiatry 56 781–787 Occurrence Handle10.1001/archpsyc.56.9.781 Occurrence Handle1:STN:280:DC%2BD3szlt1ajtQ%3D%3D Occurrence Handle12884883

    Article  CAS  PubMed  Google Scholar 

  • R Axelrod (1997) Advancing the art of simulation in the social sciences R Conte R Hegselmann P Terna (Eds) Simulating Social Phenomena Springer Berlin Heidelberg New York 21–40

    Google Scholar 

  • AG Barto (1995) Adaptive critics and the basal ganglia JC Houk JL Davis DG Beiser (Eds) Models of Information Processing in the Basal Ganglia MIT Press Cambridge 215–232

    Google Scholar 

  • AG Barto AH Fagg N Sitkoff JC Houk (1999) ArticleTitleA cerebellar model of timing and prediction in the control of reaching Neural Comput 11 565–594 Occurrence Handle10.1162/089976699300016575 Occurrence Handle1:STN:280:DyaK1M7oslChug%3D%3D Occurrence Handle10085421

    Article  CAS  PubMed  Google Scholar 

  • DG Beiser JC Houk (1998) ArticleTitleModel of cortical-basal ganglionic processing: encoding the serial order of sensory events J Neurophysiol 79 3168–3188 Occurrence Handle1:STN:280:DyaK1czgtFGiug%3D%3D Occurrence Handle9636117

    CAS  PubMed  Google Scholar 

  • R Benecke JC Rothwell JPR Dick DL Day CD Marsden (1987) ArticleTitleDisturbance of sequential movements in patients with Parkinson’s disease Brain 110 361–379 Occurrence Handle3567527

    PubMed  Google Scholar 

  • MT Berlim BS Mattevi P Belmonte-de-Abreu TJ Crow (2003) ArticleTitleThe etiology of schzophrenia and the origin of language: Overrview of a theory Compr Psychiatry 44 7–14 Occurrence Handle10.1053/comp.2003.50003 Occurrence Handle12524630

    Article  PubMed  Google Scholar 

  • TVP Bliss GL Collingridge (1993) ArticleTitleA synaptic model of memory: long-term potentiation in the hippocampus Nature 361 31–39

    Google Scholar 

  • P Brodal JG Bjaalie (1997) Salient anatomic features of the cortico-ponto-cerebellar pathway CID Zeeuw P Strata J Voogd (Eds) Progress in Brain Research Elsevier Amsterdam 227–249

    Google Scholar 

  • S Charpier JM Deniau (1997) ArticleTitleIn vivo activity-dependent plasticity at cortico-striatal connections: evidence for physiological long-term potentiation Proc Natl Acad Sci 94 7036–7040 Occurrence Handle10.1073/pnas.94.13.7036 Occurrence Handle1:CAS:528:DyaK2sXktF2qsL0%3D Occurrence Handle9192687

    Article  CAS  PubMed  Google Scholar 

  • F Crick C Koch (2003) ArticleTitleA framework for conciousness Nat Neurosci 6 119–126 Occurrence Handle10.1038/nn0203-119 Occurrence Handle1:CAS:528:DC%2BD3sXmsFGgtg%3D%3D Occurrence Handle12555104

    Article  CAS  PubMed  Google Scholar 

  • A Dagher AM Owen et al. (1999) ArticleTitleMapping the network for planning: a correlational PET activation study with the Tower of London task Brain 122 1973–1987 Occurrence Handle10.1093/brain/122.10.1973 Occurrence Handle10506098

    Article  PubMed  Google Scholar 

  • J Debiec JE LeDoux K Nadler (2002) ArticleTitleCellular and systems reconsolidation in the hippocampus Neuron 36 527–538 Occurrence Handle10.1016/S0896-6273(02)01001-2 Occurrence Handle1:CAS:528:DC%2BD38XosV2htb4%3D Occurrence Handle12408854

    Article  CAS  PubMed  Google Scholar 

  • K Doya (2002) ArticleTitleMetalearning and neuromodulation Neural Networks 15 495–506 Occurrence Handle10.1016/S0893-6080(02)00044-8 Occurrence Handle12371507

    Article  PubMed  Google Scholar 

  • K Doya (1999) ArticleTitleWhat are the computations of the cerebellum, the basal ganglia and the cerebral cortex Neural Netw 12 961–974 Occurrence Handle10.1016/S0893-6080(99)00046-5 Occurrence Handle12662639

    Article  PubMed  Google Scholar 

  • RP Dum PL Strick (2002) ArticleTitleAn unfolded map of the cerebellar dentate nucleus and its projections to the cerebral cortex J. Neurophysiol. 89 634–639

    Google Scholar 

  • JL Elman (2004) ArticleTitleAn alternative view of the mental lexicon Trends Cogn Sci 8 301–306 Occurrence Handle10.1016/j.tics.2004.05.003 Occurrence Handle15242689

    Article  PubMed  Google Scholar 

  • SJ Enna NG Bowery (2004) ArticleTitleGABAb receptor alterations as indicators of physiological and pharmacological function Biochemi Pharmacol 68 1541–1548

    Google Scholar 

  • DJ Felleman DC Essen ParticleVan (1991) ArticleTitleDistributed hierarchical processing in the primate cerebral cortex Cerebral Cortex 1 1–47 Occurrence Handle1:STN:280:By2A2MzlsFQ%3D Occurrence Handle1822724

    CAS  PubMed  Google Scholar 

  • D Fraser S Park G Clark D Yohanna JC Houk (2004) ArticleTitleSpatial serial order processing in schizophrenia Schizophrenia Res 70 203–213 Occurrence Handle10.1016/j.schres.2003.09.019

    Article  Google Scholar 

  • R Freedman S Leonard A Oliney CA Kaufmann D Malaspina CR Cloninger D Svrakic SV Faraone MT Tsuang (2001) ArticleTitleEvidence for the multigenic inheritance of schizophrenia Am J Med Genet (Neuropsychiatric Genetics) 105 794–800 Occurrence Handle10.1002/ajmg.10100 Occurrence Handle1:STN:280:DC%2BD38%2FnsVOhsg%3D%3D

    Article  CAS  Google Scholar 

  • Freeman WJ (2005) Self organizing criticality in scale-free neocortical dyanamics. Biol Cybern (this issue).

  • WJ Freeman (2003) ArticleTitleA neurobiological theory of meaning in perception. Part I: Information and meaning in nonconvergent and nonlocal brain dynamics Int J Bifurcation Chaos 13 2493–2511 Occurrence Handle10.1142/S0218127403008144 Occurrence HandleMR2013111

    Article  MathSciNet  Google Scholar 

  • JM Fuster (2001) ArticleTitleThe Prefrontal cortex – an update: time is of the essence Neruon 30 319–333 Occurrence Handle10.1016/S0896-6273(01)00285-9 Occurrence Handle1:CAS:528:DC%2BD3MXktFeisbk%3D

    Article  CAS  Google Scholar 

  • JM Fuster (1997) The prefrontal cortex and the temporal organization of behavior H Sakata A Mikami JM Fuster (Eds) The association cortex - structure and function Harwood Academic Publishers The Netherlands 15–31

    Google Scholar 

  • S Genet B Delord (2002) ArticleTitleA biophysical model of nonlinear dynamics underlying plateau potentials and calcium spikes in Purkinje cell dendrites J Neurophysiol 88 2430–2444 Occurrence Handle1:CAS:528:DC%2BD38Xptlels7Y%3D Occurrence Handle12424284

    CAS  PubMed  Google Scholar 

  • AR Gibson JC Houk NJ Kohlerman (1985) ArticleTitleMagnocellular red nucleus activity during different types of limb movement in the macaque monkey J Physiol [ Lond] 358 527–549 Occurrence Handle1:STN:280:BiqC28%2FktF0%3D

    CAS  Google Scholar 

  • PS Goldman-Rakic (1988) ArticleTitleTopography of cognition: parallel distributed networks in primate association cortex Ann Rev Neurosci 11 137–156 Occurrence Handle10.1146/annurev.ne.11.030188.001033 Occurrence Handle1:STN:280:BieB3cfislM%3D Occurrence Handle3284439

    Article  CAS  PubMed  Google Scholar 

  • PS Goldman-Rakic S Funahashi CJ Bruce (1990) Neocortical memory circuits. In.: The brain: cold spring harbor symposia on quantitative biology Cold Spring Harbor Laboratory Press New York

    Google Scholar 

  • AM Graybiel (1991) ArticleTitleBasal ganglia – input, neural activity, and relation to the cortex Curr Opin Neurobiol 1 644–651 Occurrence Handle1:CAS:528:DyaK38Xht1Ggtrk%3D Occurrence Handle1822311

    CAS  PubMed  Google Scholar 

  • AJ Gruber SA Solla DJ Surmeier JC Houk (2003) ArticleTitleModulation of striatal single units by expected reward: a spiny neuron model displaying dopamine-induced bistability J Neurophysiol 90 1095–1114 Occurrence Handle12649314

    PubMed  Google Scholar 

  • Gruber AJ, Solla SA, Houk JC (2003) Dopamine induced bistability enhances signal-processing in spiny neurons. NIPS.

  • MD Hauser N Chomsky FW Tecumseh (2002) ArticleTitleThe faculty of language: what it is, who has it, and how did it evolve Science 298 1569–1579

    Google Scholar 

  • RN Holdefer LE Miller LL Chen JC Houk (2000) ArticleTitleFunctional connectivity between cerebellum and primary motor cortex in the awake monkey J Neurophysiol 84 585–590 Occurrence Handle1:STN:280:DC%2BD3cvitFCiuw%3D%3D Occurrence Handle10899231

    CAS  PubMed  Google Scholar 

  • RN Holdefer JC Houk LE Miller (2005) ArticleTitleMovement-related discharge in the cerebellar nuclei persists after local injections of GABAa antagonists J Neurophysiol 93 35–43 Occurrence Handle10.1152/jn.00603.2004 Occurrence Handle1:CAS:528:DC%2BD2MXktlGhsg%3D%3D Occurrence Handle15331620

    Article  CAS  PubMed  Google Scholar 

  • G Holmes (1939) ArticleTitleThe cerebellum of man. (The Hughlings Jackson Memorial Lecture) Brain 62 1–30

    Google Scholar 

  • JE Hoover PL Strick (1999) ArticleTitleThe organization of cerebellar and basal ganglia outputs to Primary motor cortex as revealed by retrograde transneuronal transport of herpes simplex virus type 1 J Neuroscience 19 1446–2463 Occurrence Handle1:CAS:528:DyaK1MXhtFOgs7c%3D

    CAS  Google Scholar 

  • Houk JC, Fraser D, Fishbach A, Roy SA, Simo LS, Bastianen C, Fansler- Wald D, Miller LE, Reber PJ, Botvinick M (2005) Action selection in subcortical loops through basal ganglia. Proceedings of the 1st International Workshop on Modeling Natural Action Selection, Edinburgh, July 2005

  • JC Houk (2001) Neurophysiology of frontal-subcortical loops DG Lichter JL Cummings (Eds) Frontal-subcortical circuits in psychiatry and neurology Guilford Publications New York 92–113

    Google Scholar 

  • JC Houk (1997) ArticleTitleOn the role of the cerebellum and basal ganglia in cognitive signal-processing Prog Brain Res 114 543–552 Occurrence Handle1:STN:280:ByiA3snktV0%3D Occurrence Handle9193165

    CAS  PubMed  Google Scholar 

  • JC Houk JL Adams AG Barto (1995) A model of how the basal ganglia generates and uses neural signals that predict reinforcement JC Houk JL Davis DG Beiser (Eds) Models of information processing in the basal ganglia MIT Press Cambridge 249–274

    Google Scholar 

  • JC Houk AG Barto (1992) Distributed sensorimotor learning GE Stelmach J Requin (Eds) Tutorials in motor behavior II Elsevier Amsterdam 71–100

    Google Scholar 

  • JC Houk J Keifer AG Barto (1993) ArticleTitleDistributed motor commands in the limb premotor network Trends Neurosci 16 27–33 Occurrence Handle10.1016/0166-2236(93)90049-R Occurrence Handle1:STN:280:ByyC2Mfgs1c%3D Occurrence Handle7679234

    Article  CAS  PubMed  Google Scholar 

  • Houk JC, Mugnaini E (2002) Cerebellum. In: Squire LR, Bloom FE Roberts ea JL (eds) Fundamental neuroscience. Academic NewYork

  • JC Houk S Alford (1996) ArticleTitleComputational significance of the cellular mechanisms for synaptic plasticity in Purkinje cells Behav Brain Sci 19 457–461

    Google Scholar 

  • JC Houk SP Wise (1995) ArticleTitleDistributed modular architectures linking basal ganglia, cerebellum, and cerebral cortex: their role in planning and controlling action Cerebral Cortex 5 95–110 Occurrence Handle1:STN:280:ByqA2crmsFM%3D Occurrence Handle7620294

    CAS  PubMed  Google Scholar 

  • SE Hua JC Houk (1997) ArticleTitleCerebellar guidance of premotor network development and sensorimotor learning Learn Mem 4 63–76 Occurrence Handle1:STN:280:DyaK1MzosV2qtA%3D%3D Occurrence Handle10456054

    CAS  PubMed  Google Scholar 

  • M Inase ST Sakai J Tanji (1996) ArticleTitleOverlapping corticostriatal projections from the supplementary motor area and the primary motor cortex in the macaque monkey: an anterograde double labeling study J Comp Neurol 373 283–296 Occurrence Handle10.1002/(SICI)1096-9861(19960916)373:2<283::AID-CNE10>3.0.CO;2-M Occurrence Handle1:STN:280:ByiD2cvosFM%3D Occurrence Handle8889928

    Article  CAS  PubMed  Google Scholar 

  • MC Jiang GF Alheid MG Nunzi JC Houk (2002) ArticleTitleCerebellar input to magnocellular neurons in the red nucleus of the mouse: Synaptic analysis in horizontal brain slices incorporating cerebello-rubal pathways Neuroscience 110 105–121

    Google Scholar 

  • M Ito (2001) ArticleTitleCerebellar long-term depression: Characterization, signal transduction, and functional roles Physiol Rev 81 1143–1195 Occurrence Handle1:CAS:528:DC%2BD3MXlt1Ohsr0%3D Occurrence Handle11427694

    CAS  PubMed  Google Scholar 

  • R Kawagoe Y Takikawa Hikosaka (1998) ArticleTitleExpectation of reward modulates cognitive signals in the basal ganglia Nat Neurosci 1 411–416

    Google Scholar 

  • RM Kelly PL Strick (2003) ArticleTitleMacroarchiteccture of basal ganglia loops with the cerebral cortex: use of rabies virus to reveal mutisynaptic circuits Prog Brain Res 143 441–451

    Google Scholar 

  • Kelly RM, Strick PL (2004) Cerebellar loops with motor cortex and prefrontal cortex of a non-human primate. J Neuroscience.

  • SG Kim K Ugurbil PL Strick (1994) ArticleTitleActivation of a cerebellar output nucleus during cognitive processing Science 265 949–951 Occurrence Handle1:STN:280:ByuA38botVI%3D Occurrence Handle8052851

    CAS  PubMed  Google Scholar 

  • AE Kincaid T Zheng CJ Wilson (1998) ArticleTitleConnectivity and Convergence of single corticostriatal axons J Neuroscience 18 4722–4731 Occurrence Handle1:CAS:528:DyaK1cXjslGjt74%3D

    CAS  Google Scholar 

  • Y Lamarre G Spidalieri (1983) ArticleTitleFast ballistic arm movements triggered by visual, auditory, and somesthetic stimuli in the monkey. I. Activity of percentral cortical neurons J Neurophysiol 50 1343–1358

    Google Scholar 

  • FA Middleton PL Strick (1997) Newconcepts about the organization of basal ganglia output JA Obeso MR DeLong C Ohye CD Marsden (Eds) The basal ganglia and new surgical approaches for parkinson’s disease, advances in neurology Lippincott-Raven Publishers Philadelphia 57–68

    Google Scholar 

  • LE Miller JC Houk (1995) ArticleTitleMotor co-ordinates in primate red nucleus: Preferential relation to muscle activation versus kinematic variables J Physiol Lond 488 533–548 Occurrence Handle1:CAS:528:DyaK2MXptFGnt70%3D Occurrence Handle8568692

    CAS  PubMed  Google Scholar 

  • M Minsky (1986) The Society of mind Simon and Schuster New York

    Google Scholar 

  • M Minsky (1963) Steps toward artificial intelligence EA Feigenbaum J Feldman (Eds) Computers and thought McGraw-Hill NYC

    Google Scholar 

  • SM Nicola DJ Surmeier RC Malenka (2000) ArticleTitleDopminergic modulation of neuronal excitability in the striatum and nucleus accumbens Ann Rev Neurosci 23 185–215 Occurrence Handle10.1146/annurev.neuro.23.1.185 Occurrence Handle1:CAS:528:DC%2BD3cXjs1Gmsr8%3D Occurrence Handle10845063

    Article  CAS  PubMed  Google Scholar 

  • KE Novak LE Miller JC Houk (2002) ArticleTitleThe use of overlapping submovements in the control of rapid hand movements Exp Brain Res 144 351–364 Occurrence Handle10.1007/s00221-002-1060-6 Occurrence Handle1:STN:280:DC%2BD383otVeltQ%3D%3D Occurrence Handle12021817

    Article  CAS  PubMed  Google Scholar 

  • FW Ohl H Scheich WJ Freeman (2001) ArticleTitleChange in pattern of ongoing cortical activity with auditory category learning Nature 412 733–736 Occurrence Handle10.1038/35089076 Occurrence Handle1:STN:280:DC%2BD3Mvmt1GrsA%3D%3D Occurrence Handle11507640

    Article  CAS  PubMed  Google Scholar 

  • MH Perrett HH Harries JJ Mistlin JK Hietanen JJ Benson R Bevan S Thomas MW Oram J Ortega K Brierley (1990) ArticleTitleSocial signals analyzed at the single cell level: someone is looking at me, something touched me, something moved Int J Comp Psychol 4 25–55

    Google Scholar 

  • SE Petersen JA Fiez (1993) ArticleTitleThe processing of single words studied with positron emission tomography Annu Rev Neurosci 16 509–530 Occurrence Handle10.1146/annurev.ne.16.030193.002453 Occurrence Handle1:STN:280:ByyB3MzgslI%3D Occurrence Handle8460901

    Article  CAS  PubMed  Google Scholar 

  • J Requin A Riehle J Seal (1988) ArticleTitleNeuronal activity and information processing in motor control: From stages to continuous flow Biol Psychol 26 179–198 Occurrence Handle10.1016/0301-0511(88)90019-1 Occurrence Handle1:STN:280:BiaD1cfjtFM%3D Occurrence Handle3061479

    Article  CAS  PubMed  Google Scholar 

  • RL Riolo MD Cohen R Axelrod (2001) ArticleTitleEvolution of cooperation without reciprocity Nature 414 441–443

    Google Scholar 

  • K Sakai O Hikosaka R Takino S Miyauchi M Nielsen T Tamada (2000) ArticleTitleWhat and When: Paralled and convergent processing in motor control J Neurosci 20 2691–2700

    Google Scholar 

  • JD Schmahmann DN Pandya (1997) ArticleTitleAnatomic organization of the basilar pontine projections from prefrontal cortices in rhesus monkey J Neurosci 17 438–458

    Google Scholar 

  • W Schultz (1998) ArticleTitlePredictive reward signal of dopamine neurons J Neurophysiol 80 1–27 Occurrence Handle1:CAS:528:DyaK1cXltFWisbY%3D Occurrence Handle9658025

    CAS  PubMed  Google Scholar 

  • W Schultz R Romo T Ljungberg J Mirenowicz JR Hollerman A Dickinson (1995) Reward-related signals carried by dopamine neurons JC Houk JL Davis DG Beiser (Eds) Models of Information Processing in the Basal Ganglia MIT Press Cambridge 233–248

    Google Scholar 

  • AK Seth JL McKinstry GM Edelman JL Krichmar (2004) ArticleTitleVisual binding through reentrant connectivity and dynamic synchronization in a brain-based device Cerebral Cortex 14 1185–99 Occurrence Handle10.1093/cercor/bhh079 Occurrence Handle15142952

    Article  PubMed  Google Scholar 

  • PL Strick RP Dum N Picard (1995) Macro-organization of the circuits connecting the basal ganglia with the cortical motor areas JC Houk JL Davis DG Beiser (Eds) Models of Information Processing in the Basal Ganglia MIT Press Cambridge 117–130

    Google Scholar 

  • J Tanji (2001) ArticleTitleSequential organization of multiple movements: involvement of cortical motor areas Ann Rev Neurosci 24 631–651 Occurrence Handle10.1146/annurev.neuro.24.1.631 Occurrence Handle1:CAS:528:DC%2BD3MXls1Shs7Y%3D Occurrence Handle11520914

    Article  CAS  PubMed  Google Scholar 

  • JM Tepper T Koos CJ Wilson (2004) ArticleTitleGABAergic microcircuits in the neostriatum Trends Neurosci 27 662–669 Occurrence Handle10.1016/j.tins.2004.08.007 Occurrence Handle1:CAS:528:DC%2BD2cXotlajsb8%3D Occurrence Handle15474166

    Article  CAS  PubMed  Google Scholar 

  • T Tyrrell D Willshaw (1992) ArticleTitleCerebellar cortex: its simulation and the relevance of Marr’s theory Phil Trans Royal Soc Lond B 336 239–257 Occurrence Handle1:STN:280:By2A2c3ms10%3D

    CAS  Google Scholar 

  • T Wichmann H Bergman PA Starr T Subramanian RL Watts MR DeLong (1999) ArticleTitleComparison of MPTP-induced changes in spontaneous neuronal discharge in the internal pallidal segment and in the substantia nigra pars reticulata in primates Exp Brain Res 125 397–409 Occurrence Handle10.1007/s002210050696 Occurrence Handle1:CAS:528:DyaK1MXitVCksL8%3D Occurrence Handle10323285

    Article  CAS  PubMed  Google Scholar 

  • U Wilensky K Reisman (1998) Learning biology through constructing and testing computational theories – an embodied modeling approach Y Bar-Yam (Eds) Proceedings of the second international conference on complex systems New England Complex Systems Institute Nashua

    Google Scholar 

  • CJ Wilson (1990) Basal Ganglia In: The synaptic organization of the brain Oxford University Press NY 279–316

    Google Scholar 

  • EH Yeterian GW Hoesen ParticleVan (1978) ArticleTitleCortico-striate projections in the rhesus monkey: the organization of certain cortico-caudate connections Brain Res 139 43–63 Occurrence Handle10.1016/0006-8993(78)90059-8 Occurrence Handle1:STN:280:CSeD1c7os1M%3D Occurrence Handle413609

    Article  CAS  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Feinberg School of Medicine, Northwestern University, 303 E. Chicago Ave., M211, Chicago, IL, 60611, USA

    James C. Houk

Authors
  1. James C. Houk
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to James C. Houk.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Houk, J. Agents of the mind. Biol Cybern 92, 427–437 (2005). https://doi.org/10.1007/s00422-005-0569-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00422-005-0569-8

Keywords

Search

Navigation