Neuronal microcircuits for decision making in C. elegans

https://doi.org/10.1016/j.conb.2012.05.005Get rights and content

The simplicity and genetic tractability of the nervous system of the nematode Caenorhabditis elegans make it an attractive system in which to seek biological mechanisms of decision making. Although work in this area remains at an early stage, four basic types paradigms of behavioral choice, a simple form of decision making, have now been demonstrated in C. elegans. A recent series of pioneering studies, combining genetics and molecular biology with new techniques such as microfluidics and calcium imaging in freely moving animals, has begun to elucidate the neuronal mechanisms underlying behavioral choice. The new research has focussed on choice behaviors in the context of habitat and resource localization, for which the neuronal circuit has been identified. Three main circuit motifs for behavioral choice have been identified. One motif is based mainly on changes in the strength of synaptic connections whereas the other two motifs are based on changes in the basal activity of an interneuron and the sensory neuron to which it is electrically coupled. Peptide signaling seems to play a prominent role in all three motifs, and it may be a general rule that concentrations of various peptides encode the internal states that influence behavioral decisions in C. elegans.

Highlights

► The nematode Caenorhabditis elegans is an attractive system in which to seek biological mechanisms of decision making. ► Four basic paradigms of behavioral choice, a simple form of decision making, have been demonstrated in C. elegans. ► A recent series of pioneering studies has begun to elucidate the neuronal mechanisms of several choice paradigms. ► Peptide signaling seems to play a prominent role in behavioral choice in C. elegans.

Introduction

One of the primary functions of the nervous system is to make decisions that maximize evolutionary fitness in an unpredictable world. Neurobiologists investigate the neuronal mechanisms of decision making at two main levels of complexity. The simpler level, which may be called behavioral choice [1], mainly concerns the proximal causes of selecting between alternative sensory cues or behaviors. A typical experiment at this level seeks to identify the states of the nervous system that predict which of two or more mutually exclusive behaviors will be activated on each trial in a series of identical stimuli. The more complex level, which has been termed value-based decision making [2], examines not only proximal causes, but ultimate causes as well. Here, experimental conditions are arranged so that the subject's prior assessment of the relative benefits of distinct choices can be manipulated experimentally. At the neuronal level, researchers seek to understand how benefits are represented by the nervous system, and how these representations are integrated with the proximal causes of the selection between alternatives. In one simple scenario, the proximal causes of behavioral choice are the neuronal building blocks of value-based decision making. To the extent that this is so, the former serves as an important experimental model for the latter.

Historically, the neuronal analysis of decision making has emphasized humans and nonhuman primates. However, because of the difficulty of accurately manipulating the activity of functionally specific neuronal subpopulations in awake, behaving subjects, it has so far been easier to establish the neuronal correlates of decision making than its neuronal causes. Clearly, progress toward a biological theory of decision making would be accelerated by a complementary approach that studies decision making in organisms that can be genetically engineered (nematode, fruit fly, zebrafish, mouse). Such organisms are unusually amenable to optogenetic methods for activating and inactivating subpopulations of neurons, which is one of the most efficient ways to demonstrate that a particular neuronal event is necessary and sufficient for decision making. For this reason, engineerable organisms are now being used at an increasing rate in studies of decision making [3, 4].

The nematode Caenorhabditis elegans is an attractive system in which to seek biological mechanisms of decision making. Like other members of its genus, it is a so-called fruit nematode, which forages for capricious blooms of bacteria in rotting fruits, flowers, and stems [5]. Its tiny nervous system, with only 302 neurons, has been anatomically reconstructed almost completely at the ultrastructural level, yielding the celebrated ‘wiring diagram of the worm’ [6, 7]. The well-known genetic tractability of C. elegans, together with technical advances in basic nematode neurophysiology  including patch clamp electrophysiology [8], calcium imaging [9], and optical control of neuronal and muscular activity [10, 11, 12]  is accelerating the pace of research into the neuronal basis of behavior in this organism. More recently, opto-mechanical systems have been developed that enable recordings from C. elegans neurons in freely moving animals engaged in natural behaviors [13••, 14, 15, 16•]. Additionally, C. elegans uses many of the same neurotransmitters and neuromodulators as higher organisms, including dopamine and serotonin, which are involved in signaling positive and negative rewards in primate decision making [17, 18]. Thus, C. elegans is well suited for the identification of genetic, synaptic, and network-level causes of action selection that may underlie decision making in more complex organisms.

Section snippets

Behavioral repertoire

The numerical simplicity of the C. elegans nervous system belies a sophisticated behavioral repertoire that continues to expand as researchers probe deeper into the behavioral abilities of this species. Currently, C. elegans behavior can be organized according to three broad functional categories (Table 1). The first is housekeeping behavior, which is concerned primarily with feeding and reproduction. The second category is escape behavior, which comprises short latency (≤1 s) withdrawal

Experimental paradigms of behavioral choice

Behavioral paradigms for investigating the proximal causes of behavioral choice vary widely in complexity. However, the simplest among them can be arranged in a two-by-two matrix (Figure 1a–d) according to the number of sensory stimuli manipulated in the experiment (S1, S2) and the number of mutually exclusive behaviors (B1, B2) that are monitored. All four types of choice behavior have been demonstrated in C. elegans.

One stimulus, one behavior (Figure 1a). This type of experiment is

The logic of behavioral choice

Each behavioral choice paradigm constitutes a distinct switching logic, as indicated by the circuit diagrams in Figure 1. The simplest case is that of the go, no-go behaviors (Figure 1a), in which the presence or absence of the behavior under investigation (B) is dictated by the presence or absence of the stimulus (S) and the internal state of the animal. Internal state regulates the disposition of a simple single-pole/single-throw switch that puts the animal in a permissive or nonpermissive

Behavioral strategies for habitat and resource localization

Each of the three more complex behavioral choice paradigms investigated to date in C. elegans is an instance of habitat and resource localization (Table 1). C. elegans localizes resources utilizing three main behavioral strategies that are common across the animal kingdom [34]: orthokinesis, klinokinesis, and klinotaxis. In orthokinesis, locomotion slows when the animal encounters the habitat or resource, which results in accumulation at the population level, by analogy to a traffic jam.

Klinokinesis

In the laboratory, C. elegans localization behaviors are mainly studied on the surface of an agar-filled plate where locomotory thrust is generated by snake-like undulations. These undulations occur in the dorso-ventral plane because worms crawl on their sides. Locomotion in C. elegans is dominated by periods of relatively straight forward movement, called runs [37, 43], which are punctuated about twice a minute by turning events capable of significantly reorienting the worm. Each event

The neuronal circuit for klinokinesis

The neuronal circuitry that implements C. elegans klinokinesis algorithm has been described in draft form [45, 47, 48•, 49••, 50, 51]. It can be summarized as a cascade of four subcircuits composed of, respectively, sensory neurons and their electrically coupled interneurons, sensory interneurons, premotor interneurons, and motor neurons (Figure 2). Synaptic transmission is likely to be graded for the most part in C. elegans [52•, 53] and thus interactions between subcircuits may have a

The neuronal basis of klinokinesis

The characteristic functions of the four subcircuits involved in klinokinesis provide a model of how klinokinesis occurs at the neuronal level. In the case of localizing a resource, for example, sensory neurons that function as ON cells are activated when the animal is moving up the gradient, whereas sensory neurons that function as OFF cells are activated when the animal is moving down the gradient. Thus, the behaviorally effective conditions are not the presence or absence of stimulation but

Neuronal microcircuits for behavioral choice

A recent series of pioneering studies  unique in using a combination of classical and molecular genetics, microfluidics, and in vivo calcium imaging to investigate decision making in C. elegans  has begun to elucidate the neuronal mechanisms of behavioral choice in this organism [23••, 47, 59••, 66, 67, 68]. Focusing primarily on behavioral competition (Figure 1c), and stimulus and behavioral competition (Figure 1d), these studies provide a set of circuit motifs that may form the basis for models

Generalities and prospects

The investigation of the neuronal basis of decision making in C. elegans is just beginning. Focusing primarily on behavioral choice, researchers have identified three circuit motifs that appear to be sufficient to explain the outcomes of two choice paradigms. One motif (Figure 4a) is based mainly on changes in the strength of functional synaptic connections whereas, the other two motifs (Figure 4b,c) are based on changes in the basal activity of an interneuron and the sensory neuron to which it

References and recommended reading

Papers of particular interest, published within the period of review, have been highlighted as:

  • • of special interest

  • •• of outstanding interest

Acknowledgements

We thank Dr. W.B. Kristan, Jr. for comments on the manuscript. Support: NIH MH51383.

References (87)

  • S.H. Chalasani et al.

    Dissecting a circuit for olfactory behaviour in Caenorhabditis elegans

    Nature

    (2007)
  • J.M. Gray et al.

    A circuit for navigation in Caenorhabditis elegans

    Proc Natl Acad Sci U S A

    (2005)
  • D. Biron et al.

    An olfactory neuron responds stochastically to temperature and modulates Caenorhabditis elegans thermotactic behavior

    Proc Natl Acad Sci U S A

    (2008)
  • S. Faumont et al.

    The awake behaving worm: simultaneous imaging of neuronal activity and behavior in intact animals at millimeter scale

    J Neurophysiol

    (2006)
  • E.Z. Macosko

    A hub-and-spoke circuit drives pheromone attraction and social behavior in C. elegans

    Nature

    (2009)
  • M. de Bono et al.

    Social feeding in Caenorhabditis elegans is induced by neurons that detect aversive stimuli

    Nature

    (2002)
  • C.V. Gabel et al.

    Neural circuits mediate electrosensory behavior in Caenorhabditis elegans

    J Neurosci

    (2007)
  • W.S. Ryu et al.

    Thermotaxis in Caenorhabditis elegans analyzed by measuring responses to defined thermal stimuli

    J Neurosci

    (2002)
  • E.R. Sawin et al.

    C. elegans locomotory rate is modulated by the environment through a dopaminergic pathway and by experience through a serotonergic pathway

    Neuron

    (2000)
  • A. Ward et al.

    Light-sensitive neurons and channels mediate phototaxis in C. elegans

    Nat Neurosci

    (2008)
  • N. Wittenburg et al.

    Thermal avoidance in Caenorhabditis elegans: an approach to the study of nociception

    Proc Natl Acad Sci U S A

    (1999)
  • A. Rangel et al.

    A framework for studying the neurobiology of value-based decision making

    Nat Rev Neurosci

    (2008)
  • M. Leblond et al.

    Motivational state and reward content determine choice behavior under risk in mice

    PLoS ONE

    (2011)
  • J.Y. Cohen et al.

    Neuron-type-specific signals for reward and punishment in the ventral tegmental area

    Nature

    (2012)
  • K.C. Kiontke et al.

    A phylogeny and molecular barcodes for Caenorhabditis, with numerous new species from rotting fruits

    BMC Evol Biol

    (2011)
  • L.R. Varshney et al.

    Structural properties of the Caenorhabditis elegans neuronal network

    PLoS Comput Biol

    (2011)
  • J.G. White et al.

    The structure of the nervous system of the nematode Caenorhabditis elegans

    Philos Trans R Soc Lond B Biol Sci

    (1986)
  • R.A. Kerr et al.

    Intracellular Ca2+ imaging in C. elegans

    Methods Mol Biol

    (2006)
  • A.M. Leifer et al.

    Optogenetic manipulation of neural activity in freely moving Caenorhabditis elegans

    Nat Methods

    (2011)
  • J.N. Stirman et al.

    Real-time multimodal optical control of neurons and muscles in freely behaving Caenorhabditis elegans

    Nat Methods

    (2011)
  • S. Faumont et al.

    An image-free opto-mechanical system for creating virtual environments and imaging neuronal activity in freely moving Caenorhabditis elegans

    PLoS ONE

    (2011)
  • M. Zheng et al.

    Calcium imaging of multiple neurons in freely behaving C. elegans

    J Neurosci Methods

    (2012)
  • W. Shultz

    Midbrain dopamine neurons: a retina of the reward system?

  • E.L. Ardiel et al.

    An elegant mind: learning and memory in Caenorhabditis elegans

    Learn Mem

    (2010)
  • B.B. Shtonda et al.

    Dietary choice behavior in Caenorhabditis elegans

    J Exp Biol

    (2006)
  • Y. Zhang et al.

    Pathogenic bacteria induce aversive olfactory learning in Caenorhabditis elegans

    Nature

    (2005)
  • Y. Shinkai et al.

    Behavioral choice between conflicting alternatives is regulated by a receptor guanylyl cyclase, GCY-28, and a receptor tyrosine kinase, SCD-2, in AIA interneurons of Caenorhabditis elegans

    J Neurosci

    (2011)
  • J. Culotti et al.

    Osmotic avoidance defective mutants of the nematode C. elegans

    Genetics

    (1978)
  • M. Chalfie et al.

    The neural circuit for touch sensitivity in Caenorhabditis elegans

    J Neurosci

    (1985)
  • S. Saeki et al.

    Plasticity of chemotaxis revealed by paired presentation of a chemoattractant and starvation in the nematode Caenorhabditis elegans

    J Exp Biol

    (2001)
  • H.A. Colbert et al.

    Odorant-specific adaptation pathways generate olfactory plasticity in C. elegans

    Neuron

    (1995)
  • I. Torayama et al.

    Caenorhabditis elegans integrates the signals of butanone and food to enhance chemotaxis to butanone

    J Neurosci

    (2007)
  • A. Bendesky et al.

    Catecholamine receptor polymorphisms affect decision-making in C. elegans

    Nature

    (2011)
  • Cited by (55)

    • The Input-Output Relationship of AIY Interneurons in Caenorhabditis elegans in Noisy Environment

      2019, iScience
      Citation Excerpt :

      Therefore, our results suggest that fluctuations in sensory input induce behavioral variability. It is difficult to address the relationship between sensory input and behaviors under environmental noise, because of the low signal-to-noise ratio (Faumont et al., 2012). Our results thus provide novel insights into the relationship between sensory-input fluctuation and behavioral variability.

    View all citing articles on Scopus
    View full text