Abstract
Planning spatial paths through our environment is an important part of everyday life and is supported by a neural system including the hippocampus and prefrontal cortex. Here we investigated the precise functional roles of the components of this system in humans by using fMRI as participants performed a simple goal-directed route-planning task. Participants had to choose the shorter of two routes to a goal in a visual scene that might contain a barrier blocking the most direct route, requiring a detour, or might be obscured by a curtain, requiring memory for the scene. The participant's start position was varied to parametrically manipulate their proximity to the goal and the difference in length of the two routes. Activity in medial prefrontal cortex, precuneus, and left posterior parietal cortex was associated with detour planning, regardless of difficulty, whereas activity in parahippocampal gyrus was associated with remembering the spatial layout of the visual scene. Activity in bilateral anterior hippocampal formation showed a strong increase the closer the start position was to the goal, together with medial prefrontal, medial and posterior parietal cortices. Our results are consistent with computational models in which goal proximity is used to guide subsequent navigation and with the association of anterior hippocampal areas with nonspatial functions such as arousal and reward expectancy. They illustrate how spatial and nonspatial functions combine within the anterior hippocampus, and how these functions interact with parahippocampal, parietal, and prefrontal areas in decision making and mnemonic function.
Introduction
The neural mechanisms supporting the planning of spatial routes remain a mystery, although single-unit recording and lesion and neuroimaging studies provide some tantalizing hints. Posterior hippocampal formation (HF) in humans (homologous to dorsal HF in rodents) is thought to encode environmental location to support spatial navigation (O'Keefe and Nadel, 1978; Maguire et al., 1998; Ekstrom et al., 2003; Hartley et al., 2003; Moser and Moser, 1998; Doeller et al., 2008; Moser et al., 2008), whereas anterior HF (homologous to rodent ventral HF) is associated with processing environmental context (Bannerman et al., 2004; Kjelstrup et al., 2008), novelty (Strange et al., 1999; Bunzeck and Düzel, 2006; Dudukovic and Wagner, 2007; Doeller et al., 2008), arousal, emotion, and reward (Moser and Moser, 1998; Ferbinteanu and McDonald, 2001; Fanselow and Dong, 2010; Royer et al., 2010), and their effects on memory (Wittmann et al., 2005; Adcock et al., 2006). Spatial planning links representations of location with expectancy of reward to provide a basis for the appropriate choice of action (Sutton and Barto, 1998; Foster et al., 2000).
Neuronal responses in rodent hippocampus (Breese et al., 1989; Kobayashi et al., 1997; Frank et al., 2000; Hollup et al., 2001; Fyhn et al., 2002; Ferbinteanu and Shapiro, 2003; Lee et al., 2006; Hok et al., 2007; Dupret et al., 2010) and medial prefrontal cortex (mPFC) (Hok et al., 2005) can reflect the animal's future trajectory or proximity to goal locations. Hippocampal place cells have been proposed to provide spatially extended evaluation functions encoding goal proximity (Burgess et al., 1994; Burgess and O'Keefe, 1996; Bilkey and Clearwater, 2005) or expectancy of reward (Dayan, 1991; Foster et al., 2000). In humans, neuronal representations of location can reflect the current goal of search within a virtual town (Ekstrom et al., 2003), and navigational accuracy is impaired by hippocampal damage (Spiers et al., 2001a,b; Bohbot et al., 2004) and correlates with hippocampal activation (Maguire et al., 1998; Grön et al., 2000; Hartley et al., 2003; Iaria et al., 2003). However, the precise contributions of hippocampal and nonhippocampal regions to spatial decision making remain obscure. For example, although the above rodent studies predominantly target dorsal hippocampus, the spatially extended firing fields in ventral hippocampus (Jung et al., 1994; Kjelstrup et al., 2008) are ideally suited to provide evaluation functions that cover the entire environment.
Using fMRI, we investigated the neural bases of goal-directed spatial planning and the representation of goal proximity. We manipulated memory load to dissociate any general mnemonic role of the hippocampus (Squire, 1992; Eichenbaum et al., 1999) from its role in spatial planning, and to identify regions associated with representation of spatial scenes [e.g., parahippocampal gyrus (Epstein and Kanwisher, 1998)]. We also investigated the effect of having to make a detour in order to provide an independent manipulation of difficulty and identify regions associated with inhibition of the direct route [e.g., left and medial prefrontal areas (Maguire et al., 1998; Spiers and Maguire, 2006)]. A key aspect of the design was to parametrically manipulate the start position, hence varying goal proximity.
Materials and Methods
Participants.
Eighteen healthy, right-handed males (mean age ± SD, 23.33 ± 3.96 years old) with no history of psychiatric or neurological disorder took part in this study, which was approved by the local research ethics committee. All participants gave informed written consent and were paid for participating.
Trial structure.
The experiment consisted of 120 trials (24 trials per condition with four experimental and one control conditions; see below). Each trial had an encoding phase and a test phase (lasting 3 s each) separated by a delay phase (range, 1–7 s; mean, 4 s) (Fig. 1). Trials were separated by an intertrial interval (range, 1–7 s; mean, 4 s). In the encoding phase, participants passively viewed a virtual room from a central position; the room contained two parallel walls (with two gaps each), a man behind the second wall, and a gate (supplemental Fig. 1, available at www.jneurosci.org as supplemental material). The man was the target of mental navigation. From the central position, there were two possible routes to get to the man, corresponding to the two gaps in the first wall. For each condition, there were an equal number of trials with the man on the left or right.
A, B, Trial structure showing the alternation of encoding phases, in which participants passively view the layout of a room from the middle viewpoint, and test phases, showing the same room from a shifted viewpoint, during which participants had to respond by indicating which gap in the near wall they would go through to get to the man by the shortest possible route (each phase lasted 3 s). Two examples are given with the man shown on the left in the no-detour/memory condition (A) and in the detour/no-memory condition (B). The delay and intertrial intervals (ITI) were both jittered with a mean duration of 4 s.
During the test phase, participants were shown the same room as in the encoding image, but from a different start position that varied from trial to trial. There were six start positions, distributed laterally from the middle viewpoint. Participants had to indicate, by pressing one of two buttons, which gap in the nearest wall (left or right) they would choose to get to the man by the shortest possible route. Thus, due to their shifted start position, participants had to mentally recalculate the shortest distance to the man and choose the corresponding gap.
Before scanning, participants were familiarized with the task in a training phase that lasted ∼15 min outside of the scanner, using different start positions than in the experimental task.
Detour and memory manipulation.
The experiment used a two-by-two factorial design, the first factor being detour (detour vs no-detour) and the second being memory (memory vs no-memory), resulting in four experimental conditions. These factors concern manipulations of the basic task.
The detour manipulation concerned the gate in the farther wall. In detour trials, the gap in the farther wall directly in front of the target was closed by a gate, meaning that the planned route had to go through the other gap rather than directly to the target. In no-detour trials, the other gap in the farther wall was closed by a gate, meaning that the target could be approached directly (supplemental Fig. 1, available at www.jneurosci.org as supplemental material). Half of the trials required a detour and half were no-detour trials. The distance to the goal was thus longer in the detour condition, although, for the purposes of the planning task (i.e., choosing the closer gap) the goal simply became the farther gap. Accordingly, when comparing the lengths of the alternative routes, we simply measured the distance to the appropriate gap in the farther wall in all cases.
The memory manipulation concerned the test trials. In memory trials, the room beyond the first wall, including the farther wall, gate, and target, was obscured by a curtain during the test phase. Thus, planning required remembered knowledge from the encoding phase regarding the configuration of the farther wall and target, combined with visible knowledge concerning the current start position. Altogether, at test, a curtain was depicted in half of the trials (i.e., memory trials), and in the other half the room remained visible (i.e., no-memory trials).
During control trials (24 trials), one gap (left in half the trials, right in the other half) in the first wall was highlighted and participants simply had to choose that gap, hence controlling for planning processes; it is likely that choosing the highlighted gap demanded less planning than deciding which of two routes was the shortest. Reaction times were indeed shorter for the control condition compared with the experimental conditions.
Trials of the four experimental conditions and the control condition were randomly presented in miniblocks of five trials (unknown to the participants) throughout the experiment, with the constraint that trials of the same condition were not repeated in two successive trials (i.e., across miniblock boundaries).
Parametric variation of start position.
For every trial, there were two possible routes to the open gate at the far side of the room (the goal) and one was always shorter than the other. The participants' start position was varied parametrically to manipulate the proximity of the goal (i.e., choosing an obvious short route from a longer route vs choosing between two approximately equal medium-length routes). There were five levels of goal proximity, ranging from distance 1 trials (the shortest correct route to the goal) to distance 5 trials [the longest correct route to the goal and the smallest difference between correct and incorrect routes (Fig. 2)]. All start positions were fully counterbalanced across detour and memory factors. This allowed us to investigate independently the effects of detour, memory, and goal proximity and to establish whether any observed effects could be explained in terms of task difficulty effects.
Overall, in 83% of test trials (start positions 1–5), the shortest route from the test viewpoint (i.e., the choice of left or right gap) was the same as from the encoding viewpoint. For the remaining 17% of trials (start position 6), the shortest route was through the other gap in the nearest wall compared with that shown at encoding. Using this shortest route, start position 6 was the same distance from the goal as start position 4 (Fig. 2).
A, Aerial view of the layout, shown in the no-detour condition. B, Correspondence between the distance to goal (distances 1–5) and the six start positions (positions 1–6) in the no-detour/no-memory condition, with the shortest route for each start position indicated (participants did not see these routes). In the no-detour condition, the shortest route for start positions 1–5 (red) involved choosing the gap opposite to the man, whereas the shortest route from the sixth start position (green) involved choosing of the gap on the other side. C, Correspondence between distance to goal and start positions in the detour/no-memory condition, with the shortest route for each start position indicated. In the detour condition, the brown gate in the far wall blocks the direct route to the man, so that the goal for the planning task (i.e., the choice of gate in the nearer wall) becomes the other (unblocked) gate in the farther wall. The start positions are organized relative to the goal for the planning task (i.e., number 1 is the closest to the goal in all conditions, but is far from the man in the detour condition).
Behavioral data analysis.
A repeated-measure ANOVA was applied to the experimental factors [detour (2) × memory (2) × goal proximity (5)] for both performances and reaction times (RT). Performance was calculated by dividing the number of correct trials by the total number of trials for that configuration (hit rate).
fMRI acquisition.
Blood oxygenation level-dependent-sensitive T2*-weighted functional images were acquired on a 3T Siemens Allegra scanner using a gradient-echo EPI pulse sequence with the following parameters: repetition time, 2600 ms; echo time, 30 ms; flip angle, 90°; slice thickness, 2 mm; interslice gap, 1 mm; in-plane resolution, 3 × 3 mm; field of view, 192 mm2; 40 slices/volume. The sequence was optimized to minimize signal dropouts in the medial temporal lobes (Weiskopf et al., 2006). Visual stimuli were presented using MATLAB (MathWorks) and COGENT 2000 Toolbox (http://www.vislab.ucl.ac.uk/cogent.php).
Image preprocessing.
Functional images were processed and analyzed using SPM5 (www.fil.ion.ucl.ac.uk/spm). The first five volumes were discarded to allow for T1 equilibration. Standard preprocessing procedures included correction for differences in slice acquisition timing, realignment/unwarping to correct for interscan movements, and normalization of the images to an EPI template specific to our sequence and scanner that was aligned to the T1 MNI template. Finally, the normalized functional images were spatially smoothed with an isotropic 8 mm FWHM Gaussian kernel.
fMRI data analysis.
In the basic model, fMRI time series were modeled by a general linear model including separate regressors for each of the four conditions during the test phase (no-detour/no-memory, no-detour/memory, detour/no-memory, and detour/memory) and for the control condition, as well as parametric modulations of these regressors reflecting the goal proximity in each trial. In addition, we modeled the encoding phase by including one regressor containing all trials. The resulting coefficients were analyzed across participants using SPM5. All regressors were convolved with the canonical hemodynamic response function. Data were high-pass filtered (cutoff period, 128 s). Coefficients for each regressor were estimated for each participant using maximum likelihood estimates to account for serial correlations in the data. At the first level, linear contrasts of the parameter estimates for each regressor of interest were calculated for each participant and were then brought to the second level random-effects analysis. We conducted a 2 × 2 ANOVA with the factors detour and memory on the parameter estimates for the regressors of the four experimental conditions at test.
To look at the parametric effect of goal proximity, we extended the above statistical model by introducing parametric regressors reflecting differences in goal proximity on a trial-by-trial level. This design enables us to look at any possible effects of goal proximity per se, but also any possible effects of detour and memory on goal proximity and vice versa. To control for possible confounds due to response-switching (i.e., changing from the gate that would have been chosen from the encoding viewpoint) and novelty (i.e., the change in the visual scene from the encoding to testing viewpoints) on the goal proximity effect, we estimated a second first-level model. This model included six regressors according to the six different starting positions (collapsed across the four experimental conditions), plus one separate regressor for the control condition and an additional regressor modeling activity in the encoding phase (collapsed across all conditions; see above).
A final analysis was performed to investigate whether activations identified as reflecting goal proximity could be explained in terms of a nonspecific task-difficulty effect. We therefore estimated another first-level model that included a regressor for the experimental conditions (collapsed across all four conditions), a regressor for the control condition, and another for the encoding phase. For the first regressor, two parametric modulations were entered, reflecting goal proximity (as defined in Parametric variation of start position, above) and task difficulty (as reflected in RTs on a trial-by-trial level). The corresponding parameter estimates were calculated for each participant and brought to the second-level random-effects analysis (one-sample t tests). Each parametric analysis therefore revealed the unique contribution of either goal proximity or task difficulty, since each was orthogonalized to the rest of the design.
Based on our a priori hypotheses, we report activations at an uncorrected statistical threshold of p < 0.001 and extent threshold of k > 10 voxels. Coordinates of brain regions are reported in MNI space.
Results
Behavioral results
Analyses of the behavioral data revealed a significant interaction between the factors detour and memory for performance (Fig. 3), indicating that performance decreased when having to make a detour on the basis of remembered information (F(1,17) = 6.514, p < 0.021). RTs showed a main (increasing) effect of having to make a detour (F(1,17) = 17.976, p = 0.006). A main effect of goal proximity was also detected, both in terms of performance increasing with goal proximity (F(4,13) = 24.089, p < 0.001) and RTs (F(4,13) = 20.142, p < 0.0001) and RTs decreasing with goal proximity. Performance showed no sign of an interaction between goal proximity and detour (F(4,13) = 0.512, p = 0.727), nor between goal proximity and memory (F(4,13) = 0.616, p = 0.652), nor a triple interaction (F(1,13) = 1.390, p = 0.247). Similarly, RTs showed no interaction between goal proximity and detour (F(4,13) = 1.107, p = 0.361), nor goal proximity and memory (F(4,13) = 0.942, p = 0.445), nor a triple interaction (F(4,13) = 1.761, p = 0.147). Thus, varying goal proximity affected performance/difficulty independently of the detour and memory manipulations. Furthermore, all subjects completed the task successfully with 90% (SD, 6%) of correct responses.
A, B, Behavioral results for the detour, memory, and control conditions in terms of performance (i.e., choice of the correct shortest path) (A) and reaction times (B, left). The effect of goal proximity (B, right) (for distance levels, see Fig. 2) on performance and reaction times is shown separately for the detour and memory conditions. Error bars denote SEM. D, Detour; M, memory; NoD, no-detour; NoM, no-memory; ctl, control.
fMRI results
Spatial planning
Comparing all experimental conditions (planning a route) to the control task (no spatial planning) showed activation in a frontoparietal network, including the bilateral mPFC, dorsolateral and ventrolateral prefrontal cortex (PFC), posterior parietal cortex (PPC), precuneus, insula, right parahippocampal gyrus, occipital regions, thalamus, and cerebellum (Table 1).
Results of the contrast comparing all conditions to the control condition (highlighted gate)
Effect of detour
Compared with the no-detour trials, the detour trials showed greater activation in the left mPFC and right ventromedial PFC, bilateral precuneus, left PPC, and right cerebellum (Fig. 4A, Table 2). Different areas were activated by goal proximity (see Parametric effects of goal proximity, below), indicating that detour-related activations did not simply reflect goal proximity or difficulty. Right anterior hippocampal activation (and left activation, subthreshold at p = 0.005) was detected when contrasting the no-detour (i.e., direct route) to the detour trials (i.e., longer, indirect route). We interpret this activation as reflecting proximity to goal (see Parametric effects of global proximity, below).
Statistical parametric maps showing the main results of the factorial analysis. A, Main effect of detour: no-detour versus detour, centered on the right hippocampal peak (x = 26, y = −6, z = −16); detour versus no-detour, centered on the left mPFC peak (Brodmann area 10; x = −18, y = 58, z = −8). B, Main effect of memory: no-memory versus memory, centered on the right inferior occipital peak (Brodmann area 18; x = 30, y = −88, z = −4); memory versus no-memory, centered on the right parahippocampal peak (Brodmann area 36; x = 28, y = −38, z = −18). Stereotaxic coordinates are given in Table 2. Plots show mean percentage signal change of the peak voxel in the indicated region (±SEM) separately for the detour and memory factors. Color scale shows voxel t values. L, Left; R, right.
Results of the detour × memory ANOVA
Effect of memory (obscuring the scene at test)
When participants had to choose the route based on their memory for the layout of the scene (curtain vs no curtain trials), there was greater activation bilaterally in the parahippocampal and lingual gyri (Fig. 4B, Table 2). The reverse contrast (no curtain > curtain trials) revealed bilateral inferior occipital activation.
Detour and memory interaction
An interaction effect was found in the left hippocampus, bilateral ventrolateral and ventromedial PFC, and medial and posterior parietal areas. A weak interaction can be seen in bilateral anterior hippocampus (Fig. 4A), such that the effect of memory is greater in no-detour trials than in detour trials (in which planning may overshadow memory). This interaction becomes significant in a small, left mid-hippocampal region and in the other regions listed above, where the memory effect reverses in detour trials (i.e., greater activation in the no-memory condition in which the goal is visible). It is possible that the visible detour trial evokes different or more intense spatial planning than other conditions, but this interaction was not anticipated and its interpretation is speculative.
Parametric effects of goal proximity
We first investigated which regions showed levels of activation that increased parametrically the closer the start location was to the goal. This analysis revealed activations in bilateral anterior hippocampus (peak region). In addition, we observed a network of regions, including right parahippocampal gyrus, bilateral ventromedial PFC, mPFC, and bilateral posterior cingulate gyrus, extending into the precuneus and retrosplenial cortex, occipital areas (lingual gyrus, cuneus), right anterior cingulate, and superior temporal cortices and bilateral cerebellum (Fig. 5, Table 3). This parametric effect is independent of detour and memory factors since we did not observe significant main effects of detour or memory in the aforementioned regions in the 2 × 2 ANOVA of these effects on the parametric estimates for goal proximity (i.e., goal proximity did not interact with detour or memory in its effect on activation) (see Materials and Methods). Calculation of the full distance to the goal (i.e., the distance to the goal location itself, rather that the distance to the open gate in the rear wall) led to similar results. Indeed, the increased hippocampal activation for no-detour trials compared with detour trials (i.e., shorter vs longer overall routes to the goal) (Fig. 4) is consistent with our main finding that hippocampal activation is driven by goal proximity.
Parametric effect of goal proximity. A, B, Left hippocampal (A; x = −26, y = −16, z = −20) and left medial prefrontal (B; x = −2, y = 56, z = −12) activation increases with goal proximity. Statistical parametric maps show the increasing response with increasing proximity to goal (top). Plots show activation (±SEM) for the different levels of proximity to goal (Fig. 2) and control condition (ctl). Stereotaxic coordinates are given in Table 3. Color scale shows voxel t values. For representational purposes, the statistical maps show clusters surviving a height threshold of p < 0.0001.
Results of the parametric analysis of proximity to goal, showing regions more active for start positions closer to the goal
To further rule out the possibility that the goal proximity effect could be explained by the varying difficulty of the task, an additional parametric analysis was conducted to reveal the unique contribution of goal proximity (i.e., the design matrix included orthogonalized regressors for goal proximity and for task difficulty, as assessed by RTs on a trial-by-trial level). Results showed that the goal proximity-related activations persisted in the same regions when difficulty was taken into account, namely the bilateral hippocampus, parahippocampal gyrus, mPFC, posterior cingulate gyrus extending into the precuneus and retrosplenial cortex, cuneus, anterior cingulate and lateral temporal cortices, and the bilateral cerebellum (supplemental Fig. 2A; supplemental Table 1, available at www.jneurosci.org as supplemental material). These results were independent of the order of the regressors entered in the model. Hence, these regions are driven by goal proximity and not by the varying difficulty of the task (for effects of varying difficulty, see supplemental Fig. 2B, available at www.jneurosci.org as supplemental material). Note that percentage signal change for the control condition in the hippocampus is not positive and is lower than that for the shorter goal distances (Fig. 5), indicating that task ease at these shorter distances cannot account for hippocampal activation (since its activation is greater than for the control condition).
Could the effects of goal proximity reflect response-switching or novelty? Start position 6 had one of the longest path lengths to the goal and also involved choosing the opposite gate to that associated with the shortest path from the encoding viewpoint (middle position). It is therefore possible that an effect of goal proximity could arise in part from decreased activation in trials from start position 6, in which participants had to switch their response compared with any prepotent response selected during the encoding phase. No sign of this was found; the activation for start position 6 exceeded that for start position 4, which was equidistant to the goal but did not require switching from a response selected during encoding (supplemental Fig. 3A, available at www.jneurosci.org as supplemental material). We also examined whether the goal proximity effect might be modulated by novelty, since the view from the different start positions involve differing amounts of change from the (middle) view shown at encoding. There was no sign of a parametric increase in activation according to the extent of visual change from encoding to test phases (supplemental Fig. 3B, available at www.jneurosci.org as supplemental material).
In the final analysis of goal proximity, we investigated those regions in which activation increased parametrically the further the start location was from the goal. These regions therefore showed increased activation when the comparison between the correct and incorrect routes was increasingly more difficult. The regions identified in this analysis included the precentral gyrus, bilateral insula, precuneus, dorsolateral and ventrolateral PFC, anterior and posterior cingulate cortices, angular gyrus, and PPC (Fig. 6; Table 4).
Parametric responses of increasing goal distance showing activation in the precuneus (sagittal section), insula (coronal section), and anterior cingulate cortex (both sections). Statistical parametric maps and plots of percentage signal change (±SEM) in the left precuneus (x = 12, y = −58, z = 60) are shown for increasing levels of distance from goal. The farther the start position is from the goal, the higher the activation. Stereotaxic coordinates are given in Table 4. Color scale shows voxel t values.
Results of the parametric analysis of distance to goal, showing regions more active for start positions farther from the goal
Discussion
We identified an extended network involved in spatial decision making in the absence of actual navigation. The most prominent activations were in the hippocampus, parahippocampal gyrus, mPFC, PPC, and precuneus. The mPFC, precuneus, and PPC are more active when a detour must be planned, whereas the parahippocampal gyrus is more active when the layout of the scene must be remembered. A parametric analysis revealed increasing activation with the proximity of the goal in bilateral anterior hippocampus, right parahippocampal gyrus, mPFC, and medial parietal regions, independent of task difficulty, response switching, and novelty. Previous studies have identified a similar network during active navigation in virtual environments (Maguire et al., 1998; Shelton and Gabrieli, 2002; Hartley et al., 2003; Iaria et al., 2003; Bohbot et al., 2004; Spiers and Maguire, 2006, 2007) and during imagined navigation (Ghaem et al., 1997). Here, we attempt to specify their functional contributions to spatial decision making.
Detour planning
Prefrontal involvement in spatial memory has been attributed variously to executive functions, planning, decision making, and working memory (Maguire et al., 1998; Grön et al., 2000; Hartley et al., 2003; Bohbot et al., 2004; Spiers and Maguire, 2006). Our results indicate that planning a detour activates the left mPFC and right ventromedial PFC, consistent with findings showing increased left mPFC activity for strategy switching in the presence of obstacles (Maguire et al., 1998; Rauchs et al., 2008) and right ventromedial PFC activation when a specific route is blocked (Spiers and Maguire, 2006). Our study allows further interpretation of these activations. First, they are not due to increased difficulty in the detour condition, since difficulty was controlled independently in our design, and did not produce mPFC activation. Second, mPFC activity is not a novelty response to the unexpected blockage, since detour trials were as common as no-detour trials in our design. Overall, these results implicate mPFC in changing strategy when encountering an obstacle, with inhibition of the most direct path likely an important component.
The precuneus and left PPC were activated by detour planning. Both regions are activated by way-finding compared with processing static scenes (Maguire et al., 1998) or route-following (Hartley et al., 2003). The PPC has also been associated with spatial planning (Spiers and Maguire, 2006) and activity there correlates with egocentric distance to the goal (Spiers and Maguire, 2007). Animal studies reveal neurons in medial parietal areas that respond to the position of stimuli in allocentric space (Galletti et al., 1993; Dean and Platt, 2006), whereas neurons in the more lateral intraparietal sulcus respond to combinations of egocentric and allocentric locations (Andersen et al., 1985; Snyder et al., 1998) and to the animal's position along a trajectory (Nitz, 2006). Thus, these activations may reflect a role in translating between allocentric medial temporal lobe representations and egocentric parietal representations necessary for imagery and planning of potential routes (Burgess et al., 2001; Byrne et al., 2007), which would be more complex in the detour condition.
Effect of memory
Memory-related activation was detected in bilateral parahippocampal and lingual gyri when the scene was obscured by a curtain compared with when it was visible. Parahippocampal and lingual activations have been detected during recall of topographic information (Aguirre et al., 1996), suggesting their role in learning topographical representations. The parahippocampal gyrus responds selectively to visual scenes depicting places (Epstein and Kanwisher, 1998) and is specifically involved in the retrieval of spatial context compared with nonspatial context (Burgess et al., 2001; King et al., 2005; Bar et al., 2008; Epstein and Ward, 2010). The absence of significant memory-related hippocampal activation is consistent with a long history of basic contrasts of memory versus nonmemory conditions (Ungerleider, 1995; Wagner et al., 1998). Our findings confirm the role of the parahippocampal gyrus in representing the spatial information in visual scenes rather than just perceptual processing. In the reverse comparison, greater activation in bilateral posterior occipital regions reflected the richer visual characteristics of the scenes without the curtain.
Effect of goal proximity
The bilateral anterior hippocampus, right parahippocampal gyrus, medial prefrontal, and medial posterior parietal regions showed a very robust increase in activation with goal proximity. Activity in the anterior hippocampus can be interpreted in terms of complementary spatial and nonspatial processes. Models of rodent navigation posit that the place cell representation of location drives representations of reward expectation (Foster et al., 2000) or goal proximity (goal proximity and expectation of reward are equivalent in the context of navigation in simple environments) (Burgess et al., 1994; Burgess and O'Keefe, 1996; Bilkey and Clearwater, 2005). These goal cells would have firing fields covering the entire environment, with peak rates at the goal location, and were postulated for the subiculum or nucleus accumbens. However, the large firing fields in ventral rodent hippocampus (anterior hippocampus in humans) and the association of these regions with contextual, affective, and reward-related processing (Moser and Moser, 1998; Ferbinteanu and McDonald, 2001; Bast, 2007; Adhikari et al., 2010; Fanselow and Dong, 2010; Royer et al., 2010) suggest that the representation of goal proximity could be provided by the anterior hippocampus.
The ventral/anterior hippocampus is closely connected to medial prefrontal areas (Fanselow and Dong, 2010; Royer et al., 2010) where goal-responsive cells have been reported in rodents (Hok et al., 2005, 2007). Thus, anterior hippocampal and medial prefrontal areas may conspire to support representations of goal proximity (Gaussier et al., 2002; Killcross and Coutureau, 2003; Poucet et al., 2004; Doeller et al., 2008).
Our finding of hippocampal activation in spatial decision making is consistent with its association with navigating to an unseen target location (Maguire et al., 1998; Grön et al., 2000; Hartley et al., 2003; Iaria et al., 2003; Spiers and Maguire, 2006), and recordings in humans showing the presence of goal-responsive place cells in the hippocampus and prefrontal cortex (Ekstrom et al., 2003). In addition, hippocampal place cells can show a modulation of their spatially localized activity according to the goal location (Breese et al., 1989; Kobayashi et al., 1997; Hollup et al., 2001; Fyhn et al., 2002; Hok et al., 2007; Dupret et al., 2010) or current path (Frank et al., 2000; Ferbinteanu and Shapiro, 2003; Lee et al., 2006). Thus, our findings are consistent with the presence of a representation of goal proximity in the HF that is used for path planning.
The remaining parahippocampal activation presumably reflects support for the representation of the spatial scene within which planning is performed, consistent with its role in processing spatial scenes (Epstein and Kanwisher, 1998) and its activation in the memory condition. Medial parietal/posterior cingulate regions were also activated by goal proximity, although, unlike the hippocampus, these regions were also more active when planning detours (see Detour planning, above). Their activation may reflect the intensity of spatial processing and imagery, which might increase with both goal proximity and detour planning. This would be consistent with the association of medial parietal regions with spatial navigation (Burgess et al., 2002; Bird and Burgess, 2008; Epstein, 2008; Vann et al., 2009), episodic memory (Wagner et al., 2005; Viard et al., 2007, 2010, 2011), and imagery (Fletcher et al., 1995; Burgess et al., 2001; Cavanna and Trimble, 2006; Byrne et al., 2007). Studies in monkeys (McCoy and Platt, 2005) and humans (Peters and Büchel, 2009) have also linked these areas to reward processing and attention. Pearson et al. (2009) hypothesized that it integrates variables such as reward, uncertainty, and target location.
These findings indicate a role for the HF (including subiculum), medial prefrontal, and medial parietal regions in supporting goal-directed navigation, and suggest that this is achieved via increases in firing rate with goal proximity. Our results are consistent with the existence of this type of goal coding in hippocampal, parahippocampal, medial prefrontal, and medial parietal areas, and illustrate the potential for complementary spatial and nonspatial interpretations of anterior hippocampal processing.
A different network of regions was associated with increased distance from the goal, including lateral prefrontal, bilateral insula, anterior and posterior cingulate cortices, and lateral parietal regions. As distance increases, the two alternative routes become more similar and consequently the choice between them becomes more difficult. The network of regions identified by this analysis is consistent with previous associations of increasing dorsolateral prefrontal activation with task difficulty (Duncan and Owen, 2000) and anterior cingulate and ventrolateral prefrontal activation with task difficulty (Barch et al., 1997) and response selection (Tregellas et al., 2006).
Conclusion
Using a spatial route planning task, we identified an extensive network of brain regions showing specific involvement in detour planning, memory, and goal proximity. Activity in medial prefrontal cortex, precuneus, and left PPC was associated with detour planning, regardless of difficulty, whereas activity in the parahippocampal gyrus was associated with remembering the spatial layout of the scene. Activity in bilateral anterior hippocampus showed a robust increase with proximity to the goal, together with medial prefrontal and parietal areas. Our findings support results from single-unit recordings and computational modeling concerning the use of direct encoding of goal proximity in navigation, and highlight the potential for complementary spatial and nonspatial interpretations of anterior hippocampal function.
Footnotes
This work was supported by the Wayfinding project of the European Union and the Medical Research Council (UK). We thank Hugo Spiers for useful discussions and help with initial task design, and the Wellcome Trust Centre for Neuroimaging at University College London for providing help and scanning facilities.
- Correspondence should be addressed to Neil Burgess, Institute of Cognitive Neuroscience, University College London, 17 Queen Square, London WC1N 3AR, United Kingdom. n.burgess{at}ucl.ac.uk