Abstract
Extensive motor skill training induces reorganization of movement representations and synaptogenesis within adult motor cortex. Motor skill does not, however, develop uniformly across training sessions. It is characterized by an initial fast phase, followed by a later slow phase of learning. How cortical plasticity emerges during these phases is unknown. Here, we examine motor map topography and synapse number within rat motor cortex during the early and late phases of motor learning. Adult rats were placed in either a skilled or unskilled reaching condition (SRC and URC, respectively) for 3, 7, or 10 d. Intracortical microstimulation of layer V was used to determine the topography of forelimb movement representations within caudal forelimb area of motor cortex contralateral to the trained paw. Quantitative electron microscopy was used to measure the number of synapses per neuron within layer V. SRC animals showed significant increases in reaching accuracy after 3, 7, and 10 d of training. In comparison with URC animals, SRC animals had significantly larger distal forelimb representations after 10 d of training only. Furthermore, SRC animals had significantly more synapses per neuron than URC animals after 7 and 10 d of training. These results show that both motor map reorganization and synapse formation occur during the late phase of skill learning. Furthermore, synaptogenesis precedes map reorganization. We propose that motor map reorganization and synapse formation do not contribute to the initial acquisition of motor skills but represent the consolidation of motor skill that occurs during late stages of training.
Introduction
Most adult behavior involves the expression of motor skill. Despite the significance of motor learning for the performance of most behaviors, little is known as to how or where skilled movement is encoded by the brain. The motor cortex is arguably the primary motor structure and is essential for performance of skilled movement (Porter and Lemon, 1995). Since the discovery of motor maps within the motor cortex (Fritsch and Hitzig, 1870), decades of experiments have shown that redistribution of movement representations occurs in response to a variety of manipulations (for review, see Sanes and Donoghue, 2000). However, the capacity for reorganization likely exists to support acquisition of skilled movement. Indeed, motor learning-dependent changes in movement representations have been demonstrated in human (Cohen et al., 1993; Pearce et al., 2000), monkey (Nudo et al., 1996b), and rodent (Kleim et al., 1998a; Remple et al., 2001; Conner et al., 2003) motor cortex. The reorganization is characterized by both an areal expansion and an increase in the number of representations corresponding to trained movements (Nudo et al., 1996a; Kleim et al., 1998a, 2002b; Conner et al., 2003). The changes are also learning specific. Neither repetition of unskilled movements (Kleim et al., 1998a; Plautz et al., 2000), strength training (Remple et al., 2001) nor exercise training (Kleim et al., 2002a) is sufficient to induce motor map reorganization. Furthermore, manipulations that prevent map reorganization also impair skill learning (Conner et al., 2003). Collectively, these data demonstrate that the development of skilled movement is supported by changes in motor map topography. It is unknown, however, whether motor map reorganization develops uniformly as training progresses or occurs during specific phases of training.
The development of motor skill is characterized by two general phases of learning. The first involves rapid improvements in performance that can be observed both within a single training session and across the first few sessions. The second slower phase involves more moderate gains in performance that progress across multiple training sessions (Kleim et al., 1996; Nudo et al., 1996b; Karni et al., 1998; Kleim et al., 1998a). Results from neural imaging studies have suggested that these two different phases are supported by different patterns of activity across the motor system (Karni et al., 1998). The initial fast phase is associated with activation of striatum and cerebellum, whereas the later phase engages motor cortex (Ungerleider et al., 2002). These results would then predict that motor map reorganization would occur during the late, rather than early, phase. Furthermore, changes in cortical synapse number have been shown to be both localized to regions of motor cortex that undergo reorganization (Kleim et al., 2002b) and only detectable during the late phase (Kleim et al., 1996). We, therefore, hypothesize that motor map reorganization and synapse formation occurs during the late, slower phase of motor learning. To test this hypothesis, we examined the topography of movement representations and synapse number within rat forelimb motor cortex during both the early and late phases of motor learning.
Materials and Methods
Subjects. Fifty-six adult male Long-Evans hooded rats (350-420 gm) were assigned randomly to either a skilled reaching condition (SRC; n = 28) or an unskilled reaching condition (URC; n = 28). SRC animals were further allocated into 3 d (n = 9), 7 d (n = 10), and 10 d (n = 9) training conditions. URC animals were similarly allocated to 3 d (n = 9), 7 d (n = 9), and 10 d (n = 10) training conditions. Animals were group housed (four animals/cage) in standard laboratory cages on a 12 hr light/dark cycle throughout the experiment within the Canadian Centre for Behavioural Neuroscience vivarium.
Reach training. Over the course of several days, all animals were placed on a restricted diet until they reached 90% of their original body weight. A brief period of pretraining was then given to familiarize the rats with the reaching task. This involved placing them into test cages (10 × 18 × 10 cm) with floors constructed of 2 mm bars, 9 mm apart edge to edge. A 4 cm wide and 5 cm deep tray filled with food pellets (45 mg; Bioserv) was mounted on the front of the cage. The rats were required to reach outside the cage and retrieve pellets from the tray. All rats remained in pretraining until they had successfully retrieved 10 pellets (∼1 hr/d for 2 d). After pretraining, the rats were placed into a Plexiglas cage (11 × 40 × 40 cm) with a 1 cm slot located at the front of the cage. SRC animals were trained for 15 min each day to reach through the slot and retrieve food pellets from a table outside the cage (Whishaw and Pellis, 1990). Rats were permitted to use either limb, and the preferred limb was noted for each animal. Each session was videotaped, and frame by frame analysis was used to assess reaching performance. A successful reach was scored when an animal grasped the food pellet, brought it into the cage and to its mouth without dropping the pellet. The percentage of successful reaches [(number of successful retrievals/the total number of reaches) × 100] was then calculated.
To control for the potential effects of increased motor activity, URC animals were trained on a variation of the skilled reaching task. They were placed into training cages identical to that of the SRC and also trained to reach for a food pellet placed outside the slot for 15 min per day. However, the pellet was placed out of reach. Thus, the URC animals would reach for but never obtain the food pellet and, therefore, not develop skilled reaching movements. To keep the animals reaching, a food pellet would be periodically dropped into the training cage through the slot. Thus, the SRC and URC animals experienced similar amounts of forelimb activity, but only the SRC animals developed motor skill. Pilot work showed that well trained URC animals performed at the level of previously untrained animals when placed into the SRC (our unpublished observations).
Performance on the skilled reaching task used here is characterized by an early phase of learning in which reaching accuracy improves rapidly for over the first 5 d of training. After this phase, reaching accuracy improves at a much slower rate. Based on these data, we defined the first 5 d as the early, rapid phase of learning and the second 5 d as the late, slow phase. Animals from both the SRC and URC conditions were, therefore, trained for 3, 7, or 10 consecutive days before being mapped to assess the topography of movement representations during these different phases.
Electrophysiological mapping. Within 2 d of the final training session, standard intracortical microstimulation techniques were used to generate detailed maps of forelimb regions of the motor cortex contralateral to the trained forelimb (Kleim et al., 1998a; Remple et al., 2001). Before surgery, animals were anesthetized with ketamine hydrochloride (70 mg/kg, i.p.) and xylazine (5 mg/kg, i.p.), receiving acepromazine (0.02 mg/kg, i.m.) and ketamine (20 mg/kg, i.p.) as needed. A craniotomy was performed over the motor cortex contralateral to the trained paw of each animal. To prevent edema, a small puncture was made in the cisterna magna before removing the skull and dura. The exposed cortex was then covered in warm silicone oil (37°C). A digital image of the cortical surface was taken, and a 375 μm grid was superimposed onto the image. A glass microelectrode (controlled by a hydraulic microdrive) was used to make systematic penetrations across the cortex using the cortical surface image and grid as a guide. At each penetration site, the electrode was lowered to ∼1550 μm (corresponding to cortical layer V). Stimulation consisted of 13 200 μsec cathodal pulses delivered at 350 Hz from an electrically isolated stimulation circuit. Animals were maintained in a prone position with the limb consistently supported. Sites where no movement was detected at ≤60 μA were recorded as unresponsive. Forelimb movements were classified as either distal (wrist/digit) or proximal (elbow/shoulder), and representational maps were generated from the pattern of electrode penetrations. The caudal forelimb area (CFA) was chosen for analysis because this area has previously been shown to reorganize in response to skilled forelimb training (Kleim et al., 1998a). The CFA was defined by a medial boundary of vibrissa representations, a lateral and caudal boundary of nonresponse sites, and a rostral boundary of head and neck representations (Kleim et al., 1998a; Remple et al., 2001; Kleim et al., 2002a). An image analysis program (CANVAS, version 3.5) was used to calculate the areal extent of the CFA. The proportion of both distal and proximal movement representations that occupied the CFA was then calculated.
Tissue preparation. Immediately after mapping, a small volume of Toluidine blue (2%) was injected into the medial and lateral boundaries of the CFA. Animals were deeply anesthetized with pentobarbital (120 mg/kg) and transcardially perfused with 2% paraformaldehyde/2.5% glutaraldehyde in 0.1 m phosphate buffer. The mapped hemisphere was then sectioned coronally (300 μm) on a vibratome and viewed under a dissection microscope at low power (2×). Samples of tissue (∼500 μm wide) extending from pia to white matter were taken from sections in which the dye injections were visible. The tissue blocks were then washed in 0.1 m cacodylate, postfixed in 2% osmium tetroxide/1.5% potassium ferrocyanide in 0.1 m cacodylate buffer for 2 hr, and en bloc stained with 2% uranyl acetate for 45 min. Samples were then dehydrated through a series of alcohols before being transferred into propylene oxide and gradually embedded in Eponate resin. All tissue samples were coded with respect to treatment condition, and stereological analysis was conducted by independent researchers (N.R.C., R.B., and M.R.) who were all blind to sample conditions.
Estimating changes in synapse number. Behavioral training can lead to an increase in cortical volume that is primarily attributable to dendritic (Greenough et al., 1985; Kleim et al., 1997b), glial (Sirevaag et al., 1991; Anderson et al., 1994), and vascular hypertrophy (Black et al., 1990). Because of this volume increase, measures of synapse density alone may not reveal changes in synapse number. In conditions of stable neuron number, however, changes in neuropil volume can be detected by estimating neuron density. By obtaining the density of neurons and the density of synapses per unit volume, the number of synapses per neuron can be calculated and used to measure changes in synapse number (Turner and Greenough, 1985; Black et al., 1990; Kleim et al., 1996, 1998b; Jones et al., 1999). In the present study, unbiased stereological measures were used to determine the number of synapses per neuron within layer V of the motor cortex.
Neuron density. One block of tissue from each animal was chosen randomly, and 120 serial 1 μm sections were taken using a diamond knife and an ultramicrotome. These sections were stained with Toluidine blue, and cortical layer V was identified by the presence of large pyramidal cells and the absence of layer IV granule cells. Using a computer-assisted microscope, the physical disector (Sterio, 1984) was used to obtain estimates of neuron density. Pairs of sections within each series were compared in succession. The first section in the series was considered the Reference section, and the second the Lookup section, then the second section became the Reference section for the third section, and so on. Neuronal nuclei were identified by the presence of a central nucleolus within a pale nucleus and frequently by the oval to pyramidal shape of the surrounding cell soma. Irregularly shaped, smaller nuclei with extensive chromatin characteristic of glial cells were not counted. Within an unbiased counting frame (2500 μm2 at 60×), the number of neuronal nuclei that were present in the Reference section, but not the Lookup section (Q-), were counted. The disector volume of tissue through which the cells were counted (Vdis) was given by: Vdis = (Aframe)(H), where Aframe was the area of the counting frame and H was the section thickness (1 μm) multiplied by the number of sections. Neuron density (NvNeuron) was then determined by: 
Synapse density. After 1 μm sectioning, a small pyramid was trimmed into layer V of the motor cortex using a 1 μm Toluidine blue section from that block as a guide. From the pyramid, 20 silver-gray, serial sections (∼70 nm thick) were taken using a diamond knife and an ultramicrotome. Sections were collected on Formvar-coated, slotted, copper grids and stained with lead citrate-uranyl acetate. A four picture photomicrograph montage (23,800× print magnification) was taken from the same position within each section. The physical disector (Sterio, 1984) was then used to estimate synapse density from these micrographs. Briefly, pairs of electron micrographs (70 nm apart) within the series were then compared, and the number of synapses, within an unbiased counting of a known area (66 μm2), that were present in the Reference section but not the Lookup section were counted. Synapses were identified by the presence of a synaptic membrane specialization and at least three vesicles in the presynaptic element. From these measures, the number of synapses per neuron could be determined (NvSynapse)(1/NvNeuron) (Kleim et al., 1996).
Results
Skilled reaching performance
Within each daily 15 min training session, rats made 185 (±14) reaching attempts. Paired Student's t tests (p < 0.05) were conducted on the percentage of successful reaches between the first and last day of training for SRC animals in each of the three different training schedules. Results showed a significant increase in reaching success after 3 d (t(7) = 5.037; p < 0.05), 7 d (t(9) = 12.39; p < 0.05), and 10 d (t(12) = 12.89; p < 0.05) of training (Fig. 1A). After 3 d of training, performance improved from 18% (±7%) to 39% (±8%). After 7 d, accuracy increased from 23% (±8%) to 52% (±7%), and after 10 d, accuracy improved from 21% (±5%) to 61% (±9%). An ANOVA showed a significant effect of “day” on final reaching accuracy (F(2,39) = 4.11; p < 0.05). Subsequent multiple comparisons (Fisher's PLSD; p < 0.05) showed SRC animals in the 3 d condition had significantly lower reaching accuracies than the 7 and 10 d animals (Fig. 1B). The results show that although significant improvements in reaching accuracy occurred after 3 d, additional significant improvements can be seen after 7 d.
A, Performance of animals on the skilled reaching task after 3, 7, or10 d of training. Closed circles represent performance on the first day of training (Baseline), and open squares represent performance on the last day of training (Test). In comparison with baseline levels, all animals showed a significant increase in the percentage of successful reaches on the test day (*p < 0.05; Student's dependent t test). B, Performance on the last day of training for all three training durations. Reaching accuracy did not significantly differ between the 7 and 10 d animals, but both were significantly higher than the 3 d animals (*p < 0.05; Fisher's PLSD).
Topography of movement representations
Each evoked motor map was derived from ∼78 (±13) electrode penetrations. CFA maps were located approximately between -0.5 and +4.5 mm bregma (Fig. 2). An ANOVA with “condition” and day as between-subject factors revealed no significant main effect of condition (F(1,84) = 0.85; p > 0.05), day (F(4,84) = 1.78; p > 0.05), or condition × day (F(4,84) = 0.59; p > 0.05) on total area of the CFA (Fig. 3, left). However, a significant condition × day interaction was found for the percentage of the CFA occupied by distal (F(4,84) = 5.12; p < 0.05) and proximal (F(4,84) = 5.12; p < 0.05) movement representations. Subsequent multiple comparisons (Fisher's PLSD; p < 0.05) showed SRC animals to have a significantly greater proportion of CFA occupied by distal representations (Fig. 3, middle) and a significantly smaller proportion occupied by proximal representations (Fig. 3, right) than URC animals. The data demonstrate that despite significant increases in reaching performance after 3 and 7 d of training, significant map reorganization did not occur until after 10 d of training.
Representative motor maps from SRC and URC animals after 3, 7, and 10 d of training. SRC animals exhibited a significant increase in the proportion of the CFA occupied by distal movement (green) representations in comparison with URC animals after 10 d of training. URC animals had a significantly greater proportion of CFA occupied by proximal movement (blue) than SRC animals after 10 d of training. Vibrissae representations are shown in purple, head/neck representations are shown in yellow, and nonresponse sites are shown in gray. Bregma is indicated by a red line.
Left, Total area of the CFA in SRC and URC animals in the three different training schedules. The mean percentage of the CFA ± SEM occupied by distal (middle) and proximal (right) forelimb movement representations. SRC animals had a significantly greater proportion of the CFA occupied by distal movement representations than the URC animals after 10 d of training (*p < 0.05; Fisher's PLSD). Conversely, URC animals had a significantly greater proportion of the CFA occupied by proximal movement representations than SRC animals after 10 d (*p < 0.05; PLSD).
Synapses per neuron
For each animal, a total of 80 (+8) disector pairs were used to count 124 (+9) neurons through a volume of 2.98 × 106 (+2.11 × 105) μm3 (coefficient of error, 0.064). Approximately 37 (+3) disector pairs were used to count 87 (+4) synapses through volume of 205 (+12) μm3 for each animal (coefficient of error, 0.065). Two-way ANOVA revealed a significant time × condition interaction on neuron density (F(2,39) = 3.29; p < 0.05 and number of synapses per neuron (F(2,39) = 3.83; p < 0.05). Synapse density did significantly differ as a function of condition or time (F(2,39) = 0.91; p > 0.05). Subsequent multiple comparisons (Fisher's PLSD; p < 0.05) showed the SRC animals to have a significantly lower neuron density than URC animals after 7 and 10, but not 3, days (Fig. 4A). Despite the decrease in neuron density, SRC animals maintained synapse density (Fig. 4B), resulting in a significant increase in the number of synapses per neuron after 7 and 10 d of training (Fig. 4C). The decrease in neuron density is attributable to neuropil expansion (resulting from glial and dendritic hypertrophy) rather than a loss of neurons. Thus, the fact that synapse density did not change despite an increase in neuropil volume is consistent with an increase in synapse number that is reflected as an increase in the number of synapses per neuron on days 7 and 10.
Neuron density (Nvneuron) (A), synapse density (Nvsynapse) (B), and number of synapses per neuron (Syn/Neuron) (C) within layer V of the CFA. SRC animals had a significantly lower density of neurons than URC animals after 7 and 10 d of training (*p < 0.05; Fisher's PLSD). No significant differences in synapse density were found between SRC and URC animals in any of the three training schedules. SRC animals had significantly more synapses per neuron than URC animals after 7 and 10 d of training (*p < 0.05; Fisher's PLSD).
Discussion
Understanding the neural mechanisms of learning requires not only identifying those neurobiological changes that occur after learning but also determining how such changes occur during development of the learned behavior. The nature and locus of these changes may vary as a function of time. For example, Rose and colleagues (Clements and Rose, 1996; Rose and Stewart, 1999) have used a chick model of passive avoidance conditioning to show that during learning there are time-dependent shifts in neural activity and neurochemistry that occur across different brain regions. Similarly, time-limited shifts in the role of different thalamic nuclei occur during discriminative avoidance conditioning in rabbits (Hart et al., 1997). Here, we show that reorganization of motor maps and synaptogenesis within the motor cortex during motor skill training does not occur during the initial fast phase of learning but rather during the second, slower phase of learning when the rate of gain of performance is much lower. These data demonstrate that specific forms of learning-dependent neural plasticity can be temporally dissociated from specific learning-dependent changes in behavior.
Synaptogenesis occurs after motor skill acquisition
Dendritic and synaptic hypertrophy within the motor cortex after extensive motor skill training has been well documented (Greenough et al., 1985; Withers and Greenough, 1989; Kleim et al., 1996; Jones et al., 1999). The present results show that during training on a skilled forelimb reaching task, significant increases in synapse number within the motor cortex are not detectable until after significant skill acquisition has occurred. Despite the fact that SRC animals exhibited a significant increase in reaching accuracy after 3 d, the number of synapses per neuron within the motor cortex did not significantly differ from URC animals. This is consistent with previous work showing similar increases in synapse number after extensive training on a more complex motor learning task (Kleim et al., 1996). This may reflect the fact that other motor structures are more critically engaged during the early phase of training or that the changes in the motor cortex during the early phase of learning do not involve synapse formation.
During the initial phases of training, improvements in performance may be supported by plasticity within other motor structures such as the cerebellum or striatum (Ungerleider et al., 2002). Indeed, motor training has been shown to induce synaptogenesis within these brain areas (Black et al., 1990; Comery et al., 1995; Kleim et al., 1997a,b). However, the motor cortex is clearly engaged during the early phase of learning. Significant increases in immediate early gene expression occur during the early stages of motor learning (Kleim et al., 1996), and changes in neuronal ensemble activity within the motor cortex are both observable during the initial training phase and directly predict performance (Laubach et al., 2000). It is also possible that plasticity within the motor cortex during the early phase may not involve increases in synapse number. Such plasticity might include changes in the efficacy of existing synapses (Rioult-Pedotti et al., 1998) or increases in neuronal excitability (Aou et al., 1992).
Motor map reorganization occurs after motor skill acquisition
Despite significant improvements in reaching accuracy after 3 and 7 d of training, significant expansion of distal movement representations within the motor cortex was not detectable until after 10 d of training. Distinct changes in motor cortex activity have been observed after very limited amounts of motor training (Niemann et al., 1991; Karni et al., 1998; Gandolfo et al., 2000), indicating changes in cortical function do occur during the initial learning phase. The changes in neural activity likely reflect the encoding of novel movement patterns (Laubach et al., 2000) and may be supported by changes in synaptic strength (Rioult-Pedotti et al., 1998). However, they do not seem to reflect changes in cortical movement representations. It is possible that subtle changes in map topography occur during the acquisition of skills that are not detectable with the microstimulation techniques used. However, if small changes in map organization occur during the first week of training, they do not parallel the large improvements in reaching accuracy observed within the same time frame.
Reorganization of movement representations has been shown to occur within minutes in response to a variety of manipulations, including blockade of GABA receptors (Jacobs and Donoghue, 1991) and electrical stimulation (Nudo et al., 1990; VandenBerg and Kleim, 2001). Thus, the cortex maintains the capacity for rapid reorganization; yet, here we show that reorganization in response to motor training requires more than one week. It is possible that during the initial training experience, changes in movement representations occur, but do not persist, outside of the training session. Classen et al. (1998) have shown changes in movement representations after a single motor training session that last for several minutes before reverting to the pretraining state. Because the motor maps in the present experiment were derived several hours after training, such transient changes would be missed. Regardless, changes in map topography that endure beyond the training session are not detectable until after 10 d of training.
It is possible is that map reorganization simply requires a sufficient amount of time after the onset of training to be detected. In support of this second interpretation, Galvan and Weinberger (2002) have shown that experience-dependent plasticity within the auditory cortex after a single session of auditory discrimination training induces receptive field reorganization that evolves for several days after training. An additional explanation is that motor map reorganization is related to some change in motor performance other than an increase in movement accuracy. Indeed, the development of accurate movement may then be followed by qualitative changes in movement kinematics associated with movement refinement, the development of which does not affect accuracy. For example, movement sequences may be adapted so as to become more efficient or rapid without significantly affecting accuracy. Motor map reorganization may reflect such changes in performance. Conner et al. (2003) have recently shown that significant improvements in reaching accuracy can occur in the absence of changes in motor map area. The depletion of cortical acetylcholine via immunotoxic lesioning of the nucleus basalis of Meynert significantly impaired, but did not abolish, increases in reaching accuracy. The authors suggest that motor map plasticity may contribute to learning efficiency. If, indeed, motor map reorganization reflected an increase in the capacity for skill learning, then we would expect the plasticity to precede rather than follow the initial rapid increase in reaching accuracy. An alternative explanation is that map reorganization requires not only the acquisition of skilled movement but sufficient repetition of those movements. In support of this idea, we have recently found that removing animals from motor training during the early phase of training, when significant increases in reaching accuracy have occurred, prevented later motor map reorganization. Animals allowed to perform the acquired movements did, however, exhibit motor map reorganization (J.A.K. and T.M.H., unpublished observations).
In conclusion, the present experiment demonstrates that skill learning is associated with synapse formation and motor map reorganization within the motor cortex. However, these changes are not linearly related to improvements in motor performance because they occur during the late, slow phase of learning rather than during the early fast phase. The results demonstrate the temporally dynamic nature of learning-dependent plasticity that occurs within a single brain region during training on a single task and show how different phases of learning may be supported by different forms of plasticity.
Footnotes
This work was supported by the Canadian Institutes of Health Research, the Natural Sciences and Engineering Research Council of Canada, the Alberta Heritage Foundation for Medical Research, and the Canadian Stroke Network. We thank Shannon Gibbs for assistance with animal training as well as Bryan Kolb and Cristina Alberini for thoughtful comments on this manuscript.
Correspondence should be addressed to Dr. Jeffrey A. Kleim, Canadian Centre for Behavioural Neuroscience, Department of Psychology and Neuroscience, University of Lethbridge, 4401 University Drive, Lethbridge, Alberta, Canada T1K 3M4. Email: jeffrey.kleim{at}uleth.ca.
Copyright © 2004 Society for Neuroscience 0270-6474/04/240628-06$15.00/0
