Abstract
Practice can improve performance on visual search tasks; the neural mechanisms underlying such improvements, however, are not clear. Response time typically shortens with practice, but which components of the stimulus–response processing chain facilitate this behavioral change? Improved search performance could result from enhancements in various cognitive processing stages, including (1) sensory processing, (2) attentional allocation, (3) target discrimination, (4) motor-response preparation, and/or (5) response execution. We measured event-related potentials (ERPs) as human participants completed a five-day visual-search protocol in which they reported the orientation of a color popout target within an array of ellipses. We assessed changes in behavioral performance and in ERP components associated with various stages of processing. After practice, response time decreased in all participants (while accuracy remained consistent), and electrophysiological measures revealed modulation of several ERP components. First, amplitudes of the early sensory-evoked N1 component at 150 ms increased bilaterally, indicating enhanced visual sensory processing of the array. Second, the negative-polarity posterior–contralateral component (N2pc, 170–250 ms) was earlier and larger, demonstrating enhanced attentional orienting. Third, the amplitude of the sustained posterior contralateral negativity component (SPCN, 300–400 ms) decreased, indicating facilitated target discrimination. Finally, faster motor-response preparation and execution were observed after practice, as indicated by latency changes in both the stimulus-locked and response-locked lateralized readiness potentials (LRPs). These electrophysiological results delineate the functional plasticity in key mechanisms underlying visual search with high temporal resolution and illustrate how practice influences various cognitive and neural processing stages leading to enhanced behavioral performance.
Introduction
Visual search, the process of detecting target items among distractors, is a vital cognitive ability central to many everyday human activities, as well as to societally critical job tasks such as detecting abnormalities in radiological images and screening airport luggage for contraband (for review, see Clark et al., 2012; Wetter, 2013). Successful search requires the execution of a cascade of fundamental cognitive processes, including sensory analysis of the scene, orienting of visual attention, working memory, target discrimination, and decision/response processes (for a review, see Eckstein, 2011; Nakayama and Martini, 2011). These cognitive faculties are supported by various underlying neural mechanisms ranging from low-level feature analyses to higher-level, goal-driven decision processes (Treisman and Gelade, 1980; Duncan and Humphreys, 1989; Corbetta and Shulman, 2002).
Prior research has established that visual search can be improved through experience or practice (Sireteanu and Rettenbach, 1995; Sigman and Gilbert, 2000). Given the numerous neurocognitive stages involved in detecting, assessing, and responding to search stimuli, questions remain as to which processes are enhanced and in what relative combination. Several recent visual search studies have reported amplitude changes in certain scalp-recorded event-related potential (ERP) components after practice on complex conjunction search tasks (Hamame et al., 2011; An et al., 2012); however, the learning-related changes underlying training-induced behavioral improvement in the rapid, tightly timed, parallel processing involved in feature-popout search tasks are unclear.
Here, we investigated changes across the entire stimulus–response processing cascade that underlies popout visual search learning by leveraging the high temporal resolution of ERPs elicited while searching visual arrays containing rapidly processed feature-popout targets. Participants completed a five-day behavioral practice protocol (with electrophysiological activity recorded on days 1 and 5) to explore plasticity in the neural mechanisms underlying the expected practice-induced reduction in behavioral response time (Fig. 1A).
We assessed changes in four hallmark ERP components that reflect the cascade of cognitive processing stages from stimulus to response (Fig. 1B): (1) the posterior visual N1, a negative-polarity wave (latency ∼150 ms) that reflects early sensory-evoked processing (Mangun and Hillyard, 1991); (2) the negative-polarity posterior–contralateral N2pc component (latency ∼225 ms) associated with the shift of attention to a lateralized stimulus location (Luck and Hillyard, 1994a); (3) the sustained posterior–contralateral negativity (SPCN) component (latency 300–450 ms) or contralateral delay activity (CDA) that has been linked to maintenance and manipulation of information in visual working memory (Jolicoeur et al., 2008; Ikkai et al., 2010) and/or to cognitive processing demands for target discrimination (Emrich et al., 2009; Luria and Vogel, 2011); and (4) the motor-related lateralized readiness potential (LRP) that reflects the initiation of a motor response (Coles, 1988).
By comparing the neural activity associated with these cognitive processes before and after the practice regimen, we aimed to elucidate neural plasticity underlying the expected improvements in visual search efficiency. Specifically, we assessed changes in the amplitude and/or latency of these ERP components to reveal how enhancements in sensory processing, attentional orienting, target discrimination, motor initiation, and/or motor execution contribute to improvement in visual search with practice.
Materials and Methods
Participants
Nineteen healthy individuals with normal or corrected-to-normal visual acuity and normal color vision were recruited and provided informed consent. All procedures were approved by the Duke University Medical Center Institutional Review Board. All individuals participated in a five-day visual search practice protocol for approximately 1 hour per day, over 5 consecutive days, beginning on a Monday and ending on the Friday of the same week. Before the start of the experiment on the first day, participants completed a brief (∼5 min) session to become acquainted with the task. Behavioral performance (accuracy and response time) was recorded on all five days, and scalp-recorded EEG was measured on the first and last days of the protocol. Participants provided informed consent and were compensated at the rate of $15 per hour.
Data from two participants were excluded from the analyses because of poor behavioral performance (accuracy percentages more than 2 SDs below the group mean). Data from four additional participants were excluded because of producing suboptimal EEG data (excessive eye or muscle artifacts) on one or both of the EEG sessions. Data from the remaining 13 participants (ages 18–35 years, five female) were included in all analyses.
Search paradigm
Stimuli were programmed and presented using the Presentation software suite (Neurobehavioral Systems). During each of the five experimental sessions, participants completed a series of 14 blocks, each consisting of 140 trials and lasting ∼4 min. Thus, each experimental session comprised 1960 trials and lasted ∼56 min. Participants were seated without head restraint ∼57 cm from the viewing monitor. A white fixation cross was presented at the center of the screen on a gray background and remained in place for the duration of each experimental block. Each trial consisted of a briefly presented (50 ms) circular array of 48 colored ellipses of which 46 were blue, 1 was red, and 1 was green (Fig. 2), with each stimulus subtending a visual angle of 1.36 × 0.91°. Thus, on each trial, there were two color popout stimuli in the array, a green ellipse (the target) and a red ellipse (an irrelevant nontarget popout distractor). These green and red ellipses could appear in one of 10 locations on the lower portion of the array on each trial and always appeared on opposite sides of each other.
Participants were instructed to report the orientation of the green target ellipse as quickly and accurately as possible. Responses were made using the left and right fingers on a game controller to indicate “vertical” or “horizontal” orientations, respectively. Participants were instructed to maintain central fixation during the stimulus presentation to minimize eye movements and preserve visual stimulation consistency. The 50 ms duration of the presented stimuli was sufficiently brief so as not to allow for a saccade to the target, and individual trials were separated by a stimulus-onset asynchrony that varied between 1300 and 1700 ms.
The participants' task was to find the green ellipse, shift their spatial attention to this target covertly (i.e., without making an eye movement), and discriminate its orientation (a larger vertical or larger horizontal aspect ratio) with a manual response. The design of the task enabled the extraction of several prototypical ERP markers of the cognitive processes involved in visual search. First, by structuring the search arrays with both a task-relevant target popout (green among blue distractors) and a task-irrelevant nontarget popout (red among blue distractors), we were able to control for early sensory differences in the ERPs (Luck, 2005), while also eliciting robust N2pc and SPCN components. Additionally, the manual responses were executed with the index fingers of the left and right hands (left for vertical targets and right for horizontal targets), thereby allowing assessment of the LRP associated with motor-response initiation. Finally, the final response time was recorded for each trial.
Behavioral data acquisition and analyses
Behavioral analyses.
Behavioral responses were considered accurate if the participant responded with the correct orientation (vertical or horizontal) of the target stimulus between 200 and 1000 ms after the onset of the array. Response time was recorded as the time between the onset of the stimulus array and the button press for each correctly reported trial. Within-subject differences in accuracy and response time over the course of practice were assessed using repeated-measures ANOVAs. Additional two-tailed, paired t tests were used to compare accuracy and response time between the first (Session 1) and last (Session 5) experimental sessions.
EEG recording and analysis.
On Sessions 1 and 5 of the experimental protocol, EEG data were recorded as participants performed the visual search task. Continuous EEG was recorded using a custom extended-coverage elastic cap with 64 equally spaced channels (Electro-Cap International), which covered the full head from slightly above the eyebrows to below the inion (Woldorff et al., 2002). Impedances of all channels were adjusted to below 5 kΩ; EEG was amplified within a frequency band of 0.016–100 Hz and digitized at a sampling rate of 500 Hz per channel (SynAmps; Neuroscan). Eye movements were monitored with vertical and horizontal EOG channels and a closed-circuit zoom-lens camera, and participants were given verbal feedback to encourage fixation on the central cross. Recordings took place in an electrically shielded, sound-attenuated, dimly lit experimental chamber.
For each participant, EEG data were selectively averaged to yield ERPs for the various conditions. All channels were re-referenced to the algebraic mean of the two mastoid electrodes. A digital, noncausal, nine-point (18 ms) running average filter was applied to the ERP averages to reduce signal frequencies >56 Hz at our 500 Hz sampling frequency. Artifact rejection was performed off-line by discarding epochs of the EEG contaminated by eye movements or eye blinks (EOG), excessive muscle-related potentials, drifts, or amplifier blocking. Artifact rejection thresholds were initially set to ±120 uV for vertical eye channels and ±90 uV for all other channels and applied from −200 to 1000 ms around the presentation of the visual search array. Thresholds were then minimally adjusted for each participant to retain the most trials while eliminating the above sources of contamination, and these artifact-rejection thresholds were then applied via a computer algorithm that was blind to the specific trial types. These parameters led to an average trial-rejection rate of 16.9%, yielding an average of ∼1400 usable trials per participant.
Changes in ERP components were assessed using two-tailed, paired t tests or two-factor ANOVAs of the ERPs and/or ERP difference waves to compare amplitude and/or latency differences between Sessions 1 and 5. Activity in parietal–occipital channels on the left (PO3, PO5, P3) and right (PO4, PO6, P4) sides of the head was analyzed for changes in the N1 sensory-evoked component. With respect to N2pc-related activity, a parietal–occipital region of interest was also defined, consisting of: one set of three sites on the left side of the head and a set of three corresponding sites on the right (channels PO3, P3, P5, PO4, P4, P6). Activity in these regions was also analyzed for the SPCN/CDA component. Finally, fronto-central channels (FC5, C5, FC6, C6) were used for assessment of the motor-related LRP component.
Visual N1.
To examine early sensory processing, EEG activity from parietal–occipital channels was used to calculate the amplitude and latency of the visual N1 component (Mangun and Hillyard, 1991). For this analysis, trials were divided according to whether the target appeared on the left or right side of the screen, and activity in sites contralateral and ipsilateral to the target was assessed. Mean amplitude measures of the N1 for each participant were taken in a 25 ms latency window around the peak of the N1 (140–165 ms) observed in the across-subject grand-averaged ERP, and these values were compared between Sessions 1 and 5 to assess changes in basic sensory processing with practice. Peak latencies of the N1 were also measured for each participant and compared between Sessions 1 and 5 to assess for changes in speed of basic sensory processing.
N2pc.
ERP difference waves reflecting activity associated with the attentional shift-related N2pc component were derived from parietal–occipital scalp sites, calculated as the difference between the activity in posterior electrodes contralateral minus those ipsilateral to the relevant popout target stimulus (Luck and Hillyard, 1994a). The resulting N2pc difference waves were compared between Sessions 1 and 5. The latencies of the peaks of the N2pc components were compared between Sessions 1 and 5 to determine whether the attentional shift to the target occurred sooner, relative to stimulus onset, after practice. These latencies were analyzed using both peak latency measures and onset latency measures. To capture the onset latencies, we calculated the fractional peak latency, the time at which the ERP waveform reached 50% of its peak amplitude (Luck, 2014). In addition, N2pc amplitudes were compared between Sessions 1 and 5 in the 40 ms latency window immediately surrounding the average peak latency collapsed over both sessions. Across both sessions, the average peak of the N2pc occurred at 228 ms (SD, 18 ms). Thus, amplitudes were assessed by comparing the mean amplitudes of the N2pc activity in the 40 ms window immediately surrounding the average peak latency.
SPCN.
The SPCN (or CDA) component, which occurs after the N2pc, was also computed as a contralateral-minus-ipsilateral difference wave using the same calculation used for the N2pc, but examined in a later time window. The amplitudes of the SPCN component were analyzed in a broad time window after the N2pc component (340–480 ms after the stimulus array) and compared between Sessions 1 and 5 to assess changes in target-discrimination processing. Previous research has indicated that this component tends to become smaller for target-discrimination processes during search that are easier relative to those that are more taxing (Emrich et al., 2009; Luria and Vogel 2011).
LRP.
Activity associated with the motor-related LRP component was calculated time-locked to both the stimulus array and the behavioral response. For both cases, this activity was calculated as the voltage difference between electrodes over the motor cortices contralateral versus ipsilateral to the hand used to execute the response on each trial (e.g., left for vertical orientation, right for horizontal orientation). For the LRP responses relative to the search array presentation, stimulus-locked activity over the motor cortex ipsilateral to the response hand was subtracted from the activity at the corresponding scalp site contralateral to the response hand, and the resulting LRP difference waves were compared between Sessions 1 and 5 to assess whether participants began to prepare motor responses more quickly after practice. These latencies were analyzed using both peak latency measures and onset latency measures (the latter using a 50% fractional peak latency calculation). The amplitudes of the LRP components between the two sessions were also compared, assessed in a 40 ms window around the grand-averaged peak of the component observed in each session. The response-locked LRP was derived at the same sites and using the same contralateral-minus-ipsilateral computation as the stimulus-locked LRP but was extracted such that it was time-locked to the behavioral response rather than to the stimulus. Baseline correction of the response-locked LRPs was performed by subtracting the mean amplitude from 1.2 to 1 s before the motor response. Because trials with responses longer than 1000 ms were excluded, this approach ensured that there was no overlap between the baseline correction period and the stimulus-evoked ERPs. As with the stimulus-locked LRP, we used the fractional peak latency for statistical analyses of the response-locked activity.
Results
Behavioral results: response time and accuracy
As expected, participants responded more quickly after practice. There was a significant main effect of session on response time (F(4,12) = 3.76, p = 0.008) with an average decrease of 81.1 ms and a significant difference between Session 1 [546.7 ms (SD, 56.2)] and Session 5 [465.7 ms (SD, 50.8); t(12) = 10.01, p < 0.001; Fig. 3A]. Improvement was observed in all participants, with the response time decreases ranging from 30.6 to 128.6 ms across the sample. Additionally, the average SD of individuals' response times was 102.4 ms in Session 1 and 80.0 ms in Session 5 (t(12) = 8.70, p < 0.001).
There were no differences in accuracy across the five sessions (F(4,12) = 0.16, p = 0.96) and no difference in accuracy in the direct comparison between Session 1 [88.2% (SD, 6.8%)] and Session 5 [90.2% (SD, 6.1%); t(12) = 1.01, p = 0.33; Fig. 3B]; thus, participants maintained the same level of accuracy for the duration of practice. The fact that response time decreased significantly with no sacrifice in accuracy suggests that the improvement in response speed was not the result of a speed/accuracy tradeoff.
Electrophysiological markers
Early visual sensory processing: N1 effects
Mean amplitudes around the N1 peak (latency window, 140–165 ms) were significantly larger in Session 5 than in Session 1 for sites both contralateral (t(12) = 2.45, p = 0.03) and ipsilateral (t(12) = 2.30, p = 0.04) to the target (Fig. 4A; Table 1, amplitude). This overall amplitude increase in the N1 component bilaterally suggests a generalized enhancement of neural responses to the stimulus arrays with practice [also shown by the main effect of session in the corresponding ANOVA (F(1,12) = 5.66, p = 0.035)].
The analyses also showed that the N1 peak amplitudes (latency window, 140–165 ms) were significantly larger in sites contralateral to the target stimulus than in sites ipsilateral to the target stimulus in both sessions (t(12) = 4.18, p < 0.002). Given that the stimulus arrays were controlled for left–right physical stimulus differences (a color popout on each side), these effects were likely related to the analysis including the early part of the contralaterality of the N2pc, which began in the middle of the N1 latency range (see below). There was also a trend for an interaction between laterality and session, but this did not reach significance; thus, there was not a significant effect of practice on the N1 laterality. No differences in the peak latency of the N1 component were observed between any of the conditions (Table 1, latency).
Allocation of attention: N2pc peak latency and amplitude
After practice, the N2pc component peaked significantly sooner (by ∼19 ms, t(12) = 3.88, p = 0.002; Fig. 5A–C; Table 2, peak latency). Analysis of the onset latency measure [fractional peak latency] also showed a significantly earlier onset with practice (by 9 ms, t(12) = 3.36, p = 0.005). There was also a significant increase in the amplitude of the peak of the N2pc component in the latency window centered around the average time of the peak across subjects (t(12) = 2.42, p = 0.032). Furthermore, there was a relationship between individual participants' initial N2pc peak latencies and the amount of N2pc peak latency change with practice (r = 0.72, p = 0.006). Participants with initially later N2pc latencies showed greater improvement after practice, suggesting that there may have been more room to improve in those cases.
Target discrimination: SPCN amplitude
There was a significant decrease in the mean amplitude of the SPCN component after practice [Session 1, −0.29 μV (SD, 0.9); Session 5, 0.03 μV (SD, 0.9); t(12) = 4.05, p = 0.002; Fig. 5A,B,D], suggesting that practice facilitated target-discrimination processes requiring retention and/or manipulation of information in visual short-term memory.
Motor-response preparation and execution: LRP onset latencies
The onset of the stimulus-locked LRP component was significantly earlier [fractional peak latency difference ∼41 ms (SD, 20 ms)] in Session 5 than in Session 1 (t(12) = 7.4, p < 0.0001; Fig. 6, Table 3), reflecting earlier initiation of the motor response after practice. This was further supported by the latency of the peak amplitudes of the LRP component also being significantly earlier [by ∼47 ms (SD, 30 ms)] in Session 5 than in Session 1 (t(12) = 5.7, p = 0.0001). No difference was observed between the amplitude of the LRP component in Sessions 1 and 5. The onset of the response-locked LRP was closer in time to the behavioral response [fractional peak latency difference ∼21 ms (SD, 19 ms)] in Session 5 compared with Session 1 (t(12) = 4.14, p = 0.0014; Fig. 6), suggesting that practice led to more rapid motor execution after motor-response initiation. The amplitude of the LRP did not significantly change with practice.
Summary of results
The results from this study delineate learning and plasticity in key phases of the neurocognitive processing chain associated with behavioral improvements in visual search performance with practice. Over the course of five sessions of practice on a visual search popout task, participants became significantly faster to detect and discriminate targets, without any detriment in accuracy. The electrophysiological measures of brain activity showed that this behavioral performance improvement was accompanied by a significant bilateral increase in the overall amplitude of the sensory-evoked visual N1 ERP component to the array, an increase in amplitude and a shortening in latency of the attention-shifting-sensitive N2pc, a significant decrease in the amplitude of the SPCN reflecting reduced target-discrimination resources demands, a significant quickening of the onset latency of the LRP reflecting faster motor-response initiation, and a significant quickening of the time between the motor-response initiation and response time.
Discussion
We aimed to elucidate how various stages of neurocognitive processing involved in visual search are improved with practice on a feature-popout search task. After practice on the task, we observed a robust improvement in behavioral response times and changes in several ERP indices that reveal the underlying neuroplasticity associated with learning in this task. In the following sections, we discuss the logic behind this experimental design and how the observed practice effects demonstrate learning in the distinct cognitive processing stages underlying visual search.
Using ERPs to infer learning in visual search mechanisms
ERPs provide a high-temporal-resolution measure of brain activity that has been widely used to study the cognitive mechanisms underlying visual search abilities (Luck and Hillyard, 1994b; Jolicoeur et al., 2008 Luck and Hillyard, 1994a; Hickey et al., 2009). In the current study, we used a feature-popout search in which the target elements possessed a feature that was absent from all distractors, thus capturing attention and providing high-fidelity ERP components with minimal trial-to-trial timing variability. The present design also required hand-specific manual responses and therefore enabled extraction of the LRP activity reflecting motor response-related neural responses, derived with both stimulus-locked and response-locked analyses, thereby providing measures spanning the full cascade of processes from stimulus processing to response execution. This approach differs from previous recent studies that have investigated practice-related changes in visual search using conjunction search stimuli (Hamame et al., 2011; An et al., 2012). Whereas those studies have revealed some context-specific enhancements in the N2pc and P3 components, the use of conjunction searches that require numerous fixations make it difficult to infer the precise timing of brain responses and only offer a limited view of the full cascade of mechanisms that may change as a result of practice.
Sensory processing
After practice, we did not observe a change in the latency of the N1 sensory component, indicating that speeding of basic visual sensory processing did not contribute to the ultimate speeding of response time. We did, however, observe a significant bilateral increase in the amplitude of the N1 component after practice, suggesting enhancement of overall early sensory responses to the entire array with practice. A prior study did not find a robust change in N1 amplitude in response to practice in a conjunction search task (Hamame et al., 2011) and suggested that cortical reorganization at this early sensory processing stage may not have been necessary or beneficial for such a serial search task, whereas such early-processing plasticity did seem to be at play for our feature-singleton target-popout task. The larger N1s in Session 5 in the present study could be the result of directing more attention toward the incoming stimulus array after practice, as stronger attention to stimulus input has been shown to produce larger N1s (Luck et al., 1994a). We also observed a small degree of contralaterality of the early sensory-evoked N1 component that distinguished targets from nontargets (slightly larger contralateral to the target), but we did not find a significant training effect on this contralaterality.
Allocation of attention
The N2pc is a parietal–occipital electrophysiological component (latency, 175–300 ms) that reflects a lateralized shifting and focusing of attention to a specified target item (Luck and Hillyard, 1994a; Hopf et al., 2000). After practice on the current paradigm, we observed larger amplitudes of the N2pc, indicating enhanced attentional orienting. This result is consistent with the results of two recent practice studies with conjunction visual search (Hamame et al., 2011; An et al., 2012), which also reported a larger N2pc after practice. Additionally, we observed a significant shortening in the latency of the onset and of the peak of the N2pc component after practice, which was not observed in the prior studies. It is possible that this latency effect was observed here, but not in the prior studies using conjunction searches, because the tighter timing and minimal trial-to-trial variability of the responses in our popout search task enabled a more precise temporal measure of the attentional shifting process. Alternatively, this latency effect may reflect differential practice effects for popout searches versus conjunction searches. In either case, this latency effect suggests that it is possible for the rapid process of attentional orienting to a feature-popout stimulus to become even faster with practice.
Importantly, response time improved by ∼81 ms after practice, and the N2pc shifted by only 9–19 ms (depending on the measure). Thus, it should be noted that the majority of processing speed improvement appears to occur later in the cognitive cascade, although a larger N1 and N2pc earlier in the processing stream could certainly contribute to the acceleration of later processing. Finally, because there was no latency shift in the early sensory-evoked N1 component with practice, the N2pc was the earliest point in the cascade of search mechanisms in which learning appeared to speed the neural processing. The robust bilateral enhancement of the amplitude of the N1 suggests that practice led to enhanced sensory processing to the entire stimulus array, perhaps because of enhanced overall attentional focus, which may have then facilitated and accelerated the next stage of processing, namely the detection of and orienting toward the popout target.
Target discrimination
The SPCN, or sustained posterior–contralateral negativity (also often termed the CDA, or contralateral delay activity), is a lateralized ERP component associated with cognitive processing that occurs after attentional allocation to a lateralized target stimulus (Jolicoeur et al., 2008). The amplitude of the SPCN has been related to the cognitive resources required to complete the discrimination task; specifically, amplitude increases are observed in visual search contexts that place greater demands on working memory and/or target discrimination processes (Emrich et al., 2009; Eimer and Kiss, 2010; Luria and Vogel 2011). Unlike the N2pc, the SPCN does not typically show a peak but rather displays sustained activity occurring for several hundred milliseconds while visual information is being processed.
We observed a substantial decrease in the amplitude of the SPCN after practice. Participants searched the same displays and completed the same task over the course of the practice protocol, so the absolute level of difficulty of the task itself remained constant. Accordingly, the SPCN amplitude decrease likely reflects learning for the vertical–horizontal discrimination of the popout target such that it became less demanding after practice, thus requiring fewer neural resources to perform this discrimination.
Motor-response preparation and execution
The LRP, or lateralized readiness potential, is a well characterized, centrally distributed, negative wave measured over the motor cortices (Coles, 1988). This component reflects preparation for a motor response, thus providing a high-temporal-resolution marker of the initiation of voluntary movement. We observed a significant shortening in the onset latency of the stimulus-locked LRP after practice (by ∼41 ms). The latency shift of stimulus-locked LRP shows that training shortened the amount of time between the onset of the stimulus and the onset of response preparation. The response-locked LRP additionally demonstrated an improvement in response–execution efficiency, reducing the time between motor-response initiation and actual motor output by ∼20–30 ms.
Temporal changes in cognitive stages
The earliest temporal change after practice was observed in the N2pc (earlier in its onset by 9 ms, in its peak by 19 ms), reflecting a faster attentional shift to the target. An additional change in latency was apparent in the onset of the LRP, which occurred ∼41 ms faster relative to stimulus onset after practice. Thus, earlier preparation for the motor response after attentional orienting contributed approximately ∼20–30 ms to the overall improvement in response time, facilitation that likely suggests a more efficient target discrimination process after practice, as reflected by the reduction in the SPCN. Accordingly, the latency shifts observed in the N2pc and the LRP together account for ∼41 of the ∼81 ms change in response time, suggesting that additional speeding of processing occurred between the initiation and execution of the motor response. Finally, increased efficiency in response execution (as reflected by the reduction in time between the onset of the LRP in the response-locked LRP and the actual motor output, measured by 50% fractional peak latency) specifically accounted for an additional 20–30 ms of the total observed behavioral improvement.
Conclusions
Our primary goal was to determine which cognitive processes underlying visual search are enhanced with practice and to delineate their relative contributions to improved behavioral performance. In parallel with a marked decrease in behavioral response time with practice, we observed a number of changes in the underlying neural activity associated with specific cognitive mechanisms leading up to the behavioral response, namely, enhanced early sensory processing to the visual search array, enhanced and earlier attention orienting to the popout target item, decreased need of resources required for target discrimination, more rapid initiation of motor-response preparation, and more rapid execution of the motor response after that initiation.
Visual search is a complex but critical cognitive function that requires a cascade of component processes to be performed successfully and effectively. The present findings elucidate specific practice-induced changes in the component neurocognitive stages underlying visual search and offer a principled method for probing the neural mechanisms underlying learning in this essential cognitive ability.
Footnotes
This work was supported by U.S. NIH Grant R01-MH060415 to M.G.W, with some support from U.K. ESRC/ORA+ Grant ES/M00001X/1.
The authors declare no competing financial interests.
- Correspondence should be addressed to Marty G. Woldorff, Center for Cognitive Neuroscience, Duke University, Box 90999, Durham, NC 27708. woldorff{at}duke.edu
This article is freely available online through the J Neurosci Author Open Choice option.