Article Figures & Data
Figures
- Figure 1.
Comparison between responses to rare and frequent presentations. A, Outline of the bimodal oddball test. Each line represents a sample sequence from a single oddball block. Squares designate the auditory stimuli, circles designate the visual stimuli, and filled squares designate the bimodal stimuli. Gray filled shapes specify the peripheral position (Loc 1), and black shapes specify the central position (Loc 2). Bold arrows point to examples of rare occurrences of auditory (blue), visual (red), and bimodal (cyan) stimuli. Light arrows point to corresponding examples of frequent occurrences. B–G, PSTHs of responses to rare occurrences (green lines) are shown together with the corresponding responses to frequent occurrences (blue lines). Responses to the two auditory stimuli are shown in B,C, the two visual stimuli in D,E, and the two bimodal stimuli in F,G. Results from stimuli at the peripheral location are presented on the left, and results from stimuli at the center are presented on the right. Gray filled squares mark stimulus onset and duration. H–K, The PSTHs of responses to the two bimodal stimuli (cyan lines) are overlaid with the PSTHs of responses to their visual (red) and auditory (blue) components. Comparison is performed twice, once for rare occurrences (H, J) and once for frequent occurrences (I, K).
- Figure 2.
Summary of results from all recording sites. A, A scatter plot showing SI1 versus SI2 measured from the responses to the auditory sequences. The dashed lines mark the first quadrant, in which both SIs are positive. The diagonal line marks the nonspecific adaptation line (see Results). B, A histogram showing the distribution of the NIs measured from all auditory oddball tests. The dashed vertical line indicates NI = 0. C, D, Results from all visual oddball tests. E, F, Results from all bimodal oddball tests. Format as in A and B.
- Figure 3.
Interaction between SSA and multisensory integration. A, The difference between the bimodal NI and the visual NI was measured for each site. The histogram shows the distribution of all differences. B, Scatter plot of EIs measured from frequent occurrences (x-axis) versus the corresponding EIs measured from deviant occurrences (y-axis). The diagonal line shows the line of equality.
- Figure 4.
Results from incongruent bimodal oddball tests. A–H, An example from a single recording site. PSTHs of responses to rare occurrences (green lines) are shown together with the corresponding responses to frequent occurrences (blue lines). Results are presented for auditory (A, B), visual (C, D), congruent bimodal (E, F), and incongruent bimodal (G, H) stimuli. Left column shows average responses to the visual stimuli in the peripheral location (Loc 1), and right column shows responses to the visual stimuli in the central location (Loc 2). I, The novelty response of visual (red), congruent bimodal (cyan), and incongruent bimodal (purple) stimulation. J, A histogram showing the distribution of all differences between the congruent bimodal NIs and the visual NIs. K, Same as J but showing results from the incongruent bimodal tests.
- Figure 5.
Comparison between responses to strong and normal visual stimuli. A–D, An example from a single recording site. PSTHs of responses to rare occurrences (green lines) are presented together with the corresponding responses to frequent occurrences (blue lines). Results are presented for normal visual stimulation (A, B) and strong visual stimulation (C, D). E, Scatter plot of EIs (computed as the enhancement of responses to strong visual stimuli over the responses to normal visual stimuli) measured from frequent occurrences (x-axis) versus the corresponding EIs measured from rare occurrences (y-axis). The diagonal line is the line of equality. The inset compares the population average PSTHs for the responses to rare occurrences of the strong visual stimuli (red trace) and the normal visual stimuli (blue trace). F, The distribution of the differences between the NI of the strong visual stimuli and the NI of the normal visual stimuli for all sites. Loc 1, Responses to the visual stimuli in the peripheral location; Loc 2, responses to the visual stimuli in the central location.
- Figure 6.
Schematic representation of the two basic models. A, Visual and auditory inputs are integrated at the first stage. At a later stage, the bimodal responses undergo through an SSA filter. B, Each input channel, auditory or visual, is filtered separately through an SSA channel. The filtered responses are then fed to the multisensory integrator. The bars represent a sequence of frequent events (dark bars) with one rare event (light bar). The height of each bar represents the hypothetical responses at the various stages of the model.
Additional Files
Supplemental Data
Files in this Data Supplement:
- supplemental material - Supplemental Material
