Saccade accuracy is fundamental to clear vision. The brain maintains saccade accuracy by altering commands for saccades that are consistently inaccurate. For example, saccades that consistently overshoot their targets gradually become smaller. The signal that drives the adaptation of saccade size is not well understood. Previous reports propose that corrective movements and visual errors, both generated after inaccurate saccades, could be responsible for a change in saccade size. Here we show that we can elicit normal reductions in saccade size while eliciting few or no correction saccades. These normal reductions in saccade size indicate that visual errors, not correction saccades, drive the adaptation of saccades.