Bilateral cochlear implant (CI) users perform poorly on tasks involving interaural time differences (ITD), which are critical for sound localization and speech reception in noise by normal-hearing listeners. ITD perception with bilateral CI is influenced by age at onset of deafness and duration of deafness. We previously showed that ITD coding in the auditory midbrain is degraded in congenitally deaf white cats (DWC) compared to acutely deafened cats (ADC) with normal auditory development (Hancock et al., J. Neurosci, 30:14068). To determine the relative importance of early onset of deafness and prolonged duration of deafness for abnormal ITD coding in DWC, we recorded from single units in the inferior colliculus of cats deafened as adults 6 months prior to experimentation (long-term deafened cats, LTDC) and compared neural ITD coding between the three deafness models. The incidence of ITD-sensitive neurons was similar in both groups with normal auditory development (LTDC and ADC), but significantly diminished in DWC. In contrast, both groups that experienced prolonged deafness (LTDC and DWC) had broad distributions of best ITDs around the midline, unlike the more focused distributions biased toward contralateral-leading ITDs present in both ADC and normal-hearing animals. The lack of contralateral bias in LTDC and DWC results in reduced sensitivity to changes in ITD within the natural range. The finding that early onset of deafness more severely degrades neural ITD coding than prolonged duration of deafness argues for the importance of fitting deaf children with sound processors that provide reliable ITD cues at an early age.