The face inversion effect (FIE) refers to a disproportionate disruption of the processing of face information by inverting faces. We investigated the FIE in epilepsy patients by simultaneous intracranial and scalp recordings of event-related potentials (ERPs). In scalp recordings, a typical FIE on ERPs was observed with increased latencies and amplitudes of the positive counterpart of the occipito-temporal N170, namely, the vertex positive potential (VPP), in response to inverted faces. Similar amplitude and latency increases were revealed for the intracranial N200 recorded over face-sensitive and non-face-sensitive areas in the lateral occipital cortex, but not in the ventral temporal cortex. Peak latencies did not differ between the scalp VPP and intracranial N200. Findings indicate that the lateral occipital cortex but not the ventral temporal cortex contributes primarily to the FIE observed in scalp recordings.