Human lesion data have indicated that the frontal polar area might be critically involved in having an insight into one's future. Retrospective memory mediated by medial temporal lobes and related structures, on the other hand, could be used to extract one's future prospects efficiently. In the present study, we investigated the roles of these two brain structures in thinking of the future and past by using positron emission tomography (PET) and a naturalistic task setting. We measured regional cerebral blood flow (rCBF) in healthy subjects while they were talking about their future prospects or past experiences, with regard to two different temporal windows (in years or days). Many areas in the frontal and the medial temporal lobes were activated during the future and past tasks compared with a control task requiring semantic retrieval. Among these, areas in anteromedial frontal pole showed greater activation during the future tasks than during the past tasks, showing significant effect of temporal distance from the present. Most areas in the medial temporal lobes showed greater or equivalent level of activations during the future tasks compared with the past tasks. The present results suggest that thinking of the future is closely related to retrospective memory, but that specific areas in the frontal pole and the medial temporal lobes are more involved with thinking of the future than that of the past.