Astrocytes are increasingly believed to play an important role in neurovascular coupling. Recent in vivo studies have shown that intracellular calcium levels in astrocytes correlate with reactivity in adjacent diving arterioles. However, the hemodynamic response to stimulation involves a complex orchestration of vessel dilations and constrictions that spread rapidly over wide distances. In this work, we study the three-dimensional cytoarchitecture of astrocytes and their interrelations with blood vessels down through layer IV of the mouse somatosensory cortex using in vivo two-photon microscopy. Vessels and astrocytes were visualized through intravenous dextran-conjugated fluorescein and cortically applied sulforhodamine 101 (SR101), respectively. In addition to exploring astrocyte density, vascular proximity, and microvascular density, we found that sheathing of subpial vessels by astrocyte processes was continuous along all capillaries, arterioles, and veins, comprising a highly interconnected pathway through which signals could feasibly be relayed over long distances via gap junctions. An inner SR101-positive sheath noted along pial and diving arterioles was determined to be nonastrocytic, and appears to represent selective SR101 staining of arterial endothelial cells. Our findings underscore the intimate relationship between astrocytes and all cortical blood vessels, and suggest that astrocytes could influence neurovascular regulation at a range of sites, including the capillary bed and pial arterioles.