Semantic and phonemic fluency tasks are frequently used to test executive functioning, speed and attention, and access to the mental lexicon. In semantic fluency tasks, subjects are required to generate words belonging to a category (e.g., animals) within a limited time window, whereas in phonemic fluency tasks subjects have to generate words starting with a given letter. Anatomical correlates of semantic and phonemic fluency are currently assumed to overlap in left frontal structures, reflecting shared executive processes, and to be distinct in left temporal and right frontal structures, reflecting involvement of distinct memory processes and search strategies. Definite evidence for this assumption is lacking. To further establish the anatomical correlates of semantic and phonemic fluency, we applied assumption-free voxel-based and region-of-interest-based lesion-symptom mapping in 93 patients with ischemic stroke. Fluency was assessed by asking patients to name animals (semantic), and words starting with the letter N and A (phonemic). Our findings indicate that anatomical correlates of semantic and phonemic fluency overlap in the left inferior frontal gyrus and insula, reflecting shared underlying cognitive processes. Phonemic fluency additionally draws on the left rolandic operculum, which might reflect a search through phonological memory, and the middle frontal gyrus. Semantic fluency additionally draws on left medial temporal regions, probably reflecting a search through semantic memory, and the right inferior frontal gyrus, which might reflect the application of a visuospatial mental imagery strategy in semantic fluency. These findings establish shared and distinct anatomical correlates of semantic and phonemic fluency.