Material‐specific memory impairments are a well-established consequence of unilateral medial temporal lobe damage. We used fMRI to investigate encoding and recognition of verbal and nonverbal stimuli using adaptations of tasks used successfully in clinical evaluations of patients with temporal lobe epilepsy (TLE). We studied two patient groups, one with left TLE and one with right TLE, and one group of healthy subjects. Results from the healthy subjects indicated that initial and delayed recognition trials of the verbal task activated the left medial temporal lobe, and the same tasks of the nonverbal task activated the right, confirming the sensitivity to laterality of our clinical tasks. Patients tended to use the opposite hippocampus, but often the parahippocampal gyrus on the same side, compared to the healthy subjects. Since our patients and the healthy groups performed similarly on the memory tasks, we conclude that the patients' activation patterns represent an effective adaptation to the presence of an unhealthy hippocampus.