Harlem Plantation House is located on Louisiana Highway 39 between Davant and Phoenix, Plaquemines Parish, Louisiana, on the east bank of the Mississippi River about 5 miles upriver from Pointe à la Hache, Louisiana.