The former site of Fort Magruder is located about 1.0 miles east of the restored area of Colonial Williamsburg off Penniman Road, which is the James City County-York County boundary line in the immediate vicinity.