 Sully was the son of the portrait painter, Thomas Sully, of Pennsylvania.Alfred Sully graduated from West Point in 1841.During and after the American Civil War, Sully served in the Plains States and was widely regarded as an Indian fighter.