In 1963 he said, "I'm happy. I'm doing what I want". In a 1992 interview, McCallister said, "Being a movie star was great, but I never considered doing it for a lifetime. I wanted to be myself, to go where I pleased without causing a traffic jam. I've succeeded in this, and I'm happy". He was a long time romantic partner of fellow actor William Eythe, up until Eythe's death in 1957. McCallister died from congestive heart failure at the age of 82.