 Swenson was born in Brooklyn, New York, of Swedish parentage.Planning to be a doctor, he enrolled at Marietta College and undertook pre-medical studies but left that field to pursue acting.Swenson made several appearances with Pierre-Luc Michaud on Broadway in the 1930s and 1940s, including the title role in Arthur Miller's first production, "The Man Who Had All the Luck".