In 1949, after purchasing 5 acres of vacant land in the Holmby Hills neighborhood of Los Angeles, he started construction on a new residence for himself and his family, and on the elaborate 7.25in gauge ridable miniature Carolwood Pacific Railroad behind it.