He shared a box at Dodger Stadium with Jack Benny and then with Walter Matthau , traveled the world with the publisher Bennett Cerf , lunched regularly with the director Billy Wilder and had dinner every Christmas for years in the Beverly Hills home of James Stewart .