The two young men grew up with their respective families in the affluent Kenwood neighborhood on Chicago's South Side. The Loebs owned a summer estate, now called Castle Farms, in Charlevoix, Michigan, in addition to their mansion in Kenwood, two blocks from the Leopold home.