Nonetheless , Edward and Peter , who died in 1996 , were known as the '' other '' -- even '' lesser '' -- Bronfmans , as distinct from the Montreal brothers Edgar and Charles , the sons of Samuel Bronfman , who founded the Seagram distilling empire .