his family , one of the most prominent in baltimore , had made their fortune in banking and were immensely wealthy and clannish , the type of family that sat on the boards of various corporations and instituted policies at country clubs that served to exclude those they regarded as inferior .