 Brown was educated in South London and at Borough Polytechnic.He served as a councillor on Camberwell Borough Council and was leader of the council.He was the first leader of the London Borough of Southwark from 1964, on which he served as an alderman.