 Brown was first elected as Member of Parliament (MP) for Shoreditch and Finsbury at the 1964 general election.In 1966 he was challenged for his seat by the fascist Oswald Mosley, who had been interned without trial during the Second World War.Following boundary changes for the February 1974 election, Brown was elected for Hackney South and Shoreditch.