 On 20 June 1972, Brown became manager of Bury, leading them to twelfth place in Division Four at the end of his first season in charge.The following season, 1973–74, Bury started brightly, and would eventually be promoted in fourth place; Brown, however, had left on 19 November 1973, to manage Nottingham Forest, and took them to seventh place by the end of the season.The following season, Forest started badly and Brown upset the fans by selling Duncan McKenzie to Brian Clough's Leeds United.