 Brown's final two games came in the finals against Austria and Uruguay.Brown moved to Luton Town in February 1957, for a fee of £8,000, scoring on his league debut at Leeds.He scored five goals in the Hatters' successful 1958–59 FA Cup run, including scoring the only goal in their sixth-round victory over his former club, Blackpool.