During the trial he played in seven youth fixtures and one reserve match for the club and was eventually handed a two and a half year contract at the Priestfield Stadium. After regularly appearing upon the bench, Brown was handed his senior debut on 5 March 2002, where he played the full 90 minutes of a 2–1 victory over Grimsby Town. His performance in the following match, a 0–0 draw with Sheffield Wednesday, saw him named in the Division One team of the week. Brown was voted as Gillingham's player of the year for his performances during the 2005–06 season. The following month, Brown signed for Premier League side Blackburn Rovers on a four-year deal. On 11 September 2010, Brown signed for Leeds United on an initial one-month loan after an injury to Kasper Schmeichel. He made his Leeds debut as a substitute against Ipswich Town on 2 October after Shane Higgs got injured. After such Brown's loan was extended by another month. On 5 October, Brown revealed an interest in joining Leeds on a permanent basis. Brown made his first start for Leeds against Middlesbrough. His loan came to an end on 15 November. On 19 November 2010, Brown signed for Leyton Orient on a one-month loan. On 23 November 2010 he saved an Aaron McLean penalty to help his side secure a 2-2 draw at Peterborough United. On 3 March 2011, he joined Championship side Cardiff City on an emergency loan deal, after injuries to Cardiff's goalkeepers David Marshall and Tom Heaton. The following day, Stephen Bywater also joined on loan, and kept Brown out of the side, but despite not making an appearance during his initial spell, Cardiff decided to extend his loan until the end of the season. On 20 July 2011, Brown joined Scottish Premier League club Aberdeen on a free transfer . Mid-way through the season first-choice goalkeeper David Gonzalez began to fall out of favour with manager Craig Brown, and with Jamie Langfield still recovering from a seizure suffered in the previous season, Brown was handed the starting position on a regular basis. He went on to make a further 24 appearances in the 2011–12 season. In a Scottish Cup quarter-final away to Motherwell, he saved a Michael Higdon penalty as the Dons won 2–1. On 29 January 2013, Brown was released by Aberdeen. Brown joined Ipswich Town on a short-term deal on 28 March 2013. After this, and a short spell with Cambridge United, he next played for Sutton United.