 In August 1963, Brown joined then non-league Wigan Athletic as player-manager, replacing Johnny Ball.He remained at Wigan until July 1966.In November 1966, he returned to Luton, this time as manager of a side struggling in the Fourth Division.