Brown was born in Oberon, New South Wales, one of twins[3] and attended Trunkey Public School, Coffs Harbour High School (1957–60) and Blacktown Boys High School. In his senior year, he was elected school captain.