born in woodville, south australia to thomas caterer, a pioneer adelaide teacher and mayor of kensington and norwood and marina (née mudie), caterer attended norwood grammar, the school founded by his father, and the then newly opened university of adelaide. in 1879, caterer became the first graduate of the university, with a bachelor of arts. friends and well-wishers attempted to attend the graduation ceremony but were banned from doing so.