robert was one of three sons born in cheshire to robert hibbert and margaret tetlow. his younger brother thomas hibbert (1710–1780) was the first family member to develop the family business interests in jamaica, which included slave trading and sugar plantations. his other brother john (1732–1769) also lived in jamaica, from 1754 until his death.