Xavier was born to a poor family in a farm in Pombal, Ritápolis, near São João del Rey, Minas Gerais. He was adopted by his godfather and moved to Vila Rica (now Ouro Preto) after the death of his parents (mother in 1755; father in 1757).[2]