 As one of the first settlers in Acla, Panama, he became the actuary of the local Spanish administrators.Between 1528 and 1530, Xerez lived in Natá of the Coclé Province as the actuary of governor Pedro de los Ríos.During this last year, when Francisco Pizarro had returned from his interview with King Charles V in Toledo, Spain, Xerez once again joined Pizarro and his followers on their voyage to conquer the Inca Empire.