 Xerez did not have the same luck back in his native Seville, and soon became broke after various unsuccessful businesses.Towards the end of the 1540s his situation aggravated, prompting him to change his name to Francisco López de Xerez.No details of Xerez are known following these years, although some authors claim he went bankrupt and eventually returned with his family to Peru until he died.