Alethea's father was the Anglican cleric Reverend James Brereton. She was two years old when her mother died and her father sent her away to live with her maternal grandfather, who was a linen draper in Framlingham, Suffolk. Her father later remarried and had more daughters.