brooks was born in new bedford, massachusetts, which was an area of the country well-known at the time for providing refuge, resources, education and employment for former slaves. her mother, martha webb, had been a former slave owned by president john tyler. webb was involved with the underground railroad. her daughter went on to develop a "passion for equality" that lasted her entire life.