In 1835, Brown's family was broken apart when they were all sold to different slave owners; Clara was sold to a plantation owner in Kentucky. When Brown was 56 years-of-age, she received her freedom and required by law to leave the state. She worked her way west as a cook and laundress to Denver, Colorado.