the dunhams had tolerated elizabeth 's presence while stephen lived , but after his demise following a tragic carriage accident on broad street , elizabeth had packed her belongings , and left her children with their grandmother to be educated as their father had wished .