 His sister, Grace Dyer Taylor died of meningitis the first year.When he was six the family was nearly killed by a rioting mob during the Yangzhou riot in 1868.Finally in 1870 he was sent home with his surviving siblings with Emily Blatchley to live in London, separated from his parents.