 His second wife Cleora C. Thomas bore 9 children, two of which died as infants.In his last days, Gilmer traveled to San Antonio due to health reasons before making his last business trip to New York City where he died in 1906.At the time of his death, he was the second wealthiest man in Orange, Texas.