Carroll accepted the affidavit swearing his innocence, later explaining it in great detail to Andrew Johnson. He never returned to the United States. He died in Montreal on May 3, 1868. He is buried in Lenow Circle, Lot 57, Space #1  at Elmwood Cemetery in Memphis, Tennessee.