the population of london became increasingly anxious about it , but duke henry was never to know by what contrivance they were whisked out of sight , or how close to his own home lay the cause of it .