The shogunate bowed to the pressure and agreed to accept American diplomat Townsend Harris , who established the first US consulate at Gyokusenji temple in Shimoda in 1856 .
There has never been a US consulate in Shimoda .