The shogunate bowed to the pressure and agreed to accept American diplomat Townsend Harris , who established the first US consulate at Gyokusenji temple in Shimoda in 1856 .
In the mid-19th century , the first US consulate was set up in Shimoda .