 In November 1905, he was awarded the Grand Cordon of the Order of the Rising Sun.After the Russo-Japanese War, Inoue was elevated to "shishaku" (viscount) on 21 September 1907, and to the largely ceremonial rank of Fleet Admiral on his retirement on 31 October 1911.After retirement, Inoue continued to exert an influence on naval policy, and was a strong proponent of the occupation and annexation of the Caroline Islands during World War I 

Inoue died in 1929.