In this capacity, he was persuaded by railway engineer Roland Brotherhood to relax the bank's conditions on his overdraft in return for help in getting Goldney re-elected in the forthcoming election; Goldney, having been re-elected, then advised the bank that the conditions could be relaxed. However, shortly after this, in 1869, the bank changed its mind, and Brotherhood's enterprise failed; Brotherhood blamed Goldney for this. Goldney was appointed a Deputy Lieutenant of Wiltshire on 22 February 1869. The position of Bailiff of Chippenham passed down to Goldney; he was also a Freemason, holding the office of Grand Warden of England. He was created Baronet Goldney of Beechfield in the parish of Corsham, and Bradenstoke Abbey in the parish of Lyneham on 30 April 1880. He died at Eaton Place, Belgravia, London on 8 May 1900, and the baronetcy passed to his first son, Gabriel Prior Goldney. Goldney is commemorated in stained-glass windows of Chippenham parish church, The Foundling Hospital, London and in the name of Goldney Avenue, Chippenham.