By the end of 1975, Lewis' image was badly damaged and he soon lost the confidence of his party. Sentiment was growing in favour of replacing him with Sir Eric Willis. At a caucus meeting on 20 January 1976, parliamentary backbencher Neil Pickard called a spill motion, which was carried 22 votes to 11. Lewis opted not to try to regain his post, leaving Willis to take the leadership unopposed. Lewis's term as Premier came to an end on 23 January 1976, his 54th birthday. Lewis was the only non-elected non-Labor premier who did not take the Coalition into an election. Lewis served as Willis' Minister for Local Government until May 1976, when the Liberal Government was narrowly defeated by the Labor Party. In opposition Lewis did not hold any position within the Shadow Cabinet and later resigned from Parliament on 7 September 1978, the vacancy becoming one of the justifications for calling the election for 7 October 1978. At the election, his seat fell to the Labor candidate Bill Knott. On his departure from parliament, he was permitted by Queen Elizabeth II, on the Governor's recommendation, to continue to use the title "The Honourable". He was made an Officer of the Order of Australia on 26 January 2000 ""For service to the Parliament of New South Wales, to the environment as the founder of the National Parks and Wildlife Service of New South Wales, and to the community"". On 1 January 2001 he was awarded the Centenary Medal. Lewis died on 25 April 2016, aged 94.