In 1837 he was consecrated Bishop of Norwich and appointed Clerk of the Closet, holding both positions until his death. The diocese at this time was conspicuous for laxity and want of discipline, which he proceeded to remedy, although at first he met with much opposition. Ordinations and confirmations were held more regularly and frequently, schools were properly inspected, the Plurality Act, which prohibited the holding of more than one benefice by a clergyman except in certain cases, was enforced, and undesirable clergy were removed.