That it was owned by Walpole was discovered only about a decade ago when Sir Oliver Miller , a distinguished art historian , found a 1736 inventory of No . 10 Downing Street in a book at the Pierpont Morgan Library in New York .