His compulsion to collect books developed in childhood when he became interested in many of the beautiful, but run-down Victorian homes in St. Paul he walked past on his way to school. Blumberg began removing doorknobs and stained glass windows from the old houses that were slated for destruction as part of a revitalization project in St. Paul. Blumberg amassed hundreds of these items during the course of his collecting years in addition to the books.