he remembered hearing that they , together with similar houses on upper main street , were the homes of the capitalists and their top boys who ran the textile mills in the heyday of expansion during the nineteenth and early twentieth centuries .