he wore an old smoking jacket with the belt askew , an open-throated white shirt , and a pair of rough serge pants that would have looked more at home upon the legs of a itinerant gardener than upon those of the richest man in little dunthorpe .