In his perplexity , he thought of his cosy lumber pile at Roxbury Station and remembered that when he had left the boat he had noticed a large vacant lot near the wharf which was filled with piles of lumber .