tom had gone from london with a party of young men to newmarket , where a neglected fall and a good deal of drinking had brought on a fever ; and when the party broke up , he had been left by himself at the house of one of these young men , with the attendance only of servants .