he also noted three men by the door , slightly aside from the rest , who , for some reason he could not put his finger on , appeared to him sinister , perhaps because they seemed to make an effort not to .