After getting hit by some unknown force, Joe stops and watches. Maybe there was something he couldn't see messing with him, or there was some trick to getting to the tower. He thought maybe he would just watch the others try, or maybe that elf would shed some light on the situation. He was the one who told them to head to the tower after all.