The idea is that backwards time travel is impossible because if it occurred, time travellers would attempt to do things such as kill their younger selves (or their grandfathers etc.). We know that doing these things—indeed, changing the past in any way—is impossible. But were there time travel, there would then be nothing left to stop these things happening. If we let things get to the stage where the time traveller is facing Grandfather with a loaded weapon, then there is nothing left to prevent the impossible from occurring. So we must draw the line earlier: it must be impossible for someone to get into this situation at all; that is, backwards time travel must be impossible.