it is the same problem with time travel. the whole earth, solar system, galaxies are spinning, what will be your reference point in spacetime. it is incrediblely complicated to time travel to a specific "place" in time.