The problem of your speed or lack thereof when teleporting assumes that there's some type of absolute reference frame for objects in the universe that they move in relation to. It makes the most sense that you'd be maintaining the momentum you were traveling in and interdimensionally affected by the gravity you were near before and while you're teleporting.