Graphics in modern 3d games are completely faked, and it works because they can control the view medium (the tv - a 2d window). When you can walk around the world though in VR would you not expect to be able to kick objects around, move lights, lock doors, break tables to use the pieces as weapons? Instead you still have the same game as on the tv where all that stuff is off limits, resulting in this weird in-between-fake-and-real-world-simulation which is jarring to play.