The future is probably very much as you said. We'll say "Driverless cars used to be so restricted! How quaint! They only kill about two million people a year, and we accept that risk." Then we tell our cars to take us home, and run someone over on the way home, and blame them for being in the wrong place at the wrong time, and think no more about it.