I've spent a lot of time walking around barefoot (no Vibrams either--never felt like spending the money on them) in cities (NYC and SF), and your feet get used to the concrete thing really quickly.  Your feet toughen up and it's not a big deal.  I agree about barefooting being annoying in cold weather though.