I would imagine a (truly) self driving car wound not assert itself aggressively - but carefully - in a crowded square and would therefore not make any progress at all.  A steady stream of pedestrians jay-walking, knowing that they had nothing to fear.  (Or at least, believing they had nothing to fear.)