I'd actually read that as everyone using their own Stealth score (including ranks, modifiers, attribute, etc.), but we all benefit from whoever's die roll is highest. I think that makes a little more sense, since then you can't have one really stealthy guy "cloak" a bunch of centurions in heavy armor who've never stealthed a day in their life. It still seems like a huge benefit.