I imagine it's an issue right now because, well, we just started.  Later missions won't likely involve the whole team, just as the Justice League doesn't do everything in a stupidly huge group in the comics.