I didn't say this wasn't "a lot of people." According to Pew, Catholics equal the percentage of Evangelicals but "nones" at 21% now exceed each. 
"There used to be a 'Catholic vote' -- think John F. Kennedy era America -- but not anymore, said Kyle Kondik, managing editor of Sabato's Crystal Ball, a political newsletter run out of the University of Virginia Center for Politics. 'I think that Catholics have become kind of immersed in the general electorate in such a way that their being Catholic doesn't really tell you much about how they might vote,' he said." (NCR 11/20/15)