I think the bigger thing in evolution is that fewer genes overall come from natural selection pressure in females. Most females will reproduce. In a real evolutionary setting like back in pre-history only a few men reproduced while lots of females reproduced since dominant males would take all the mates. Like polygamy. Lots of animals do this where only dominant males mate. 


So all the most of the natural selection is coming on the male side since females mostly reproduce no matter what. (Long Long time ago) while males need to be super fit to beat out other males to mate. Most of the weeding out comes on the male side that is


It’s actually quite brilliant because it speeds up evolution since males with lots of mates can spread good genes more quickly in the next generation than otherwise