By far the biggest chunk of people not in the labor force are people who simply don’t want to be, according to data from the monthly Current Population Survey (which the BLS uses to, among other things, calculate the unemployment rate).