A similar pattern emerges when looking at annual income: 16% of those with an annual family income less than $30,000 say they feel lonely all or most of the time, compared with 9% of middle-income adults and 6% of higher-income adults.