I have to agree with you. I am a young person in my 30s who works hard, foregoes some of life's pleasures (like ultra luxury cars, huge mansions, expensive vacations, etc.) but has several million in net worth. Financial freedom is a nice feeling that no luxury car or big mansion can achieve. We do spend money on dining so we're not super frugal or cheap. But we take the bus/bike, live in a modest home (as modest as you can get in this city) and don't feel our life is any worse because of it.
I read a while ago that a doctor (yes, a doctor!) who was retiring in his 70s was asking his patients for their credit card information so that they could "donate" money for his retirement. The doctor was apparently one of the early founders of green peace and was a hippy doc, but never bothered to save. The College of Physicians pretty much put an end to that.
So those who are jealous really need to understand how the world works.