Thing is, the hate is directed against them for actions that are entirely within their control, not for immutable aspects like their skin colour or their hair colour or whatever.

No one forces Roma families to withhold their kids from school and commit petty crimes. No one forces Roma families to steal everything that isn't nailed down.

Racism may be responsible to some extent - but I should point out that Roma are very ethnically similar to South Asians, and immigrants from South Asia generally do pretty well wherever they go. Blacks in America have it far worse and still manage to avoid inviting the kind of hate the Roma get. There also exist Roma people who abandoned their "culture" and made the effort to get educated and get integrated, and face no problems in society.