The Romany Gypsies absolutely hate, the Irish travelers, many of whom can't be pure Gypsies as they don't have brown eyes, black hair and a dark complexion. They hate the bad reputation they give them.
Where I live there are a lot of Gypsies, most of whom live in houses, some I wouldn't spit on, others I could and would happily trust with my life. A long time a go, I learnt to treat people on an individual basis, I either like them or not, can trust them or not and all things like race, colour, creed are all irreverent to this.
Gypsies by nature are assertive, but if you are firm and polite to them, generally they will respect you for that. Some of them I know are crooks, others are honest and very hard working and there are many in this country that run successful businesses and pay their taxes, but that doesn't make good news stories or TV programs!
The bad ones mean that they all tend to get tarred with the same brush (no pun intended) and the good ones have to endure the the racism and insults along with the ones that deserve them.