I've also (again, much less bad than your experiences) had an entire train station platform / train carriage of people wearing blue-and-gold for team E, scowl/glare at me for the whole train ride in a very aggressive manner because I just happened to be wearing purple, which happens to be the colour for team D.

I don't follow sport, it's just that most of my clothes are purple.

In [my city] it's not possible to avoid leaving the house every single game day, because every Saturday/Sunday (and some Fridays) for Autumn/Winter is game day -

the football season runs from Saturday, March 10 until Saturday, August 25.