Well I like to wear the kit to match my bike, some people think its strange, and on a recent Sportive I was overtaken by a cycling club bunch and one made a joke/comment about saying 'Look its Lance Armstrong' which I did not think was particularly funny and no one else laughed, but who cares, I wear what I want.
A few years ago, I was wearing a jersey that said eddy Mercx, and someone over took me and said, 'blimey mercx has put weight on', but again, its just the odd comment, but then you get people who think they are funny every where, so I still continue to wear what I want !