My fear is not just the sound in your ear from music or even wind noise. It's the loss of concentration. I know that drivers have music or talk radio on whilst driving so why not cyclists.
I, for one, feel that I need to concentrate on everything around me just that little bit more cycling than driving. Not that I don't concentrate whilst driving. I don't have to think about pot holes quite as much. I have to anticipate more what other road users are going to do. I need to recognise whether or not they have seen me (this is often looking at their eyes) have they focused on me or past me.
I know that I sometimes need to turn off from my music or, more often, Radio 4 and really concentrate on situations on the road. This I find I can do with the Radio from the car speaker but find more difficult if I'm plugged into it. Even one headphone and I find the distraction of sound, ear fitting, cable etc too much. I've tried riding, walking to the pub listening to a programme I was into before leaving home, but always found it one input too many. Perhaps I'm one of those people that can't walk and chew gum but I don't think so.
I have a hands free kit for my phone but find that, if in a difficult situation on the road, people are repeating my name or hello thinking I can't hear them as I've stopped talking to concentrate on a more demanding situation.
I'm not against others listening to music or whatever as they go about their activities but it is not for me.
Another thing I've often noticed though is those that cannot be without their sounds. I've watched lads meet their girlfriend and have to put in one earpiece as they walk off holding hands. Maybe she waffles on to much for him so has to drown her out with his music
.