The other side of the coin is that there will be many slower and more nervous riders, maybe with children with them, who won't use a path at all, if it's inhabited by the nutters who think they're on a 10 mile TT.
I'm not suggesting you would ride inconsiderately, but a lot of riders who want to go fast, are totally intolerant of anyone slower than them and will force their way past with very little room to spare. Cycle paths are not the place for this sort of antisocial behaviour, and riders who are unwilling to tolerate being held up by slower cyclists should stay off those paths and mix it up with the cars. Suddenly having a speed freak cyclist appear from nowhere inches away from behind, then fly past is not pleasant for family groups or any slow riders.