I can see exactly why people feel cyclists have ruined Surrey Hills. Cyclists mean you have to look extra carefully before crossing the road as a pedestrian, as a motorist you have to look extra carefully before changing lane or turning a corner and often wait for a suitable opportunity to overtake, in both cases you sometimes have to wait a remarkably long-seeming time for a gap, and you have to queue for longer at the cafe at the top of Box Hill. I understand exactly why all of those things irritate people.
Thing is, of course, all of those things are either using a facility for exactly the purpose it was intended (use of a paved road by a wheeled vehicle, use of a cafe by people in the vicinity), or are things that motorists do just as much (creating the need to look before crossing the road). But there's this perception that when motorists do something, it is normal, when cyclists do the same thing it is abnormal and therefore irritates people and leads them so feel (and genuinely believe) that cyclists have "ruined" the area which motorists haven't. It's a quite remarkable disconnect in people's minds.
In part I think this is just statistics - cars are more common that cycles, so whatever cars do, however objectively ruinous of an area it may be, is accepted as normal, an acceptance not extended to the rarer cycles. But in part I think it is about identification. Most people (certainly in the Surrey Hills area...) drive a car; other car drivers dress the same and behave in the same way; we're familiar with why car drivers do what they do; it is easy to see car drivers as "us", even when they are, objectively, creating a safety hazard, or delaying us, or polluting us, or causing another chunk of our greenery to be dug up for another car park. Cyclists, on the other hand, are not (to the average resident of Surrey Hills) "us", they are quite definitely "them". It's not just that the average resident of Surrey Hills doesn't cycle up Box Hill. It's that the people who do so mostly dress differently, have their own social groups they belong to identified by their own liveries, their own language to communicate in, and their own goals in life - all things that make them "them" and lead to this logically completely unsustainable but nevertheless deeply held view that cyclists are ruining the area.