I suspect many golfers would feel the same about cycling. A lot of the people I know think what I do is slightly odd.
There are similarities in that the dress code is pretty unflattering (on me, anyway!) and we both spend too much money on upgrades.
Golf is the crack cocaine of the sport world. Once every 6 months you hit the perfect shot that fools you into thinking you might be able to play a bit, you spend the next 6 months hitting the ball into lakes and long grass.
Imagine you go out on your bike and on the steepest hill in the area, one day you can miraculously fly up it at 25mph overtaking all the local roadies, that's a bit what it's like.
I had a go on a driving range the other month, and it was great! Fantastic for stress relief and really addictive. Technically I should be alright at it as it is in my genes. There are two golf pros in my family: one great uncle in the US and my great great great uncle was the open champion in 1906. Bit tenuous but hey!
Yeah! Golf and work used to cheese me off: Salesmen taking afternoons off to 'entertain clients', always made me slightly suspiscious. That said I got offered my first decent job on a golf course after, yes you guessed it, taking the afternoon off. I'm still lousy at it but then I only play once every two years so that's no surprise. If I hit one good ball in a round that memory keeps me going. The rest of the time I'm to be found poking round in the rough looking for my ball!!