I get it all the time. I've been a labourer, I've been a manager, I've been a boss, I've been a business owner - end of the day I'm a working stiff just like everyone else who needs a pay cheque at the end of the month. Some people obsess about their social standing and need ever more tightly defined boxes to pigeon-hole people into. <shrug>
I agree completely. I've cleaned toilets, and worked on building sites for years. As I said, there is no logic to the system......but others in the system won't let you define it in a way which suits you. Whatever you call yourself (and I've never seen the need to call yourself anything), others will decide which class you belong to.