If you're one of those people who believe that speed is the most important factor in the determination of safe driving, then I can only say you're ignorant.
I thought you should be allowed to drive on the road. Now I am sure of it!
You stupidly (if we are getting into such epithets) divorce speed as the most important attribute of the damage that is going to occur in a collision. Or do you restrict your driving to the CERN campus where a different physics may exist?
As for the safe speed such that your judgement will always be correct - it is zero. You may be able to control your car better at a higher speed than another ( though your judgement in this is worrying) - but despite that it is going to increase the risk to other road users who have to look out for you (or for small kids) who don't.
From your car seat you can't see everything. The unexpected happens. You need time to take action. That is directly extremely related to your speed. I think I would rather rely on a traffic engineer's (or even a politician's!) balance of the risk of speed than yours.
In road crashes people are more at risk from mistakes than malice. You seem to pack quite a few ...