Cycle-commuting (at any speed) involves heavy exercise, it also involves exposure to frighteningly disparate risks of damage. Both of these promote adrenaline production, adrenaline is a stress hormone involved in what is correctly known as 'flight or fight' response.
For a car-driver to reacted to a close pass with a flight or fight response, it would be disproportionate. For a cyclist who has just experienced a potentially life-ending event such a response is entirely proportionate.
So no, parity with other road users is not the question here.