Perhaps you are accepting too much responsibility here, and not placing the responsibility where it really lies, i.e. with those drivers who misjudged your speed, as opposed to not realising what it was. If they think they have plenty of time to pull out when they don't, they have not fulfilled their duty of care to other road users properly, hence they are driving negligently. As a cyclist you are a road user with the same responsibilities and the same rights as those car drivers, so if you are in a position where you have precedence, drivers have to give way or ensure it is safe to manoeuvre without doing so. Even if you are going too fast for the conditions, their responsibility is not reduced - 2 wrongs don't make a right.
Apologies for the sermon, but it winds me up no end when drivers fail to give way to me on my bike in situations when they would do to a car. It seems there is a prevalent attitude of "it's only a bike, it can't go much more than walking pace", or "it's only a bike so I can just pull in front because they're not as important as cars / have secondary road user rights / they'll get hurt not me / it doesn't matter", or they just aren't looking for a bike so don't see it, and before you know it, the bike is right on top of them trying to avoid a collision, sometimes with dire consequences.