I have been leisure cycling regularly for five years. Before that I did a short commute most days.
I have done lots of audax rides. You don't have to be fast to do audaxes, just water proof.
Now, speed.
If I go on the "club run" with my local club, 50 miles of Devon hills, I struggle to keep up. Compared with average club riders I am slow over this distance. When I do a 10 mile timed loop it takes me approx 27 minutes, in the summer when I am at maximum fitness. That's 35 kph
Riding to work (15 miles hilly) takes me under hour on my racing bike. That's 26kph
I often go riding at the weekend and 100km of hilly Devon takes just over 4 hours or 25kph
Notice how my speed drops off for the longer distances
When I looked into doing the "Tour of the Black Mountains" sportif my utter lack of speed put me off.
This is a 189km event but to do it at "bronze medal" speed for my age group requires a time of 7h. This is over 27kph! However, looking at the profile of the event there are some flat sections which could be ridden with a group at some speed. So I suppose in theory it could be done.