For the commute I’d start to get concerned when gusts of more than 40 mph are forecast. For a day leisure ride I’d not bother if the average was much above 18-20 mph. I get a lot of westerlies so strong winds often result in a linear ride from home on the coast and a train back!