I've spent over 12 hours on a road bike crossing the country. I can't think of anything else I could have sat on for that long and been more comfortable.
Having just been to visit my family this weekend and was reminded that they comment on stuff they know little about. I would say ignore them. It'll be you riding the bike, not them. Hybrids are great bikes for most people, but do nothing really well. Other bikes do other things much better, but no one bike covers all requirements. As an example:
Long distance good to adequate roads - road bikes (particularly Audax or Sportive-style ones) or touring bikes (rack, nice strong wheels) wind hands-down on this.
Rougher roads, gravel, towpaths, trials, woods - mountain bikes with suspension win in this area, but aren't great for long distance as they sap energy.
Upright bikes (e.g. shopping bikes) are great for use around town with an upright riding position and good luggage provision.
Full suspension.
Going fast in wet and muddy conditions - go for a cyclo cross or a gravel bike.
Hybrid bikes will get you around town better than mountain bikes and road bikes, but not as well as upright bikes. They will get you on longer distances that shoppers, but nothing close to a road bike. Wider tyres will help over potholes, but it will still be rough and you will need enough air to avoid pinch punctures.
10 years ago I bought a road bike. It got used for shopping, commutes on road, canal towpath, through snow and ice, and on 150 mile sportives. I now have a much more sensible bike for bad weather, but the road bike still gets used more often.