I had a Schwinn hybrid which I used for my first few tours and it was fine. My wife wanted to buy me something nice for my 50th birthday so I ended up with a Ridgeback Panorama tourer. This has drop handlebars and is more like a strongly built road bike. I noticed right away that the Panorama is about 20% faster on the roads which was great, but it doesn't like gravel or tracks much which suited the hybrid fine. The extra speed is, I think, mainly down to the width of the tires so maybe you could put skinnier tyres on. I should say that while the new bike is faster on the road, and seems more stable when fully loaded than my old hybrid, it doesn't pedal for me, the hills still hurt!
Not sure how helpful this is but I'm sure someone more knowledgeable will come after me. It might be useful to know if you are just planning to ride around the countryside or actually tour with panniers etc?