Thank you for all the responses above 
One thing I'm not understanding perfectly. On the flatter bits through town on smooth, newly paved concrete, I'm now hitting 18mph on the road bike and I can hold it there with a fair bit of effort but no more than I'm exerting later on in the ride on the rougher asphalt bits, where I'm struggling to hold 13mph and it's requiring the most effort I can muster to stop myself going past my lactic threshold. Is surface really that significant when riding with 25mm tires?

One thing I'm not understanding perfectly. On the flatter bits through town on smooth, newly paved concrete, I'm now hitting 18mph on the road bike and I can hold it there with a fair bit of effort but no more than I'm exerting later on in the ride on the rougher asphalt bits, where I'm struggling to hold 13mph and it's requiring the most effort I can muster to stop myself going past my lactic threshold. Is surface really that significant when riding with 25mm tires?