I have one word for you - merino!
Baselayer, socks, hat, leg warmers, you name it!
And +1 for silk glove liners.
I'm also not keen on cycling when there's a potential of black ice, at 57 (and three quarters) I don't fancy hitting the ground hard, I did it about 20 years ago and you don't have a chance to fall better, one moment you're flying along, the next you're lying on the ground!
Last year I treated myself to a jersey with windproof front, and I can honestly say it's made a lot of difference to my ability to cope with lower temps, though as pointed out re the black ice above, I don't normally ride in less than about 3 degrees