I never seem to feel the cold, except in my fingers.
Apart from a lightweight jacket and some padded pants I own no cycle specific clothing at all but I never seem to have a problem.
If it's really cold, i.e. very sub-zero then I wear:
A wicking t-shirt (walking type from
Millets)
Fleece jacket (standard millets cheapo)
Lightweight outer jacket
{if dark - a reflective vest}
Neck tube
Thin fleece hat under helmet.
Ordinary baggy shorts (not cycle specific) over footless tights and padded pants
Alpine ski gloves
If it's zero or just above I dispense with the tights and outer jacket (unless wet), and probably the hat.
I was out and about on the bike today for around three hours and I wore a fleece jacket over a t-shirt plus baggy shorts over padded pants. The Alpine gloves and, of course hiking shoes & socks completed the ensemble

I was fine, a little too warm sometimes.
I do sweat but most seems to wick away and I always seem comfortable, maybe too warm at times.