There are only two things to sort out about winter riding: Clothing and control. First I’ll talk about clothing. If you dress right, it’s easy to stay warm, even comfortable, in temperatures down into the teens.
Most people overdress for winter riding, outfitting themselves like Admiral Peary embarking on a North Pole expedition. The main difference between you and Peary is that he spent his day standing stock still on the hind end of a dogsled, whereas you are exercising, and generating heat. (Another difference is that you can’t simply claim to have actually made it to the office and expect people believe you for the better part of a century.) Your pedalling can add 20 to 30 degrees to the perceived temperature, and if you’ve dressed according only to the thermometer, you’ll quickly overheat. So on your torso and legs, you need to underdress a bit. My default outfit for temperatures between about 23 and 35 degrees is two long sleeve woolen layers (at least one a turtleneck), topped by a medium weight (sort of “heavy windbreaker”), lightly water-repellent cycling jacket. On my legs I wear, over standard cycling shorts, a set of winter stretch cycling tights. Set up in that fashion I may be chilly for the first five or eight minutes but by the 10th I’m usually sweating.
(I swear by a Devold woolen zippered base layer I bought from Rivendell Bicycles a few years back. Rivendell no longer sells that brand and the closest thing I can find nowadays on the Devold website are its “Multisport” zip undershirts. Rivendell is now selling a similar high-neck zippered undershirt from New Zealand, which I’m sure is superb.)
The principle of underdressing does not apply to your hands, feet or face. They benefit little from your exertions and it’s important to make sure they’re well covered - don't skimp. Experiment with different weights of gloves and socks for different temperatures – you want your hands to be warm, but arctic gloves that are good at 15 degrees can feel really confining and uncomfortable at 40. A balaclava will keep your face and ears comfortable, and you can carry it scrunched up in a jersey pocket on days when you’re not sure you’ll need it or not.
Oh, finally. All of this assumes that you’re riding straight through to your destination, where within a minute or two after arriving, you’ll be moving indoors. Once you stop pedalling you will begin to lose heat very quickly – and thanks to your sweat, even more quickly at the end of the ride than at the outset.