Over the years, I have discovered this to be the case. If you can keep your core warm enough, you won't even need gloves most of the time. I wear lots of layers and that helps you stay warmer and also gives the ability to adjust if needed.
Another thing, if you keep a hand warmer against your wrist, it will keep your hand warm by warming the blood vessels going into the hand. Additionally, latex gloves (believe it or not) will keep a lot of warmth in. The problem with those is that your hands will sweat and then get cold.