I’d recommend some warm fleece underclothes. You can get some cheap ones at Uniclo.
I personally bought some warm pyjama’s from Taobao. They are so warm and thick that I actually can imagine how it feels like to be a polar bear!
And when the weather really gets cold and nothing seems to help… your body is the best heater of all. Get some exercise and that will keep you warm for a while!!