Gardening gloves are lightweight cotton or canvas. They are designed to be worn in the summer when it is hot. I take a pair canoeing to prevent paddle-blisters and for moving hot pots on a stove or logs in a fire.
Long ago, women used to put on hand lotion at bedtime and then put thin cotton gloves on over that while the lotion sunk in. These are also not warm. I don't know if they're still sold; perhaps a beauty supply store would be helpful.
Latex and other "rubber" gloves feel warm after a while because they don't breathe.
The internet appears to be full of cotton gloves, fwiw. These disposable cotton glove liners look exceptionally lightweight, despite the description's talk of cold weather applications.