I usually go hunting with a very thin glove to wear just to get the wind off my hands. And I stuff a really well insulated pair of gloves in my pack for if it gets super cold. I figure if its so cold I need those, I'm surviving not hunting.

The fold back mitten style is just too much in the way and too much fiddling around.