Summer time and high Hummidy reduce the chance of ESD damage.
Winter time and Low Humidity the possibility of damage skyrockets. In Fact you do NOT even have to touch, just bring your pinky next to a component to cause damage - the EM field can do it!
Gloves have to effects (1) Good - No transfer of body oils to the component and (2) Not good for getting rid of static charge.
At home working on my systems I do not wear gloves. At work required to wear latex gloves and a wrist strap, But this is on a 20 Mil satellite Instrument and Oil on any surface is BAD in Space. For Home computer Body oils are bad for the CPU - prevents good thermal conductivity between cpu and HS.
I do wear a wrist strap during the winter (RH is typically 20%) when handling CPU/RAM/Circuit cards such as GPUs outside the protective ESD shield they come in.
Summer time I'm a little more relaxed and if the Components are install I keep one habd on the case when working inside, but still wear the wrist strap when installing new RAM, or a GPU.