Some pictures and detailed PC specifications would help. Especially the GPU brand and model, case model, number of fans, CPU, cpu heatsink model.
Did you tried to clean the GPU heatsink? Is it a laptop or a desktop PC?
Also how do you know GPU temp and fan speed? You use GPU-z, MSI aferburner or some other similar program?
My GPU has an idle temp of 48 degrees with fans completely stopped.