Only when I'm stress testing or rendering, nothing else I do gets my cpu hot enough for the fan speed to increase to max speed.
What temperatures are you usually getting?
I've been running http://www.alcpu.com/CoreTemp/
(no install necessary, very nice program) and I get 40-42 idle in Windows, 44-48 doing stuff, and over 50 with intense gaming (WoW).
[Edit]: Wow, I just switched my case to Antec Nine Hundred and all the noise is GONE. Hah, I kept putting my ear to the cpu cooler and thought that's what was loud. But it was these (4 of em):http://www.newegg.com/Product/Product.aspx?Item=N82E16835150007
Damn, horrible. No wonder they're so cheap.