immortalgamer :
geofelt :
I think you have a problem that needs fixing unless your room is at 35c. (95f) or hotter.
The fan is spinning up because the motherboard detects a very hot cpu.
Most likely, it is a failed cooler mount.
Take off the cooler, and clean off the old paste from both the cooler and the cpu with alcohol and a lint free paper such as a coffee filter.
Reapply the paste, being careful to not use too much. A drop in the middle should do it. Too much paste will act as an insulator. If you want quiet, perhaps you should buy a tall tower type cooler with a slow turning 120mm fan.
A CM hyper212 or Xigmatek will be about $30.
My room temperature is like 20C so I guess I do need to reapply thermal paste. Also, I'm using the 80mm stock cooler that came with the CPU. Should I replace it with a better one?
Something is wrong.
Not much can go wrong if the stock cooler fan is running.
You could remount the cooler, and you will likely resolve the issue. It will cost you about $8 for a tube of AS5 paste.
Instead, I think I might buy a cooler like the cm hyper212. It is only $20 after rebate:
http://www.newegg.com/Product/Product.aspx?Item=N82E16835103065
It has a backplate mount, so you need to be able to access the back of your motherboard to install it. It comes with paste.
The big advantage to me, more than the better cooling, is that it will run quieter.