Your fan/MB supports PWM fan control (check that it's using a 4-pin connector), it'll automaticall adjust the fan speed based on temperature, so that you don't have to sit through extra noise if you dont have to.
Go into bios (smartfan/ fan pwm option, or something similar, depends on MB) and you can modify it further, setting a low speed & low temp as well as a high speed/high temp.
When your CPU temp is under your low limit, the fan will turn at the *low* setting you entered. When your temps fall between the low and high settings, it will ramp up the speed linearly, and obviously if your temps exceed your *high* limit your fan will be running at 100%.
I suggest you find a low speed that is virtually inaudible to you (try 40%, 50%, something like that) and set your minimum fan speed to that.
35 or 40 degrees is a good temp to associate with that speed, since it's not dangerous for the CPU to be running at such temps. As long as your CPU remains below these temps, your fan will be unaudible (yay).
Set your maximum fan speed to 100%, and set your maximum temp to something like 50-55 celcius. The larger the delta between your low/high temps, the slower the fan will ramp up, and the less annoying it'll sound to you. You'll have to play around a bit to get it to work optimally, without excessive changes in fan speeds during normal (low CPU load) operation.
Cheers