You need to connect your CPU fan to your CPU_ FAN header on your motherboard so that it knows that there is a spinning fan on your CPU, its part of the checks that it does to make sure that your CPU isnt going to overheat and cook itself.
What cooler are you using? The speed of the fan partly affects the noise, but the fan blade design and bearing type has a more significant effect on the noise level of the fan. It shouldnt be too loud, and if you have it hooked up to your motherboard it will stay low until temps go up then it will crank up to full speed, mine makes a high pitched whine but it usually doesnt matter since i have headphones on whenever its under load.