Noisy is highly subjective. I had no issues noise wise with stock coolers, and I use case damping and sound absorption to remove noise in some of my computers. My recommendation for noise is, try the stock fan, it is PWM controlled, to allow the motherboard to ramp up and down the fan speed as necessary to control temperatures, which means it could be very quiet if the temperatures are never very high. Also, since it comes with the CPU, TRY IT for yourself, and if you are not satisfied with the performance or noise, you can always buy an aftermarket cooler. By trying it yourself, you'll see whether or not it is to your liking, and how much more quiet or performance you need.
Thermal wise, they are designed to mate with the proper TDP cpus. Which means if you OC, the stock can't take you very far. If you don't OC, they are more than adequate.