I have a A10-5800k not overclocked. When i run in Ubuntu all is well. If i switch to Windows the CPU makes a certain noise humm buzz when idle. If there is a load on the CPU the noise will tend to go away until it idles down a bit. I've tried every possible BIOS config that deals with CPU throttling and temperature controlling, But it only happens in Windows. There isn't even the slightest hint of a noise when running Ubuntu or Linux based OS.
Yes the noise is coming from the CPU.
Yes the noise is coming from the CPU.