1.) It should be lower, not higher, unless you enabled some options that does so.
2.) Normally, the voltage would drop under load, and not increase, so something is off here.
My guess is that you have some sort of auto OCing option enabled in the bios. Turn it off.