the only explanation i can come up with is that under load your system fans are ramping up, and so cooling your CPU enough to lower its own fan speed.
tbh though, that sounds so stupid now that i have written it that it should probably be ignored.
have you been looking at some software to determine fan RPM? or are you going by noise? it could well be another component making the noise.