When the CPU throttles down you will definitely notice the difference in performance. It will not be a small decrease, but something rather large. I don't have an i7-920, but I would say it should be several hundred MHz.
Buying a better cooler is always a good idea since heat kills electronics. Excluding laptops, I prefer the CPU temp to be no higher than 60C - 65C under 100% load.