What's the max I can overclock (in GHz) a QX9770 (3.2 GHz stock) with a "better than stock" heatsink? What's the max I can overclock it overall with the necessary cooling system?
I will largely depend on your hardware, in particular, what better than stock cooler you're referring to. You should get over 4.0ghz with good cooling and mobo.
The "better than stock" heatsink/cooler I'm referring to is the Arctic Cooling Freezer 7 Pro Rev.2 92mm Fluid Dynamic CPU Cooler (http://www.newegg.com/Product/Product.aspx?Item=N82E16835186134).
Upper 3's maybe, but it depends on case airflow and your chip. You might get higher, just keep an eye on temps. General rule is to keep it around 70-75c while benching/stability checking, and under 70 for 24/7 usage.