What specific Vengeance kit do you have?
Keep in mind that DDR memory (DDR, DDR2, and DDR3) means dual data rate. DDR 1440 = 720MHz, DDR 1600 = 800MHz, etc.
You need to increase the memory frequency if you want to OC. This may also require a voltage increase to either the memory and/or the memory controller.