should be no issues, I overclocked a 3570k to 4GHz without touching the voltage and to 4.4GHz with a little extra voltage on the extreme3.
Lots of guides around, but basically increase your multiplier up to 39 or 40 and run some stability tests. Set the crash guard in the bios to 1, so if it fails to boot once, it'll go back into bios.
Once you hit a wall, you'll have to start adding a little voltage, use offset voltage and add in very SMALL steps. Use openhardwaremonitor to check the voltage and temps when stressing the system, ideally keep below 1.2v and 65C.
Make sure you have an aftermarket cooler, like the evo 212.