Yes. Do note that not all games will benefit from OCing your CPU. The majority I play (LoL, Amnesia, Crysis 2 & 3, GMod etc) don't see much (2 - 3 FPS) if any improvement at all. The only major one I have seen changes in is a modded Minecraft. I had decent frames(90 - 120 depending where I was. ie next to factory would be 90ish) but would stutter considerably more when the OC was not in place, but turning on multicore in optifine helped a lot more than the OC did. I have a 3570K btw.
If not editing and only gaming, you are right to go with the 4670K OC'ed, but think of overclocking as more of a fun/bragging rights kind of thing for now. There will be a time when you really will need to OC to keep up with games though, but that time is not now so a stock chip would run great.