I have been overclocking my new Haswell 4670k for a while, and done quite a bit of stress testing recently, so I hope I can help.
In my experience, I have been able to boot to the OS with different speeds and voltages and do some web browsing and word processing without any problems. However, once I started running a stress test, I would get BSODs even after only a couple of minutes into it. For an OC to be considered stable, you need to make sure that your CPU can cope even when under stress. In other words, you may be able to boot the OS and do some light work without problems, but playing a demanding game will make your computer freeze or give you BSODs.
As Y0GI said, there are lots of stress tests out there. Prime95 is very widely used, but I have read in several places that it is not optimised for Haswell, and does not test all of the processor's capabilities reliably. For Haswell, I have seen Intel Extreme Tuning Utility and Aida64 recommended for stress-testing purposes. Recommended times, again, vary depending on the source: from 6 hours of Aida64, to 8 hours on IXTU, to 24 hours on each. Once again, it depends on your preferences.
Myself, I have been using Aida64 for 8 hours to test my OCs, and I have used IXTU in the background to keep an eye on voltages and temperatures (especially the temperatures!). Then again, this is all preferences, but I have been able to find stability using this method (after a lot of trial and error).
Finally, I would recommend using manual voltages, rather than adaptive, when stress testing your OC. With manual voltages, you know at all times what your CPU is getting, and hence you can work out what the maximum voltage is to achieve stability. After you've worked this out, you can then go back to adaptive and set your maximum stable voltage as your upper limit.
I hope this helps. Good luck with your OC!