You'll probably get 4.2 to 4.4 without getting too hot. It's going to depend on your chip and just how much voltage it needs at the higher clocks. Ivy starts to get very hot on air and closed-loop water starting at about 1.25v. Obviously higher clocks also increase the temp too.
With my i7-3770k and Corsair H80, I generally try to keep my prime95 temps from exceeding ~80c though when I was charting its maximum overclock, I let it go up to ~90c. But if you are going for a 24/7 overclock, I suggest you keep your max daily-use (including gaming and compute like Folding@home, SETI@home, etc) temps under ~70c and your prime95 max temps under ~80. That's my advice anyway.