Right on, then. I assume when you say full load you mean running prime95 or OCCT or something similar? If so, I'd say go for it. Your temperatures are definitely safe for an unrealistic load, and it's definitely worth the performance bump (and the fun of tinkering).
Yeah, I was running prime95. The whole thing that intregued me into OC was the performance and being able to mess with things What do you think I should aim for, for first time OC'ing?
A 24-hour stable overclock :P But seriously, don't go for a number, go for stability. You can expect to hit somewhere in the range of 4.0 to 4.4GHz as a reference point, but every chip is different. I've not done any OCing with Sandy and Ivy myself, so if you need any sort of specific advice, you'll want someone else's help.