The cpu you can probably oc in the bios as long as you've got decent cooling for it (4 heatpipes or more with a 10cm or larger fan(s)), I would say add to the multiplier at an even number (no decimals) and add voltage if p95 fails workers or freezes computer before the first hurdle (~6mins). Add voltage in increments of .01v per bump and then test for stability. If you have a goal clock in mind (eg 4.6ghz) then set that clock and increase voltage until stable or you go over 60 degrees. If you're over 60 that's redlining it and you need to back off either the clock or voltage or both.
I've got my 8350 @ 4.6ghz but it required an additional .22v to get stable. I have a crazy good air cooler though which keeps it below 60 under stress. Anything above 60 and you're going to need better cooling.
Idk why afterburner isn't unlocked for you, I assume you have catalyst installed? Have you tried afterburner version 4.3?
If you want a fantastic air cooler build what I put in my sig, a Silverstone Heligon HE01 w.dual SilverStone FHP141's, it's about 10 degrees cooler than a Cooler Master Hyper 612 with a jetflo fan mounted on it which was my previous cooler and also comparable to liquid cooling rigs.