the cpu has an unlocked multiplier, so you can just increase the multiplier in small steps from the bios or overdrive in windows. the speed bumps when overclocking ram aren't that great so i wouldn't overclock it.
increase the cpu multiplier in small steps and monitor temperatures/stability as you increase it.
an after market cooler would be great too, cm 212 evo for example.
stock cpu coolers for oc ing will burn your cpu for oc ing you need to get a better one and oc ing your ram will not make much of a difference only 2-5 fps more. if you haven't oc ed before than get the oc ing software like cpu-z but if your going to get the best oc go into the bios and do it from there. also there are helpful videos to help you on youtube