No, never ever overclock with the stock cooler. Stock cooler can barely keep stock clocked cpus running cool. (Only exception is the G3258 dual core Pentium.)
Your going to want either a cheap good quality air cooler or if you want to get a higher overclock, an AIO water cooler.