yes you'll get a nice performace boost by overclocking.
Is it worth it buying a new cooler, probably since the hyper212+ is ~ $25
Is it worth it to buy a new motherboard too? maybe not.
I see that you can not OC on your current motherbd... tuff call. How tight is your budget?