Is an aftermarket cpu cooler worth it?

Solution
Yes, but it will be noisy and you cannot overclock well at all. It's barely sufficient for the stock temps, and an aftermarket cooler will improve it's longevity.