Was it the stock cooler or an aftermarket cooler?
If it was the stock cooler, the thermal paste was pre-applied (almost definitely), but if it's an aftermarket cooler, you DEFINITELY need to apply some paste.
And yes, it ABSOLUTELY matters. You HAVE to use thermal paste.