I get these two temperatures (they were taken a week apart), are the cores too hot or too cold, and if they're too cold, how far can I overclock? and furthermore, how do I overclock?
There is no "too cool"! You can overclock until the temp on 100% load gets to within 10 degrees of the Max permitted. Just increase by a bit at a time.