Yes, all CPUs today have sensors to tell you the core temperature of your CPU. You can see the temperature by downloading any hardware monitor software. One common one is Speed fan.
Or do so from the BIOS the old fashioned way Press Del. during boot or whichever key you need to access your BIOS. Then look for a menu called Hardware Monitor or something similar. There you will find your temps for your CPU and other components. No need for software this way, but obviously you can only check at boot.