No, that's normal. What you need to be concerned with, is how high it will get when stressed.
I have no idea how to use prime
that's a low load scenario. and yes as stated by the guys before me that is perfectly fine. check the temps when gaming, that should be your concern.
and maybe it is hotter now on where you live? summer?
Perfectly normal. idle temps will fluctuate with Ambient temps quite frequently so don't worry about those much. On really hot days you will probably notice you CPU idling around 40c sometimes. No big deal.