You want to keep the drive under about 45C. Ideally below 40C. If it gets hotter than 50C or 55C, it'll get flagged in SMART and you'll have to deal with SMART warnings for the rest of the drive's life (happened to me and I eventually had to remove the drive from my RAID even though it functioned perfectly).
The rate at which they build up heat is very slow, so a tiny amount of airflow from a fan is enough to keep them cool. Most times you don't even need a fan, just an open air intake at one end. As the PSU ejects air from your case, air gets drawn in via this intake, flows over the drives, and cools them. Do note that if you're testing the drives with the case open, you may be losing out on this passive cooling. So HDD temp...