Dual CPU Cooling Advice Both Server and Workstation

sshades

Commendable
May 24, 2016
18
0
1,520
As some background, there have recently been a bunch of slightly older (but still new [as in not refurbished] and fast) Xeon server CPUs dumped onto the market. I've bought some of these for several machines including a server and workstation. I was wondering if some people might have some good advice on a few details that I've run across. In both machines, I have a relatively large amount of room, so I can use large cooling options. Just to be clear though, water cooling doesn't make sense for this setup.

Server: This is pretty much finalized, but if anyone wants to chime in I'm all ears. This had to be a 4U chassis because we are using co-processors for HPC which are full card height. I'm using Arctic Freezer i11's since the airflow needs to go front to back, and 120 mm fans are generally too tall to fit in a 4U chassis. I think that this is fine in general. The one major hiccup is that the "front" CPU cooler blows its warm air on to the "rear" CPU cooler. Therefore the "rear" CPU tends to run 5-8 degrees C hotter. I think this is okay because both CPUs stay below 65-70 C which is actually really good for the kind of torture we put them through (it's pretty similar to running something like fold@home 24/7 for potentially years at a time).

Workstation: This is the main question. I'm using Hyper Evo 212's with this machine. In order to deal with that 5-8 degrees warmer thing I mentioned above, I've set the direction of airflow to be perpendicular for the two processors (this isn't an option in the server since all heat needs to be vented from the rear). The "front" CPU cooler is blowing UP while the the "rear" CPU cooler is blowing BACK. This makes sure that both CPUs are running at approximately the same temperature in the workstation (and I've verified that this works while the system is running). After setting this up, I realized that the Hyper Evo 212's fan actually uses a sleeve bearing type, and I know that sleeve bearing fans have reliability issues when mounted horizontally. Normally I would have no issue with keeping the Hyper Evo 212's fan, but I'm wondering whether this will cause problems in the long run. In addition, I like the idea of the hot air from one CPU not blowing onto the other, but does anyone have any intuition as to whether this is going to cause more issues than it solves by creating an odd airflow in the case? If the sleeve bearing fan that comes with the 212 should be replaced, does anyone have a good replacement suggestion? It would need to be a very reliable 4-pin non sleeve bearing fan with sufficient airflow (the 212's fan maxes out at ~80 CFM).

Update:

A picture as requested. Note that the front intake fan on this case is a 200 mm fan which you can't see in the photos. Currently the front cooler is pushing air into some porous noise cancelling material on top, but the panel above is removable if it eventually becomes an issue. There is a lot of room in the case though eventually there is going to be some sort of GPU/co-processor (or possibly two). And I also forgot to mention that while the server will be in a server and therefore noise simply isn't an issue (it has a total of 12 fans I think and sounds like a jetliner taking off when it starts up), the workstation is more limited by the fact that people need to remain sane while working near it. I'm planning on adding one more intake fan I think, but that will probably be it.

Workstation_Case.jpg


 
Solution
Can you post a picture? The clearance between the setups might be relevant for a "dead air" discussion where both fans "pulling" from the same general areas might cause a too-low volume of air to be available.

As for fans, there are lots of high-quality, silent fans on the market. My personal favorites, in order are: Cougar Vortex, Corsair Silent series (both AF and SP) and Noctua.
Can you post a picture? The clearance between the setups might be relevant for a "dead air" discussion where both fans "pulling" from the same general areas might cause a too-low volume of air to be available.

As for fans, there are lots of high-quality, silent fans on the market. My personal favorites, in order are: Cougar Vortex, Corsair Silent series (both AF and SP) and Noctua.
 
Solution
for the server 70c is still pretty hot my main rig (dual e5 2670s) maxes around 50. my quad socket 604 server hits around 50 max too.

on the workstation the best thing i have found for dual cpus is buy one h100 liquid cooler for one cpu and then the 212 evo for the other this prevent the case from heating up much and keeps a nice amount of airflow. and for the 212 if this needs to always be up i would put a second fan on it so even if one does fail (which it shouldn't) you have some redundancy.
 

sshades

Commendable
May 24, 2016
18
0
1,520
@cdabc123

I've never actually had the "hot" CPU on the server hit 65 C (I think it momentarily hit 63 C during one benchmark simulation), but I figured I should leave some wiggle room (thus the 65-70) because I'm sure that I *could* design some code that would push the temperature a few more degrees. For many of the Dell compute nodes that we have running in our server room, the *chassis* (not the CPU) is approaching those temperatures. They'll burn you if you leave your finger on the metal for a while. HPC is just a very different beast than almost everything else. Two machines running at 100% load aren't always directly comparable, and our workload is generally worse than running something like Prime95 as we are almost entirely bottle-necked by computation whereas many other workloads have significant memory constraints.

And yeah, like I mentioned, liquid is not an option here. These things need to work long-term with little maintenance, and a leak could potentially damage neighboring hardware as well which is a non-starter.

@Karsten75

For fans, I personally have had terrible experience with the Corsair AF120s. I know that the overall noise pollution on those is supposed to be low, but it all seems to exist at one frequency because they have this terrible hum that doesn't go away at lower RPM. I found them far more annoying than some no-name fans that came in a cheap Thermaltake case. They also are only rated for ~75% of the CFM of the fan in the Hyper Evo 212. Thanks for the suggestion on the Cougar Vortex though as the COUGAR CF-V12HPB Vortex looks like it might check the appropriate boxes. If airflow seems to check out otherwise, that might be the way to go.
 

TRENDING THREADS