Advice on building a numerous-core server for data science experiments

horseatingweeds

Distinguished
Jan 19, 2011
18
0
18,510
Hello,

I'm planning to build a system for running a variety of data science things. They'll be mostly multi-threaded, so the more cores the better. I also need the capacity to add high-speed GPUs later on, and I'd like the system to be fairly cheap, because it's mostly for experiments that will lead up to choosing more specific hardware or cloud services.

Anyway, I'm looking for ideas. I found this board: Intel S4600LH2 I can get this off Amazon for $300. I would need the riser cards for the PCI slots, which would be another $300, assuming I can find them. Finding 4 quad-core Xeon E5-2670 CPUs for $100 each looks feasible. If I could manage this setup, it would be a really good deal. I figure, if I get a good power source, a cheap rack case, and plenty of RAM, the total price for the initial system would be around $1100 for a total of 64 logical cores. GPUs would be later.

I also have a ~$1900 idea also resulting in 64 logical cores, but using AMD equipment as follows:

AMD Opteron 6276 (16 core)
H8QGI+-LN4F
G-Skill (non-server) 8GB
Coolmaster HAF 932
240GB SSD
PSU Coursair 750W
Noctua NH-U9DO

Any better ideas or good advice? Thanks!