Building new virtual server, ESXI, VCenter, oodles of vms (Firewall, IDS/IPS, Proxy, WebServer, Dev/Test, Hadoop...)

eriknorthrop

Honorable
Nov 11, 2013
8
0
10,510
My current build is:

AMD - FX-6350 3.9GHz 6-Core Processor
Asus - Sabertooth 990FX R2.0 ATX AM3+ Motherboard
G.Skill - Ripjaws Z Series 16GB (4 x 4GB) DDR3-1866 Memory
Intel - 520 Series Cherryville 120GB 2.5" Solid State Drive
Intel - 530 Series 240GB 2.5" Solid State Drive
Fractal Design - Define R4 (Black Pearl) ATX Mid Tower Case
Corsair - Professional 850W 80+ Gold Certified Semi-Modular ATX Power Supply
Intel - EXPI9402PT PCI-Express x4 10/100/1000 Mbps Network Adapter
Fractal Design - FD-FAN-SSR2-140 66.0 CFM 140mm Fan
Fractal Design - FD-FAN-SSR2-140 66.0 CFM 140mm Fan


Due to a hardware issue with the Motherboard and the fact that the system is (i) getting long in the tooth and (ii) cannot support my growing needs I am looking to salvage what I have and replace the most critical components. The items in BOLD will be reused.

I'd like to give ESXi a strong hardware set to run on as to maximize efficiency. Selecting a server (pro-sumer) grade motherboard is where I thought to start, especially one that will support a large amount of memory. Initially, I wanted to go with a dual socket intel build, but thought better of it.

Here is where I ended up.

Intel - Xeon E5-2670 V3 2.3GHz 12-Core Processor
Fractal Design - Celsius S24 87.6 CFM Liquid CPU Cooler
ASRock - X99 Extreme4 ATX LGA2011-3 Motherboard
Corsair - Vengeance LED 64GB (4 x 16GB) DDR4-3000 Memory


As I mentioned above, I'll salvage the case, SSDs, etc. I also have a synology in the mix that is not mentioned here, so plenty of HDD support there. Also, ill upgrade the SSDs over time and introduce a M.2 into the mix eventually.

What are the best practices here considering the use cases especially around CPU selection? Im trying to avoid purchasing unnecessarily expensive hardware due to brand name, etc, but crave the compute power.

Thanks for the read and feedback.

 
well, why not to build it around much cheaper and kinda better threadriper ?
https://www.newegg.com/Product/Product.aspx?Item=N82E16819113447&cm_re=threadripper-_-19-113-447-_-Product
https://www.newegg.com/Product/Product.aspx?Item=N82E16813119026&cm_re=x399-_-13-119-026-_-Product
on the spared money you can get more ram. and with VMs more RAM is always better :)

and that wannabe liquid cooler joke ... unless you are very limited in space, pick a decent Noctua cooler - will cost lees and do better job + a bonus of less noise and much more reliability .
 

eriknorthrop

Honorable
Nov 11, 2013
8
0
10,510


I like your suggestion and its certainly more affordable. My first question is about whether Intel Xeon or AMD Threadripper is a better choice for virtualization tasks? For me, getting consensus on this plus my own reading it central to the next iteration.

Also, are you saying that the Noctura will cool a CPU better than a liquid cooled, closed, system? And its quieter? Just asking?

Thank you for your suggestions!!
 
Can you share which virtualization you are interested in ? will you run an ESXi on the new machine or just a desktop OS with virtual machines (KVM, VMWare, Virtual Box etc.)? are you going to use direct HW mapping ?
Basically, from the two CPUs we are discussing, i'd go for the Threadriper due to presence of more cores. the per core performance is kinda the same between them.

And yes, high end air coolers do much better job than CLC AiO. Don't get me wrong, I love liquid cooling, just the true one - custom.
 

eriknorthrop

Honorable
Nov 11, 2013
8
0
10,510


Currently, I run ESXI on the hardware set listed as my current build, so I guess its installed on bare metal. The OS is installed on a SSD and VMs stored on another. I then use the synology via iSCSI for tasks where speed is not a concern. Moving forward, I thought to use this same configuration and eventually ESXi to an M.2 SSD.
 

eriknorthrop

Honorable
Nov 11, 2013
8
0
10,510


Thank you for the link, ill have a look.

When i decide to pull the trigger, Ill include my thoughts on this thread.

Thank you for the input!