Skiny,
As your application can use all available cores, and large amount of data are kept in RAM, it seems a call out for a multiple CPU, server-related system. The highest performance solution would involve Xeon E7's that are 10 core and may be used in 4 and 8 CPU configuration with up to 4,096GB of ECC RAM, but E7's are often $4,000 each and a system with 4TB of RAM- each 32GB RAM module is $900, means a system that can cost on the order of $200,000+.
The least expensive solution with a very high potential performance and expandability would be to buy a used Dell Precision T7500 with a pair of the excellent Xeon X5680 3.3 GHZ 6 -core and preferably one that already has a pair of X5680's. Dual Xeon X5680's are Passmark rated at No 15 in the dual CPU list and have a CPU score of 14151, about the same as a single Intel Xeon E5-2690 8 core / 16 thread at @ 2.90GHz which is Passmark no. 2 and costs , $1900+. So this pair of Xeons is a very good maker of the 0's and 1's and still has 50% more cores than the E5.
A 2X X5680 machine will provide 12 cores / 24 threads as compared to your current 4 cores / 8 threads so in general performance will be improved by a factor of 3X- though it's not perfectly scalar. Today a dual X5680 T7500 will cost about $2,500-$4,000. It will often be less expensive though to buy a single CPU unit and add the CPU / RAM / fan riser and a second X5680 for another $1,000-$1,200.
http://www.ebay.com/itm/DELL-PRECISION-T7500-2-X-INTEL-6C-X5680-3-33GHZ-4GB-RAM-1-X-500B-SATA-/141018693267?pt=Desktop_PCs&hash=item20d55e7e93
> which is the least expensive dual x5680 on eBay today at $2,800. but with only 4GB RAM.
A dual CPU T7500 supports 192GB of RAM (DDR3 ECC 1333) and I would think you might start with 64GB and then consider the upgrade to 128GB. The T7500 can hold I think 5X 3.5 drives and you night have a 256 or 512FB SSD for the operating system / applications and then 3X 4TB in RAID 5 for storage. a solution like this may cost about $6,000.
There are of course, a number of very good dual 4- core Xeon systems - less costly and that would at least double your calculation density. When I began doing 3D CAD I bought a Dell Precision T5400 with a 4 core Xeon X5460 @ 3.16GHz and eventually added a 2nd X5460 , and brought RAM from 4GB to 16 for rendering which can use all the cores / threads. The following system is one generation newer than mine>
http://www.ebay.com/itm/DELL-PRECISION-T7500-2x-XEON-3-33GHZ-QUAD-CORE-CPUS-24GB-MEM-2x-250GB-FX1800-/171079232623?pt=Desktop_PCs&hash=item27d51dec6f
> which has 2X Xeon W5590's, 24GB RAM for $1,000. That quite reasonable given that each CPU cost $1,600+ new- a $6,000 system three years ago. The W5590 is not the most brilliant Xeon, producing a Passmark score of 10704 or about the same as 1- Xeon E5-1650 six core. My dual X5460 system is ranked and a score of 8528, about the same as a single Intel Core i7 970 @ 3.20GHz. Still, a dual quad core has 50% more cores as the 1650, twice as many as you have currently working on the problems, and 3.33 is a good clock speed. The same seller has these with 96GB of RAM and 2X 1TB for about $1,800.
If you wanted to build a very competent system new and didn't feel it was necessary to have multiple CPU's, a Xeon E5-1650 (6-core, 3.2 / 3.8GHz has about the best cost / performance Xeon at the moment. I believe it's the Xeon equivalent of the i7-3930K and about the same price in the US (about $600). Passmark rank 12 and CPU score =11501 so it's calculation power is a bit more than the twin W5590's. I had an idea recently for an E5-1650 system >
BambiBoom PixelDozer Cadaedimathagrapharific ExtremeSignature VI ®£©™®$™_ 6.30.13
This system is intended as a workstation solution with high performance / high precision, very high stability / reliability at reasonable cost, and suitable for 2D and 3D CAD, graphic design, rendering, mathematics, simulation, animation, financial analysis, and video editing.
1. Xeon E5-1650 6-core 3.2 /3.8GHz, 12MB cache, LGA 2011 $630 (Passmark CPU score= 11462, rank = No. 12) > $590.
2. Noctua NH-U12S 120x120x25 ( NF-F12 PWM) SSO2-Bearing ( Self-stabilizing oil-pressure bearing ) CPU Cooler $70
3. ASRock X79 Extreme3 LGA 2011 Intel X79 SATA 6Gb/s USB 3.0 ATX Intel Motherboard > $190
4. 16GB (2X 8GB) 240-Pin DDR3 SDRAM DDR3 1600 ECC Unbuffered Server Memory > $150. (Check ASRock motherboard compatibility list)
5. NVIDIA Quadro K2000 VCQK2000-PB 2GB GDDR5 PCI Express 2.0 x16 Workstation Video Card $420.
6. Western Digital WD Black WD1002FAEX 1TB 7200 RPM 64MB Cache SATA 6.0Gb/s 3.5" Internal Hard Drive (RAID 1) > $90 (OS and Applications)
7. (2) Western Digital WD Black WD1002FAEX 1TB 7200 RPM 64MB Cache SATA 6.0Gb/s 3.5" Internal Hard Drive (RAID 1) >$180 $90ea. (Files, Backup, System Image)
8. SeaSonic X Series X650 Gold ((SS-650KM Active PFC F3)) 650W ATX12V V2.3/EPS 12V V2.91 SLI Ready CrossFire Ready 80 PLUS GOLD Certified Full Modular Active PFC Power Supply $120.
9. LIAN LI PC-A75 Black Aluminum ATX Full Tower Computer Case $182
10. ASUS DRW-24B1ST/BLK/B/AS Black SATA 24X DVD Burner - Bulk - OEM $17.
11. Microsoft Windows 8 Professional 64-bit (Full Version) - OEM $140
TOTAL > $2,189.
For your use, the graphics card may become a bit less graphic, double the RAM, consider whether an SSD would be desirable for OS / applications, and so on. The motherboard also could be exchanged for a nicer > ASUS P9X79 WS LGA 2011 Intel X79 SATA 6Gb/s USB 3.0 SSI CEB > $380. Always opportunities to spend more!
Just a thought. It's possible to build a very high performance system, and that would be new, have 6GB/s drives and so on, but new six core E5-2XXX Xeons are likely to be at least $1,400 each, $1,400 for RAM, and so on. Perhaps your budget could narrow the discussion.
Sorry for such a long post > A lot of choices!
Cheers,
BambiBoom
[ Dell Precision T5400 > 2X Xeon X5460 quad core @3.16GHz > 16 GB ECC > Quadro FX 4800 (1.5GB) > WD RE4 / Segt Brcda 500GB > Windows 7 Ultimate 64-bit > AutoCad, Revit, Solidworks 2010, Sketchup Pro, Corel Technical Designer, Adobe. CS4 MC, WordP Office, MS Office ]