Recommendation for hardware for very fast I/O

pi666

Honorable
Sep 25, 2017
5
0
10,510
I would like to build a new PC that maximizes I/O. I move large files across drives and would like to speed up the process. I am not on a network and plan to have a stand alone PC. What features or technology should I look for? Thanks.
 
Solution
I am sorry that I have taken so long to get back to you. I have been very busy on projects.

I mentioned AMD CPUs are soldered and Intel is not because the TIM used by Intel produces a lot of heat, due to poor thermal transmission from CPU die to the IHS. AMD does not have that problem because they use solder, just like Intel did many years ago. Soldering is more difficult on modern CPUs, so, Intel took the cheap and easy route.

I mentioned AMD 6 core 12 thread Ryzen CPUs because you get more power for much less money than from Intel and I was not sure of what software you were using. However, AMD has CPUs with fewer cores and you can save money by using fewer cores if your software cannot use the extra cores or threads, which...
I do not know what software you will be using, and that is important if you will be creating or manipulating content as well as simply moving it around because some software takes advantage of more than 4 CPU cores and some can use your GPU, however, that is not an issue if you will only be moving the data. - I will need to know what kind of drive you will be moving data to and from. - And, I do not know what your budget is.

With the above unknown, and assuming you will be creating or manipulating your own content, I suggest an AMD 6 core 12 thread CPU because AMD solders the die to the IHS, whereas Intel does not and Intel currently cost more. Use at least 3000 DDR4 low latency. And, NVMe SSDs 1TB to 2TB each, depending upon how much data you will be moving and storing.

If you will only be moving large files then a four core eight thread CPU is all you need, along with fast subsystems and drives.

I have an Intel i7 7700K that I delidded to keep temperatures down, especially when overclocking and NVMe is very fast. Whatever CPU you decide upon make sure there are enough NVMe sockets on the motherboard for what you want to do. It is possible to RAID NVMe drives, however, the best are so fast they do not need to be in RAID.

The best 2TB drives are expensive. The Samsung 960 PRO 2TB cost about $1200, however, the SAMSUNG 960 EVO 1TB cost much less at about $450 and offers most of the performance of the Pro. Look around for the best pricing, as it jumps around and you may find it on sale or bundled with a cost savings.

http://www.storagereview.com/samsung_960_evo_m2_nvme_ssd_review
http://www.storagereview.com/samsung_960_pro_m2_nvme_ssd_review

Let me know more specifics if you need more information for your build.
 

kanewolf

Titan
Moderator
If you move "large files across drives" are these external or strictly within the machine? I am guessing that you have to get new data in (on an external), do something with it, and potentially output it on an external.

If you can provide a better description of your workflow, there might be better help available.

Also a total space required and individual file size. Moving 1 million 1KB files is a different problem than moving 10 10GB files.
 

pi666

Honorable
Sep 25, 2017
5
0
10,510
My budget would be $2000 - $2500 but I'm not firmly wedded to that if some configuration cost $3000 I would consider it.
I move large graphic files within a machine (I want two internal drives) as well as USB external drives for both input and output.
Large files meaning anything 20GB - 300GB - occasionally many files of 5MB to 100MB - like 100 or those at a time.
I'm not a gamer.
Some photo editing work; document and spreadsheet work and audio editing are my main activities (plus web browsing of course).
I'm looking for a new machine.
I would use SSD.
I don't know about bus architecture or if that would make a difference.
So high fast memory and using SSDs per the suggestion above.
I do not understand " AMD 6 core 12 thread CPU because AMD solders the die to the IHS".
I understand the concept of more cores but I don't know what soldering the die to the IHS means and why that is an advantage.
I haven't decided on any kind of video card but plan to use one monitor - possibly a 34 or 34 inch.

I hope this narrows down the topic. Thanks very much.



 

pi666

Honorable
Sep 25, 2017
5
0
10,510
I should mention I use Windows 10 and Linux Mint Cinnamon 18.2. I use Dopus for my file manager on Windows and whatever is provided on Linux




 
I am sorry that I have taken so long to get back to you. I have been very busy on projects.

I mentioned AMD CPUs are soldered and Intel is not because the TIM used by Intel produces a lot of heat, due to poor thermal transmission from CPU die to the IHS. AMD does not have that problem because they use solder, just like Intel did many years ago. Soldering is more difficult on modern CPUs, so, Intel took the cheap and easy route.

I mentioned AMD 6 core 12 thread Ryzen CPUs because you get more power for much less money than from Intel and I was not sure of what software you were using. However, AMD has CPUs with fewer cores and you can save money by using fewer cores if your software cannot use the extra cores or threads, which sounds like your situation. In other words, 4 core 8 thread i7 Intel CPUs or AMD Ryzen CPUs.

Regarding overall cost of a computer, higher end AMD CPUs come with a CPU cooler. Higher end Intel CPUs do not come with a cooler. The brand new Intel i7 8700K is a good CPU, however, the motherboards are over $100 more than those used by an Intel i7 7700K and AMD Ryzen.

Windows 10 can get more work done with a CPU that has enough cores to run everything necessary in the background and the required CPU load by any other software running at the same time.

For example, programs like Adobe Premiere Pro and After Effects as many cores and threads as you can throw at it.

If you are not going to use expensive software, such as I mentioned above, then an i7-7700K with a Z270X motherboard will do the job for you. Also, a AMD Ryzen 5 1600X will do a fine job with a good motherboard.

In case you do not know what I mean by cores and threads, for example you can get CPUs with 4 cores and they will process 4 threads [basically 4 CPUs in a die or 4 pipelines doing work at basically the same time, which results in more work being done than a CPU with 2 cores]. My i7-7700K has 4 cores and can run 8 threads. The extra 4 threads are available from [Intel] Hyper-Threading and permit more simultaneous operations than a CPU with 4 cores and only able to run 4 threads [one thread per core].

I hope this explains everything without stepping on your toes, in case you already knew what Hyper-Threading is. In case you need info on Hyper-Threading here is a very simplistic, if not a little overly so, answer
https://www.youtube.com/watch?v=wnS50lJicXc

AMD has the same thing, it is called Simultaneous Multi-Threading
https://www.anandtech.com/show/11170/the-amd-zen-and-ryzen-7-review-a-deep-dive-on-1800x-1700x-and-1700/10

I made an assumption that you wanted maximum read and write performance, and that is why I mentioned the NVMe SSDs. If you want good performance in a regular SSD I suggest you look closely at the Samsung 850 Pro series, they provide outstanding performance for the price. http://www.storagereview.com/samsung_850_pro_ssd_2tb_review

I hope this helps you with your computer build.
 
Solution