Internal RAID0. Where Do I Start?

jackwilsonvideo

Prominent
Jul 16, 2017
2
0
510
Hey guys.

I am a video editor and looking to create a RAID0 system within the six hard drive bays of my new workstation PC. This seems like a much smarter option rather than buying SSDs.

I am looking at WD Black HDDs. These seem to reliable and fast. I would get four, so I could get the best read/write speeds.

I have no idea what kind of RAID controller I would need. Can anyone recommend one for my particular situation?

Thank you in advance!
 
Solution
G
G

Guest

Guest
I wouldn't recommend it, because in raid0, any drive failure results in total data loss. With 4 drives, the failure of a single drive is very likely.

That said, you often don't really need a raid controller. If you want to create the raid0 as a separate partition from your OS (i.e. windows not installed on it), just go into "control panel -> system and security -> Storage Spaces", create a new pool with the chosen drives. When it asks "resiliency type", choose "simple", and that's your raid0.

If you want your OS to be on the raid, check if your motherboard supports raid0. Most do. Go in your bios, into the SATA mode area, and see if you have the option to switch from AHCI to RAID. The steps depend on your motherboard and BIOS, but usually it's as simple as enabling the drives you want to remap, and the raid type. When installing windows, you might not see the raid drive. If so, click on "load drivers", and load the drivers from your motherboard manufacturer (which you can find on their website).

Since your needs are mostly video, which is a sequential workload, using mechanical drives makes sense. I would recommend WD Red instead of Black.

But again raid0 is very dangerous. If you estimate average disk lifetime as 3 years, your odds to experience complete data loss in a year is 71%. If you estimated the average disk lifetime as 5 years, the odds drop to 56%. So if you go this route, make sure you have a backup, and backup often.
 

jackwilsonvideo

Prominent
Jul 16, 2017
2
0
510


Hey Andy,

Thanks for your quick response.

I am currently running my OS on a 960 EVO M.2 drive. I have an MX300 1TB SSD for general media. Then I have a 850 EVO 250GB SSD for my cache files.

I don't think I would need more than 12TB for active projects, come to think of it. I would offload completed projects to archive drives every year to clear up space.

I am often working with .R3D files so would hate for Adobe Premiere to bottle neck due to storage speeds. My budget for an immediate storage solution is around $1k. Do I risk the same hard drive failure rate with an all-inclusive system such as this? Would I have sufficient read/write speeds?

https://www.bhphotovideo.com/c/product/1333894-REG/g_technology_0g05753_g_raid_removable_thunderbolt_3.html


I am glad to PayPal for a beer or coffee for some enlightenment. I am still new at this PC building stuff. Thanks!
 
G

Guest

Guest


Well, it's a difficult question. If you want to use a all-inclusive system, the only one I would recommend is something by ixsystems. It has ECC memory, and uses ZFS which has checksums and redundancy, so you just can't lose data (unless you lose the system by fire or theft). But, it's slow. The nature of ZFS is slow.

Maybe the best thing you can do is put the files you are working on to the SSD, then send them to that or a backup once done. Or, using a raid0 to work on the files, but then back them up immediately when done.

I don't understand why you have a 250GB SSD for cache files. What do you mean by that?

And how big are the biggest files you would work on?

The system you link has the same probability of failure as an internal system would, and is probably slower, despite the thunderbolt, because of sub-par controllers they put in those. The probability is actually lower, because there are only two disks (more disks in raid0 increase the risk of data loss in a non-linear way). You might consider RAID5, which, faster than RAID1, slower than RAID0, at least offers redundancy, which means if one drive fails you have at least a chance to rebuild the array.

You should archive daily, weekly, or, and I don't recommend, monthly. Yearly archiving is extremely dangerous. Imagine you lose an entire years worth of data! Or even a months. "Yeah, everything I worked on last month, I have to redo...". And often, everything seems fine until comes the time to backup. I can't tell you how often everything seemed to work great, and then I started making a backup, and in the middle of it some sectors on the disks that were silently bad showed up, corrupted files I hadn't used in a while, and I would have lost data if I didn't already have a backup.

A large factor is how much you value your data and can afford to lose it. An artist friend of mine had 15 TB of photos she took over the last decade, backep-up on dozens of drives she had stored in anti-plastic cases in her closet. Her apartment got broken into and they stole many things, including all the drives. She posted a $10k reward to get them back, anonymously, and without pressing charges. The data was worthless to the criminals, since most had been published (but not in the original raw format), and she owned the copyrights. But she never got them back. Just like that, a decade of work was lost. She was planning to compile them eventually to make a coffee table book. Now she can't.

So consider having a secondary backup which is in another location, preferably another city.

Also, transferring files to another system and deleting them isn't making a backup. Backup means at least two copies. So if you delete the files locally, you only have one copy, and no backup.

I'm happy to help further if you have other questions. I don't need any coffee or beer money, as I happen to be a rich m*-f*. If you can spare PayPal money, please consider donating to the FSF. They are doing good work.
 
Solution