Sign in with
Sign up | Sign in
Your question

Poor Mans RAID and Disk Tips

Last response: in Storage
Share
November 4, 2011 4:40:23 AM

I started this piece of work to satisfy my own curiosity. Last year I wanted to RAID 0 on my new AMD 965 system, but ended up dual booting because W7-64 was too young. It's going to be a Christmas gift this year. I already have this years Sandy Bridge system up and running.

What a mix:
Crucial M4 SSD,
Two 1TB WD Caviar Blacks,
Two 2TB Hitachi Cool Spin 5K3000 green drives,
AMD SB850 + GigaByte SATA controllers, on a GA-890GPA-UD3H
Intel South Bridge and Marvell SATA controllers, on a ASUS P8P67 Deluxe
One Lab Rat professional IC evaluator

I present to you a link to "Poor Mans Raid and Disk Tips.pdf"



Comments anyone?
a c 277 G Storage
November 4, 2011 12:30:01 PM

One comment: post a link to the pdf, not Mediafire! I get more than enough ads in my life.
a b À AMD
a b G Storage
November 4, 2011 1:49:49 PM

I don't like either. I do my best to avoid .pdf as a whole. To many exploits. Some newcomer on a forum wants me to read a .pdf? PASS.
Related resources
November 4, 2011 7:07:51 PM

This forum did not have an obvious file attachment option.
Mediafire file hosting was free. Not pleasant, but free.

OK, the pdf is 11 pages long and has inline images side by side.
I'm not sure if the moderators want it all posted, or exactly how to do it.

I like pdf documents. I like having reference documents at home.
I hate detailed online game strategy and info that is web only.
Give me both. But, then I'm older and can live without the web.




a b À AMD
a c 105 G Storage
November 4, 2011 7:23:07 PM

Since Im not running a huge database with multiple user access, or tying to speed storage subsystem up to raise a benchmark, it's hard to find a reason to run RAID 0
November 6, 2011 12:44:26 AM

Chapter 1 - Better Disk management, Intro to benchmarks, verifying AHCi-NCQ and Write Cache
November 6, 2011 12:45:07 AM

November 6, 2011 12:46:19 AM

November 6, 2011 4:21:27 PM

Chapter 2 - Why RAID when you can SSD?
November 7, 2011 6:53:21 AM

Quote:
Two 1TB WD Caviar Blacks,
Two 2TB Hitachi Cool Spin 5K3000 green drives,


I can understand using the SSD for OS but why two separate RAID's on a single system?

If it's storage you can do 4x1GB or 4x1.5GB in RAID 0 / 10 / 5 depending on how you feel.
November 7, 2011 1:12:01 PM

I had two sets of drives to play with and benchmark. I never had both setup side by side.
November 7, 2011 1:12:56 PM

Chapter 3 - RAID 0, RAID 1, and other Motherboard RAIDS

November 7, 2011 1:13:37 PM

November 7, 2011 1:52:56 PM



End Chapter 3
November 7, 2011 11:24:47 PM

WarDad said:
I had two sets of drives to play with and benchmark. I never had both setup side by side.



Ahh ok makes sense.
November 8, 2011 11:08:36 AM

Chapter 4 - Intel P67 mixing one SSD and HDD RAID.
November 8, 2011 11:09:44 AM

Chapter 5 - Changing SATA drivers on XP boot drive.
a b À AMD
a b G Storage
November 8, 2011 11:36:39 AM

To be completely honest I'm not sure you can draw any correct conclusions with this data. You are using very different drives in your testing. If you were testing the same drives on different controllers then you would have accurate data from which to draw conclusions.
November 8, 2011 1:44:11 PM

The Black and Green HDD were close enough in performance to allow a sparse test matrix. A strict test protocol with a full test matrix would have been too large.
The trends and tips are the point of the ariticle. Ex. The reader is better served when they can tell difference between 4K and 4K QD32, and update their drivers to AHCI-NCQ.

a b À AMD
a b G Storage
November 8, 2011 11:41:28 PM

Rotation speed is the same? Platter density? Cache? Controller microcode? I get the feeling they are a bit more different then you think. And I'm not sure you or I have enough knowledge about them to know if the difference in scores your seeing is the test or the drives.
November 9, 2011 12:34:16 AM

I can tell the difference, that's why I'm paid the big bucks. This isn't about the best benchmarks. I used brief and simple benchmarks that almost anyone could use. The Green drives get a 4K read around 0.6MB/s, and the Blacks get around 0.7MB/s. Both suffer a little if they are boot drives. The Blacks have less seek time, more platters (cylinders), and higher rotational speed. The Green ones are a year newer, have higher disk density, and Hitachi is known for good Sequential read speeds.

Read Wiki NCQ to get a better understanding of why 4K and 4K QD32 read results differ.
Obviously if 4K QD32 read is not significantly better than 4K, the reader is not getting full performance.

The Gigabyte controller also supports legacy Floppy and PATA (ribbon cable) drives.
It's driver has a check box for legacy Tagged Command Queueing.
NCQ (Native Command Queueing) does not appear to work here. Coincidence? No.

In the optimize chapter I did a test case with Write Cache On vs. Off. With off showing a drop in 512K and Sequential tests write speeds.
The GigaByte and Marvell secondary SATA controllers also had write speeds drop off on 512K and Sequential tests when pushed by RAID.
Both secondary controllers PCIe 2.0 x1 serial channels rated about 500MB/s.
Both SouthBridge controllers have PCIe 2.0 x4 serial channels for 4x the bandwidth. They did not have a write slowdown.
Why? Who cares, I can benchmark it and avoid using the secondary SATA controllers.
a b À AMD
a b G Storage
November 9, 2011 12:51:04 AM

And I do like how you fail to mention that depending on your board those "secondary SATA controllers" might be the only 6Gbps ports on your board. Your SSD should be plugged into them. But of course you said to never use them, so SSD speeds will suffer.
November 9, 2011 1:07:07 AM

How does "I can benchmark it and avoid using the secondary SATA controllers." become "never use them"? I think you missed the "I" and the "benchmark" parts.

BTW: SSD speeds do suffer on my Marvell secondary controller. Maybe a PCIe 2.0 x4 Sata controller card (bootable) would be a better choice.
a b À AMD
a b G Storage
November 9, 2011 5:24:32 AM

I think I wrote what I said because of your last paragraph in that first picture post, though its not as hard a "never" as I remember reading. I've looked back through this but can't seem to find where I saw what I remember seeing. I'm also not sure the issue which you speak of has anything to do with "pci bandwidth". 6Gbps ends up topping out around 600MB/s. 4x lanes of PCIe bandwidth ~1GB/s, so the bandwidth is there. Assuming of course that secondary chip is hooked up to 4x lanes. I haven't bothered to check, only going from what you wrote.
November 9, 2011 1:10:49 PM

Chapter 6 - The Test systems and benchmarks

Hard Drive Size Matters
A 2TB total capacity is compatible with standard MBR boot drive formatting. The new GPT formatting supports larger data drive capacities but it's not always backwards compatible. If your RAID exceeds 2TB then do some homework at your motherboard and OS forums. Your SATA controller may not support GPT, but it might provide a work around by partitioning multiple RAID 0 drives on the hard drives.


The Test Hardware
Drives:
2 each 1TB Western Digital Caviar Blacks, 3GB SATA, 7200 RPM, WD1001FAES
2 each 2TB Hitachi Cool Spin Green drives. 6GB SATA, ~5900 RPM, HDS5C3020ALA632
1 each 256GB Crucial M4 SSD, 6GB SATA, CT256M4SSD2
Last years system:
Gigabyte GA-890GPA-UD3H rev. 0, XP OS, AMD 965 BE, RADEON HD5870
AMD 850 South Bridge SATA Controller is very flexible.
Gigabtye controller supports SATA, legacy PATA, and Floppy drives.
This years system:
ASUS P8P67 DELUXE, W7-64 OS, I7 2600K 3.4 GHz, 2x GTX560TI, Crucial M4 SSD
Intel South Bridge SATA controller,s bios is all RAID or none.
Marvell SATA controller does not support boot drives.
Backup system:
VANTEC NST-300SU-BK Hard Drive enclosure with a 2TB green drive. It's an easy to use removable storage connected by USB 2.0 or eSATA.


The Bench Marks

IOmeter is an old program is for benchmarking servers. Intel gave it away many many moons ago. I first used it to test two independent disk simultaneously on one or two SATA controllers. It is flexible, has quite a learning curve, and produces spread sheet numbers. I became proficient and the results were close to Crystal Disk Mark 3.

Crystal Disk Mark 3 is a free program that is informative, works well, is easy to use, and is pleasing to the eye. Other programs may do more or work better but to a poor man free is very, very good.

HD Tach is free and gives a unique picture of performance across the hard drive platter. It also measures seek times. The Hitachi green drives were 19.3 ms and the WD Blacks were 13.6 ms.

I noticed the read and write times were a little off for OS boot drives. Possibly the Bench Mark program and OS are competing for disk access. The OS also occupies the fastest real estate on the hard drive.
November 9, 2011 1:11:39 PM

Chapter 7 - Wrap it up

My New System Disk Configuration

1. One SSD comfortably fits W7-64, my applications, and my games.
2. A RAID 0 array of two 1TB WD Caviar Blacks hard drives serves as a temporary work space.
3. A 2TB green drive is my main storage. A small partition of it is my 1st backup layer.


My Backup Layers

1. A small partition of the main storage hard drive is used for frequent boot disk image files. This helps recovery after a virus attacks the OS boot drives MBR. Which has happened to me.
2. Large backups and disk images use the other 2TB green drive installed in the external drive enclosure. I have partitioned it to support image backups, compressed files, and backup software files. I leave it unplugged and unconnected most of the time, to guard against viruses and lightning.
3. CDs and DVDs are used for important data. I was a volunteer fire fighter and have witnessed homes burning. To protect from fire, I have many copies in different locations, like a safe deposit box or a relatives house.
4. Web based backup storage is an option. I have privacy and ID security issues with it.

A lightning strike to a power pole killed my moms telephones, radios, cable box, modem, and PC. The lesson here is that Always Connected is Always Vulnerable. She had DVD and USB thumb drives backups, continues her family genealogy project and Saint Vincent de Paul's projects.
A good backup plan has offline storage placed in more than one location.


Conclusions

SSDs are faster where it counts for OS boot drives, games, and applications.
Hard Drives are much cheaper, larger, and should hold the bulk of your data.
Benchmark your drives performance and get the most from your system.
RAID using consumer hard drives should be limited to 2 drives.
RAID is easier to work with if it's not your boot drive.
RAID 1 data redundancy won't protect you from viruses, user errors, etc.
RAID 0 of two hard drives can be twice as fast, but is more risky.
Always have a good backup strategy. Add layers to it if you raid 0.
a b À AMD
a b G Storage
November 9, 2011 1:43:27 PM

I like keeping backups at work. Desk drawer, locker, etc. I'd add to that conclusion or somewhere else in the article that due to your example of lightening, thats why RAID1 is NOT a form of backup. Lightening hits, computer fries, both hdds are wiped. Where is your backup copy of data now? Important data should be separate and that does mean not connected to the system.
!