Sign in with
Sign up | Sign in

Results: PCMark 7 And PCMark Vantage

SSD Deathmatch: Crucial's M500 Vs. Samsung's 840 EVO
By

Futuremark's PCMark 7: Secondary Storage Suite

PCMark 7 uses the same trace-based technology as our Storage Bench v1.0 for its storage suite testing. It employs a geometric mean scoring system to generate a composite, so we end up with PCMarks instead of a megabytes per second. One-thousand points separate the top and bottom, but that encompasses a far larger difference than the score alone indicates.

This test is a big improvement over the older PCMark Vantage, at least for SSD benchmarking. The storage suite is comprised of several small traces. At the end, the geometric mean of those scores is scaled with a number representing the test system's speed. The scores generated are much different from PCMark Vantage, and many manufacturers are predisposed to dislike it for that reason. It's hard to figure out how PCMark 7 "works" because it uses a sliding scale to generate scores. Still, it represents one of the best canned benchmarks for storage, and if nothing else, it helps reinforce the idea that the differences in modern SSD performance don't necessarily amount to a better user experience in average consumer workloads.

The M500s place strangely. They don't light up the scoreboard, and I wasn't expecting that (particularly the two models placing way at the back). You shouldn't get hung up on one benchmark when it comes to characterizing a product's performance, but it's hard not to let the two smallest M500 SSD's scores taint our opinion. Shoot, the 120 GB is sandwiched between two 64 GB class SSDs, while the 240 GB is wedged between two 120 GB disks.

The 480 and 960 GB models register more respectable scores, though.

Futuremark's PCMark Vantage: Hard Drive Suite

PCMark's Vantage isn't the paragon of SSD testing, mainly because it's old and wasn't designed for the massive performance solid-state technology enables. Intended to exploit the new features in Windows Vista, Vantage was certainly at the forefront of consumer storage benching at the time. Vantage works by taking the geometric mean of composite storage scores and then scaling them a lot like PCMark 7 does. But in Vantage's case, this scaling is achieved by arbitrarily multiplying the geometric sub-score mean by 214.65. That scaling factor is supposed to represent an average test system of the day (a system that's now close to a decade behind the times). PCMark 7 improves on this by creating a unique system-dependent scaling factor and newer trace technology.

Why bother including this metric, then? A lot of folks prefer Vantage in spite of or because of the cartoonish scores and widespread adoption. That, and the fact that most every manufacturer uses the aged benchmark in box specs and reviewer-specific guidelines. In fairness, Vantage's Hard Drive suite wasn't designed with SSDs in mind, and is actually quite good as pointing out which 5400 RPM mechanical disk might be preferable.

In the more heavily 4 KB-weighted Vantage testing, the lower-capacity M500s redeem themselves. The 120 GB version even scores above the Intel SSD 335 and OCZ Vertex 3, both with 20 nm flash (though still using 64 Gb dies).

Ask a Category Expert

Create a new thread in the Reviews comments forum about this subject

Example: Notebook, Android, SSD hard drive

Display all 29 comments.
This thread is closed for comments
  • 2 Hide
    Someone Somewhere , August 6, 2013 11:38 PM
    I think you mixed up the axis on the read vs write delay graph. It doesn't agree with the individual ones after, or the writeup.
  • 8 Hide
    Someone Somewhere , August 6, 2013 11:57 PM
    Even 3bpc SSDs should last you a good ten years...

    The SSD 840 is rated for 1000 P/E cycles, though it's been seen doing more like ~3000. At 10GB/day, a 240GB would last for 24,000 days, or about 766 years, and that's using the 1K figure.

    You're free to waste money if you want, but SLC now has little place outside write-heavy DB storage.

    EDIT: Screwed up by an order of magnitude.
  • 6 Hide
    cryan , August 7, 2013 12:20 AM
    Quote:
    I think you mixed up the axis on the read vs write delay graph. It doesn't agree with the individual ones after, or the writeup.


    You are totally correct! You win a gold star, because I didn't even notice. Thanks for catching it, and it should be fixed now.

    Regards,
    Christopher Ryan

  • 2 Hide
    cryan , August 7, 2013 12:24 AM
    Quote:
    I would only buy SSD that uses SLC memory. I dont wan't to buy new drive every year or so.


    Not only are consumer workloads completely gentle on SSDs, but modern controllers are super awesome at expanding NAND longevity. I was able to burn through 3000+ PE cycles on the Samsung 840 last year, and it only is rated at 1,000 PE cycles or so. You'd have to put almost 1 TB a day on a 120 GB Samsung 840 TLC to kill it in a year, assuming it didn't die from something else first.

    Regards,
    Christopher Ryan

  • 8 Hide
    Someone Somewhere , August 7, 2013 2:57 AM
    I'd like to see some sources on that - for starters, I don't think the 840 has been out for a year, and it was the first to commercialize 3bpc NAND.

    You may be thinking of the controller failures some of the Sandforce drives had, which are completely unrelated to the type of NAND used.
  • 2 Hide
    mironso , August 7, 2013 3:57 AM
    Well, I must agree with Someone Somewhere. I would also like to see sources for this statement: "Yes, in theory they last 10 years, in practise they last a year or so.".
    I would like to see, can TH use SSD put this 10GB/day and see for how long it will work.
    After this I read this article, I think that Crucial's M500 hit the jackpot. Will see Samsung's response. And that's very good for end consumer.
  • -1 Hide
    edlivian , August 7, 2013 3:58 AM
    It was sad that they did not include the samsung 830 128gb and crucial m4 128gb in the results, those were the most popular ssd last year.
  • 8 Hide
    Someone Somewhere , August 7, 2013 4:27 AM
    You can also find tens of thousands of people not complaining about their SSD failing. It's called selection bias.

    Show me a report with a reasonable sample size (more than a couple of dozen drives) that says they have >50% annual failures.

    A couple of years ago Tom's posted this: http://www.tomshardware.com/reviews/ssd-reliability-failure-rate,2923.html

    The majority of failures were firmware-caused by early Sandforce drives. That's gone now.

    EDIT: Missed your post. First off, that's a perfect example of self-selection. Secondly, those who buy multiple SSDs will appear to have n times the actual failure rate, because if any fail they all appear to fail. Thirdly, that has nothing to do with whether or not it is a 1bpc or 3 bpc SSD - that's what you started off with.

    Quote:
    This doesn't fix the problem of audience self-selection
  • 7 Hide
    Someone Somewhere , August 7, 2013 5:27 AM
    You were however trying to stop other people buying them...

    Sounds a bit like a sore loser argument, unfortunately.

    SSDs aren't perfect, but they generally do live long enough to not be a problem. Most of the failures have been overcome by now too.

    Just realised there's an error in my original post - off by a factor of ten. Should have been 66 years.
  • 4 Hide
    warmon6 , August 7, 2013 5:30 AM
    Quote:
    I am not talking about Samsung SSD-s, I am talking about SSDs in general. And I am not going to provide any sources because SSD fail all the time after a year or so. That is the raility. You can find, on the internet, people complaining abouth their SSD failing. There are a lot of them...
    Also, SLC based SSD-s are usually "enterprise", so they are designed for reliability and not performance, and they don't use some bollocks, overclocked to the point of failure, controllers. And have better optimised firmware...


    Tell that to all the people on this forum still running intel X-25M that launched all the way back in 2008 and my Samsung 830 that's been working just fine for over a year.......

    See what you're paying attention too is the loudest group of ssd owners. The owners that have failed ssd's.

    See it's the classic "if someone has a problem, there going to be the one that you hear and the quiet group, isn't having the problem" issue.

    Those that dont have issues (such as myself) dont mention about our ssds and is probably complaining about something else that has failed.


  • 6 Hide
    Someone Somewhere , August 7, 2013 5:43 AM
    Quote:
    Yes, in theory they last 10 years, in practise they last a year or so.

    Quote:
    because SSD fail all the time after a year or so.


    Those don't seem like opinions to me. It's customary to include some form of leeway in the sentence, like 'IMHO', 'often', or 'I've heard' etc.
  • 5 Hide
    InvalidError , August 7, 2013 7:10 AM
    Quote:
    At 10GB/day, a 240GB would last for 24,000 days, or about 766 years, and that's using the 1K figure.

    Assuming the system has more than enough RAM to avoid needing any significant amount of swapping. If someone with 4GB RAM uses a 16GB swapfile to avoid upgrading to the 8-16GB RAM he really should have, he could end up writing over 1GB/minute.

    I have ended up over-crowding my RAM many times in the past and it has a tendency to make my computers practically unusable when using mechanical HDDs at which point I had to spread my programs and swapfile across multiple HDDs to reduce the IO load on individual drives. I imagine this would burn through SSDs fairly quickly.
  • 4 Hide
    jryder , August 7, 2013 7:13 AM
    Quote:
    I am not talking about Samsung SSD-s, I am talking about SSDs in general. And I am not going to provide any sources because SSD fail all the time after a year or so. That is the raility. You can find, on the internet, people complaining abouth their SSD failing. There are a lot of them...
    Also, SLC based SSD-s are usually "enterprise", so they are designed for reliability and not performance, and they don't use some bollocks, overclocked to the point of failure, controllers. And have better optimised firmware...


    Anecdotal evidence is pretty useless. People with very good or very bad experiences tend to write reviews. People generally don't write reviews for random pieces of hardware that just work as expected. Provide citations with statistics to support your statements if you want anyone to take them seriously.
  • 8 Hide
    colson79 , August 7, 2013 7:26 AM
    Quote:
    Are you bloody shitting me?! What am I, a mechanical drive lobby, spreading anti-SSD propaganda???

    I will not be replying to this topic any more. All I wanted to do is say my opinion, but there had to be some smartass telling me that I don't have the right to do it. Noooo, I have to source it. This is my oppinion, get over it.


    You are entitled to your opinion but you are making bold statements without any facts. A lot of people use forums like these to research products they are thinking about buying and you are spreading misinformation about SSD's without and evidence for your statements. I personally have 4 computers with SSD's in them that are over 2 years old and I haven't had a single issue or failure. It really pisses me off when people start spreading inaccurate statements that may turn away a potential user of a SSD. Out of all the PC upgrades I have done in the past 12 years the SSD has been the best most noticeable improvement I have done.
  • 4 Hide
    Onus , August 7, 2013 8:51 AM
    Disagreement among techies is inevitable, but please watch language.


    Just to stick an oar into the reliability issue, my Samsung 830 has run reliably for over two years now. The only SSDs I had fail in use were a couple of Sandforce drives, but their replacements have thus far been reliable. I think InvalidError has a good point about RAM though; I tend to use at least 8GB, which probably cuts down swapping quite a bit. I also prefer to close programs completely rather than have a lot of windows open, which would also reduce swapping. With a SSD, they re-open pretty quickly anyway.
  • 0 Hide
    dalethepcman , August 7, 2013 9:54 AM
    Wow, nice 180 there anti global. I have used many SSD's in both enterprise and personal use, and their reliability has been on par with enterprise level HDD's. We currently use a mix of Samsung 830/840's and crucial m400's for SSD's and with the increased capacity and incredible price drops, the m500 would be an easy drop in upgrade.
  • 2 Hide
    bullwinkel , August 7, 2013 10:12 AM
    I've purchased 3 different SSDs over the last 2 years. My first purchase was an Agility 3 64gb that I used as a boot drive for my machine that I just build. About 6 months later I purchased an M4 128gb to be used for running select applications. About 6 months after the M4 purchase, I bought an 840 500gb. I moved my OS to the M4, applications to the 840 and gave my Agility 3 to my brother to be used in his machine as a boot drive. Never had a single problem with any of them. SSDs are fantastic. Pretty soon, when the price of the TB drives come further, the only mechanical storage I'll be using is for backups.
  • 3 Hide
    rrbronstein , August 7, 2013 11:21 AM
    Quote:
    Are you bloody shitting me?! What am I, a mechanical drive lobby, spreading anti-SSD propaganda???

    I will not be replying to this topic any more. All I wanted to do is say my opinion, but there had to be some smartass telling me that I don't have the right to do it. Noooo, I have to source it. This is my oppinion, get over it.


    LOL, when you come onto an article about SSD's and say nonsense like you did, you have to expect to get hate buddy. MLC/TLC is very viable and lasts much longer than a year kid, some drives do fail, and if they do you get your replacement. Other peoples drives are not lemons and last a normal lifetime, common sense bro.

  • 2 Hide
    anything4this , August 7, 2013 12:39 PM
    As stated, it was mostly sandforce drives that failed. Have bought 7 SSD's (Crucial, Samsung, Plextor) and all are working perfectly awesome (rather than just fine :p  )
  • 3 Hide
    ethanolson , August 7, 2013 9:26 PM
    My wife is running an X-25M G2 and I just got an M500. The X-25M gave her at least two more years out of her system and the M500... holy cow is this thing awesome! Everything feels like it should.

    Oh, I highly recommend getting the drive migration kit from Crucial for ~$20. It makes like much easier. It's a USB 3.0 SATA drive connector for your M500. Then just boot the supplied CD and run it in auto mode to copy over your drive exactly and make any sizing adjustments needed to the partitions to get it to fit. It works very nicely.
Display more comments