Reducing the component list to benchmarked parts shows that the biggest difference between systems is the choice of 3-way GTX 285 or two-way GTX 295 SLI configurations.
However, both companies also offer the competitor’s graphics and motherboard configuration as an option, and everyone expects four GTX 275 graphics processors (two go into each dual-GPU GeForce GTX 295) to beat three GTX 285s. Is this even a fair fight?
iBuyPower also used a far more expensive processor, but its slightly lower overclock could tip the performance scale towards Maingear’s less-expensive part.
Swipe to scroll horizontally
Benchmark Configuration
3D Games
Call of Duty: World at War
Patch 1.1, FRAPS/saved game High Textures, No AA / No AF, vsync off Ultra Textures, 4x AA / Max AF, vsync off
Crysis
Patch 1.2.1, DirectX 10, 64-bit executable, benchmark tool Test Set 1: High Quality, No AA Test Set 2: Very High Quality, 8x AA
Far Cry 2
DirectX 10, Steam Version, in-game benchmark Test Set 1: High Quality, No AA Test Set 2: Ultra High Quality, 8x AA
World in Conflict
Patch 1009, DirectX 10, timedemo Test 1: High Details, No AA / No AF Test 2: Very HighDetails 4x AA / 16x AF
Audio/Video Encoding
iTunes 8
Version: 8.1.0.52 (x64) Audio CD ("Terminator II SE"), 53 min Default format AAC
Lame MP3
Version: 3.98 64bits (07-04-2008) Audio CD "Terminator II SE," 53 min wave to MP3
TMPGEnc 4.6
Version: 4.6.3.268 Import File: Terminator 2 SE DVD (5 Minutes) Resolution: 720x576 (PAL) 16:9
Bravo for the editor's note on page 9. I'm downright excited to see CNET and Tom's Hardware giving attention to keeping system builders honest when it comes to system reviews. In addition, I do think that in the end, most consumers value a problem free process and fast, reliable support even more than they value a few percentage points performance gain (Or am I off base here? Please comment!).
Yet that aspect of system builders is missed by the current review process. I'd love to see even more about the ordering and support process, but you're right that would require a "secret shopper" method.
I can't speak for all boutique builders, but I bet you would find many of us extremely receptive to any ideas you may have on how we can help mitigate the costs of a secret shopper program in a way that preserves the fairness and anonymity of the review process.
Jon Bach
President - Puget Systems
http://www.pugetsystems.com
sepukoWhy do the systems have different video driver packages? You call that a fair comparison ?
That's the way they shipped them, so it's the ONLY way to run a fair comparison: NO MODIFICATIONS.
Also notice that the system with the newest drivers lost. We tried ripping out the newer drivers and putting in the older ones: a few benchmarks lost around 0.1-1.0 FPS with the "matching" drivers, but it really wasn't worth the time to finish retesting since it only made the worst-performing system perform slightly worse than it had when it first lost. An increased loss of less than 1% (average) is still a loss and the difference isn't noteworthy.
If they are going to put in premium parts, why do they buy ugly cases to stick them in? When are PC makers going to put more attention into more attractive cases?
I like seeing a silverstone chassis in there. Nice to know they ain't just tossing all the nice stuff into an average garbage bin from antec or something (like we cost concious people do).