Download the Tom's Hardware App from the App Store
The reference for current tech news
Yes No
Ads

BAPCo Bites Back at AMD's Departure

by - source: BAPCo Email

BAPCo responded to AMD's allegations about SYSmark 2012 and the benchmark's alleged favoritism for another CPU manufacturer.

Wednesday morning we received a statement from Business Applications Performance Corporation (BAPCo) in regards to Tuesday's report about the departure of AMD. In a nutshell, AMD didn't agree with the direction SYSmark 2012 was taking, so the CPU manufacturer decided to leave BAPCo and retract its endorsement for the benchmark. On Wednesday BAPCo decided to respond.

"BAPCo is a non-profit consortium made up of many of the leaders in the high tech field, including Dell, Hewlett-Packard, Hitachi, Intel, Lenovo, Microsoft, Samsung, Seagate, Sony, Toshiba and ARCintuition," the company said in an emailed letter. "For nearly 20 years BAPCo has provided real world application based benchmarks which are used by organizations worldwide.  SYSmark 2012 is the latest release of the premiere application based performance benchmark.  Applications used in SYSmark 2012 were selected based on market research and include Microsoft Office, Adobe Creative Suite, Adobe Acrobat, WinZip, Autodesk AutoCAD and 3ds Max, and others."

"Advanced Micro Devices (AMD) was, until recently, a long standing member of BAPCo.," the consortium continued. "We welcomed AMD's full participation in the two year development cycle of SYSmark 2012, AMD's leadership role in creating the development process that BAPCo uses today and in providing expert resources for developing the workload contents.  Each member in BAPCo gets one vote on any proposals made by member companies.  AMD voted in support of over 80% of the SYSmark 2012 development milestones, and were supported by BAPCo in 100% of the SYSmark 2012 proposals they put forward to the consortium."

"BAPCo also notes for the record that, contrary to the false assertion by AMD, BAPCo never threatened AMD with expulsion from the consortium, despite previous violations of its obligations to BAPCo under the consortium member agreement.

"BAPCo is disappointed that a former member of the consortium has chosen once more to violate the confidentiality agreement they signed, in an attempt to dissuade customers from using SYSmark to assess the performance of their systems.  BAPCo believes the performance measured in each of the six scenarios in SYSmark 2012, which is based on the research of its membership, fairly reflects the performance that users will see when fully utilizing the included applications."

Tuesday AMD hinted that SYSmark 2012 doesn't provide "clear and reliable measurements" and is "misleading" thanks to the use of unrepresentative workloads that seemingly favors one particular non-AMD CPU manufacturer. AMD's Nigel Dessau even said that AMD tried to work within the BAPCo consortium in order to get the next-generation benchmark, SYSmark 2012, correct. He also stressed that it needed to be open, transparent and processor-neutral, but apparently the company went unheeded.

"Our good intentions were met with an outcome that we believe does a disservice to the industry and our customers," he said. "We weren’t able to effect positive change within BAPCo, and the resulting benchmark continues to distort workload performance and offers even less transparency to end users."

Share:
42
Comments
X
Submit

Comments
Add your comment
Ciuy 06/23/2011 1:22 AM
Hide
-5+

Didnt even know such a program (SYSmark 2012 oe 2011 or whatever) existed :o.

Wont know either now, i dont have an Intel cpu .

Flameout 06/23/2011 1:35 AM
Hide
-19+

blah blah blah it's funny how they just talk about other bs and not actually respond to whether their software is biased. with the muscle intel has, is it really any surprise that amd always gets the sh1t end of the stick

Wisecracker 06/23/2011 1:37 AM
Hide
-3+

PassMark 'CPU Marks' sucks worse that BAPCo 'Sysmarks' It's a synthetic test race to the bottom between those two.

And for those with a little spare cash laying around, you can buy your way into BAPCo for 20-large.

KT_WASP 06/23/2011 1:46 AM
Hide
-18+

This all rings hollow, especially since independent third parties have proven that the software is biased. What we have here, is, a poor attempt at damage control.

Move along, nothing to see here.....Just like their benchmarking software.

dogman_1234 06/23/2011 1:59 AM
Show
dalauder 06/23/2011 2:03 AM
Show
sykozis 06/23/2011 2:07 AM
Hide
-16+

I got a good laugh at this...

Quote :In the CRN Test Center, we agree; we gave up using SysMark years ago, and for some of the same reasons.

Source: http://www.crn.com/news/applicatio [...] e-quit.htm

Seems BAPco is simply trying to "pull the wool over our eyes" so to speak.... It was also found by other sites, that by changing the CPUID, you could effectively alter the benchmark results. If that is actually true, it would seem that BAPco is trying to work as a marketing team for Intel.

rohitbaran 06/23/2011 2:24 AM
Hide
--2+

BAPCo should be renamed BarkCo!

eddieroolz 06/23/2011 2:39 AM
Hide
-7+

The howls of a lost dog. AMD was right in departing.

Anonymous 06/23/2011 6:00 AM
Hide
-8+

Hmmm - no comment by BAPCo that Nvidia & VIA also just quit BAPCo at the same time for the same reasons

DjEaZy 06/23/2011 6:04 AM
Hide
-3+

... but many use irrelevant synthetic benchmarks or don't use benchmarks that show the power of GPGPU... sometimes i see tests for a system like mine and wonder, where come the low results from... my system behave much faster... in a real world applications... but that is, because i use a GPU too for some heavy operations... it's much faster...

masterofevil22 06/23/2011 6:24 AM
Hide
--1+

Software in general is optimized for Intel cpu's bc THEY HAVE GREATER MARKET SHARE and quite simply a larger percentage of software developers' end users are going to see better performance by doing this. That's just the way it is.

beenthere 06/23/2011 7:20 AM
Hide
-3+

I fully support AMD's position on the bogus BAPCo bench and will not use this bench in consideration for any future purchases as it is unreliable and disengenuous.

Anonymous 06/23/2011 8:03 AM
Show
tajisi 06/23/2011 8:08 AM
Hide
-0+

The problem, as I understand it, is that supposedly everything is compiled for Intel chips and gives Intel an artificial advantage. Thus, apparently, every benchmark site that gives an Intel chip a better review or shows higher performance is a part of a greater conspiracy. Also apparently the sky is blue due to NASA sending too many blueberries and Smurfs into space. Same difference -- next time use chipmunks.

I'd be just as doubtful if Intel claimed the same about AMD.

Anonymous 06/23/2011 9:08 AM
Hide
-5+
noob2222 06/23/2011 9:16 AM
Hide
-3+

dalauder :
Well now I'd like Tom's to run a test of BAPCo (stupid name, btw.) benchmarks. Tom's Hardware, like myself, is sympathetic to the underdog AMD, so it might not be best to risk hurting AMD if the benchmark makes them look bad while being accurate.The only way I really see Sysmark 2012 being biased is if the home user workloads use more than one or two threads since very few typical user applications are multi-threaded.



That is the inherent problem with Sysmark 2007, whether they continued the "dual thread only" for 2012 would explain why AMD would leave. you don't make a cpu only to have benchmark software test 1/4 of the power that is available.

Seriously tho, how much faster can microsoft office load.

Person A .. wow this doctument loaded in 1/2 a second.
Person B ... haha mine only took 1/4 second.

Here is another interesting fact on how disappointing Sysmark 2012 is.
Quote : Without newer browsers, HTML5 is basically untested by SM12, and while we understand that SM12 has been in development for a while, for something calling itself 2012 to include mostly 2010 applications feels out of place.


What this tells me is that Sysmark (updated every 5 or so years) will only be up to date on current software .... never.

silverblue 06/23/2011 10:25 AM
Hide
-2+

specialk9 :
I am surprised soo many of you are backing AMD. They are soooo far behind Intel that they are trying to discredit a benchmark that shows this. Seeing as Adobe Creative Suite is part of this benchmark, AMD probably fought extremely hard to get rid of it because they don't have the newer SSE extensions; thus, Intel walks all over them (in Premiere Pro CS5). Just search PPBM5 and see how badly AMD does in rendering and encoding tests.


The thing is, I'm curious about the timing. Bulldozer does indeed have the broadest support for extensions out of any AMD and Intel CPU and would indeed sufficiently outperform previous AMD offerings. Is this anything like the compiler furore we had over the past years where all CPUs are equal but some are more equal than others...?

I'm afraid I know very little on this subject so I'd like to know which tests performed particularly badly on AMD hardware. I do believe, however, that - going back to the subject of compilers - Intel were ordered to remove the code that purposefully hijacks performance on non-Intel CPUs.

aznshinobi 06/23/2011 10:48 AM
Hide
-3+

So Tom's, when you guys going to release an article about whether or not Sysmark is bias?

nebun 06/23/2011 2:16 PM
Show
REYNOD 06/23/2011 2:53 PM
Hide
-1+

Yeah ... particularly when their latest cpu's fr low power devices cream Intel ... good time to leave?

I don't think so.

Might be a good time to leave for NVidia in the IGP space as they have nothing to offer now with the low end 5 and 6 series ATI GPU integrated on die for the Brazos and Llanos CPU's ... and at the muckier end even the Intel ondie GPU ... whatever its called on the i3's and anon.

ta152h 06/23/2011 3:34 PM
Show
geekapproved 06/23/2011 3:54 PM
Hide
-3+

You can bet your last dollar Intel had a hand in this to make AMD score bad on the test to make their product look that much better. Intel has a history of shady business practices aimed at downing AMD, even if that includes illegal sales incentives and patent violations. Same old same old.

wiyosaya 06/23/2011 3:54 PM
Hide
-1+

Is anyone who is in the know going to pay any attention to what BAPco is saying on this matter?

BAPco has had its 15-mins of fame. Time for them to face up to the fact that their benchmark is an Intel marketing tool.

gto127 06/23/2011 4:08 PM
Hide
-2+

I agree with AMD'S decision to leave. Since the benchmark only comes out about every 5 years it should include software that will test the most updated scenarios such as GPU processing which is where processing is headed.

justjc 06/23/2011 4:41 PM
Hide
-2+

woops forgot Office that is tested as 2010, where the new Office 11 also supports the use of the GPU to lighten the workload for the CPU.

If nothing else all these examples show how out of date a benchmark not giving the GPU any value is today and I almost don\t dare to think how many of the programs on the list at http://www.bapco.com/products/sysm [...] ations.php will also have been switched with GPU accelerated versions in the year this bnchmark is supposed to represent by its name.

A clear fail, most likely due to BAPCo still favoring to Intel who would loose greatly if GPU friendly languages like OpenCL entered the picture. .

justjc 06/23/2011 4:46 PM
Hide
-3+

justjc :
woops forgot Office that is tested as 2010, where the new Office 11 also supports the use of the GPU to lighten the workload for the CPU. If nothing else all these examples show how out of date a benchmark not giving the GPU any value is today and I almost don\t dare to think how many of the programs on the list at http://www.bapco.com/products/sysm [...] ations.php will also have been switched with GPU accelerated versions in the year this bnchmark is supposed to represent by its name.A clear fail, most likely due to BAPCo still favoring to Intel who would loose greatly if GPU friendly languages like OpenCL entered the picture. .



Somehow my previous message never posted...
I only pointed out that in the most used parts of the everyday experience, surfing the net, the software chosen somehow always was the last version before the software got GPU acceleration.

They choose IE8, where IE9 uses the GPU
and Firefox 3.6.8, where 3.7 was renamed Firefox 4 and use the GPU
finally they decided to go with Adobe Flash 10.1, where all later versions have GPU acceleration.

fir_ser 06/23/2011 4:57 PM
Hide
-2+

If AMD SYSmark is unfair for AMD’s processors then I agree with its decision in leaving the consortium .

otacon72 06/23/2011 6:47 PM
Show
otacon72 06/23/2011 6:50 PM
Show
Anonymous 06/23/2011 7:30 PM
Hide
-3+

@otacon72

Given the right conditions a car could appear to be faster then an airplane (accelerating over 100m), must make you feel proud to believe your car is faster then an airplane.....

ps i think you missed the article about cracking an encrypted file with GPU assistance, junk indeed


Ads

Best offers

Newsletters


OK
Ads