BAPCo Bites Back at AMD's Departure
BAPCo responded to AMD's allegations about SYSmark 2012 and the benchmark's alleged favoritism for another CPU manufacturer.
Wednesday morning we received a statement from Business Applications Performance Corporation (BAPCo) in regards to Tuesday's report about the departure of AMD. In a nutshell, AMD didn't agree with the direction SYSmark 2012 was taking, so the CPU manufacturer decided to leave BAPCo and retract its endorsement for the benchmark. On Wednesday BAPCo decided to respond.
"BAPCo is a non-profit consortium made up of many of the leaders in the high tech field, including Dell, Hewlett-Packard, Hitachi, Intel, Lenovo, Microsoft, Samsung, Seagate, Sony, Toshiba and ARCintuition," the company said in an emailed letter. "For nearly 20 years BAPCo has provided real world application based benchmarks which are used by organizations worldwide. SYSmark 2012 is the latest release of the premiere application based performance benchmark. Applications used in SYSmark 2012 were selected based on market research and include Microsoft Office, Adobe Creative Suite, Adobe Acrobat, WinZip, Autodesk AutoCAD and 3ds Max, and others."
"Advanced Micro Devices (AMD) was, until recently, a long standing member of BAPCo.," the consortium continued. "We welcomed AMD's full participation in the two year development cycle of SYSmark 2012, AMD's leadership role in creating the development process that BAPCo uses today and in providing expert resources for developing the workload contents. Each member in BAPCo gets one vote on any proposals made by member companies. AMD voted in support of over 80% of the SYSmark 2012 development milestones, and were supported by BAPCo in 100% of the SYSmark 2012 proposals they put forward to the consortium."
"BAPCo also notes for the record that, contrary to the false assertion by AMD, BAPCo never threatened AMD with expulsion from the consortium, despite previous violations of its obligations to BAPCo under the consortium member agreement.
"BAPCo is disappointed that a former member of the consortium has chosen once more to violate the confidentiality agreement they signed, in an attempt to dissuade customers from using SYSmark to assess the performance of their systems. BAPCo believes the performance measured in each of the six scenarios in SYSmark 2012, which is based on the research of its membership, fairly reflects the performance that users will see when fully utilizing the included applications."
Tuesday AMD hinted that SYSmark 2012 doesn't provide "clear and reliable measurements" and is "misleading" thanks to the use of unrepresentative workloads that seemingly favors one particular non-AMD CPU manufacturer. AMD's Nigel Dessau even said that AMD tried to work within the BAPCo consortium in order to get the next-generation benchmark, SYSmark 2012, correct. He also stressed that it needed to be open, transparent and processor-neutral, but apparently the company went unheeded.
"Our good intentions were met with an outcome that we believe does a disservice to the industry and our customers," he said. "We weren’t able to effect positive change within BAPCo, and the resulting benchmark continues to distort workload performance and offers even less transparency to end users."
- AMD,
- Business,
- BAPCo ,
- SYSmark-2012 ,
- Consortium ,
- benchmark ,
- misleading
- AMD Won't Endorse SYSmark 2012 Benchmark
- Nvidia Intros Beta Driver Supporting SLI on AMD 900 Series
- id Considering Quake Reboot, Going Back to Roots
- City of Heroes Going Free to Play
- Deals for June 21: 15.6" Dell XPS 15 i5 $699.99
- Suspected LulzSec Ringleader Arrested in Essex
- Windows Much Safer After Microsoft Killed Autorun
- Samsung's Solar Powered Netbook Goes Russian
- Firefox 5 Officially Released; Download it Here!
- id Software Launching RAGE Early... As a Comic?
- EA Blocks Wang From Entering Origin [UPDATED]
- Deals June 23: 27" Dell UltraSharp IPS 25% Off
- Dungeon Siege 3 Dev Promises to Fix PC Controls
- ARM-Based Notebooks Are On The Way
- Rift Developer: WoW's Current State is ''Samey''
- LaCie CloudBox Stores Data Locally & in Cloud
- Seagate Announces Hard Drives For Tablets
- Diablo 3 Beta Details Arriving Soon?







Didnt even know such a program (SYSmark 2012 oe 2011 or whatever) existed
.
Wont know either now, i dont have an Intel cpu .
blah blah blah it's funny how they just talk about other bs and not actually respond to whether their software is biased. with the muscle intel has, is it really any surprise that amd always gets the sh1t end of the stick
PassMark 'CPU Marks' sucks worse that BAPCo 'Sysmarks' It's a synthetic test race to the bottom between those two.
And for those with a little spare cash laying around, you can buy your way into BAPCo for 20-large.
This all rings hollow, especially since independent third parties have proven that the software is biased. What we have here, is, a poor attempt at damage control.
Move along, nothing to see here.....Just like their benchmarking software.
Slap...from a slap.
Seems like AMD has been getting crap we are not getting to understand. If so, i wouldn't doubt the Intel Cousin would leave because of its bigger cousin...Intel.
Well now I'd like Tom's to run a test of BAPCo (stupid name, btw.) benchmarks. Tom's Hardware, like myself, is sympathetic to the underdog AMD, so it might not be best to risk hurting AMD if the benchmark makes them look bad while being accurate.
The only way I really see Sysmark 2012 being biased is if the home user workloads use more than one or two threads since very few typical user applications are multi-threaded. Other than that, the benchmarks should be faster on whatever CPU is faster.
I'm pretty sure 3dsmax and AutoCAD are faster on current non-AMD CPUs. We are talking about Intel, right?
I got a good laugh at this...
Source: http://www.crn.com/news/applicatio [...] e-quit.htm
Seems BAPco is simply trying to "pull the wool over our eyes" so to speak.... It was also found by other sites, that by changing the CPUID, you could effectively alter the benchmark results. If that is actually true, it would seem that BAPco is trying to work as a marketing team for Intel.
BAPCo should be renamed BarkCo!
The howls of a lost dog. AMD was right in departing.
Hmmm - no comment by BAPCo that Nvidia & VIA also just quit BAPCo at the same time for the same reasons
... but many use irrelevant synthetic benchmarks or don't use benchmarks that show the power of GPGPU... sometimes i see tests for a system like mine and wonder, where come the low results from... my system behave much faster... in a real world applications... but that is, because i use a GPU too for some heavy operations... it's much faster...
Software in general is optimized for Intel cpu's bc THEY HAVE GREATER MARKET SHARE and quite simply a larger percentage of software developers' end users are going to see better performance by doing this. That's just the way it is.
I fully support AMD's position on the bogus BAPCo bench and will not use this bench in consideration for any future purchases as it is unreliable and disengenuous.
I am surprised soo many of you are backing AMD. They are soooo far behind Intel that they are trying to discredit a benchmark that shows this. Seeing as Adobe Creative Suite is part of this benchmark, AMD probably fought extremely hard to get rid of it because they don't have the newer SSE extensions; thus, Intel walks all over them (in Premiere Pro CS5). Just search PPBM5 and see how badly AMD does in rendering and encoding tests.
The problem, as I understand it, is that supposedly everything is compiled for Intel chips and gives Intel an artificial advantage. Thus, apparently, every benchmark site that gives an Intel chip a better review or shows higher performance is a part of a greater conspiracy. Also apparently the sky is blue due to NASA sending too many blueberries and Smurfs into space. Same difference -- next time use chipmunks.
I'd be just as doubtful if Intel claimed the same about AMD.
http://www.osnews.com/story/22683/ [...] _Compiler_
Well now I'd like Tom's to run a test of BAPCo (stupid name, btw.) benchmarks. Tom's Hardware, like myself, is sympathetic to the underdog AMD, so it might not be best to risk hurting AMD if the benchmark makes them look bad while being accurate.The only way I really see Sysmark 2012 being biased is if the home user workloads use more than one or two threads since very few typical user applications are multi-threaded.
That is the inherent problem with Sysmark 2007, whether they continued the "dual thread only" for 2012 would explain why AMD would leave. you don't make a cpu only to have benchmark software test 1/4 of the power that is available.
Seriously tho, how much faster can microsoft office load.
Person A .. wow this doctument loaded in 1/2 a second.
Person B ... haha mine only took 1/4 second.
Here is another interesting fact on how disappointing Sysmark 2012 is.
What this tells me is that Sysmark (updated every 5 or so years) will only be up to date on current software .... never.
I am surprised soo many of you are backing AMD. They are soooo far behind Intel that they are trying to discredit a benchmark that shows this. Seeing as Adobe Creative Suite is part of this benchmark, AMD probably fought extremely hard to get rid of it because they don't have the newer SSE extensions; thus, Intel walks all over them (in Premiere Pro CS5). Just search PPBM5 and see how badly AMD does in rendering and encoding tests.
The thing is, I'm curious about the timing. Bulldozer does indeed have the broadest support for extensions out of any AMD and Intel CPU and would indeed sufficiently outperform previous AMD offerings. Is this anything like the compiler furore we had over the past years where all CPUs are equal but some are more equal than others...?
I'm afraid I know very little on this subject so I'd like to know which tests performed particularly badly on AMD hardware. I do believe, however, that - going back to the subject of compilers - Intel were ordered to remove the code that purposefully hijacks performance on non-Intel CPUs.
So Tom's, when you guys going to release an article about whether or not Sysmark is bias?
AMD is leaving because it can't keep up with intel....they should really just start making video cards
Yeah ... particularly when their latest cpu's fr low power devices cream Intel ... good time to leave?
I don't think so.
Might be a good time to leave for NVidia in the IGP space as they have nothing to offer now with the low end 5 and 6 series ATI GPU integrated on die for the Brazos and Llanos CPU's ... and at the muckier end even the Intel ondie GPU ... whatever its called on the i3's and anon.
The thing is, I'm curious about the timing. Bulldozer does indeed have the broadest support for extensions out of any AMD and Intel CPU and would indeed sufficiently outperform previous AMD offerings. Is this anything like the compiler furore we had over the past years where all CPUs are equal but some are more equal than others...?I'm afraid I know very little on this subject so I'd like to know which tests performed particularly badly on AMD hardware. I do believe, however, that - going back to the subject of compilers - Intel were ordered to remove the code that purposefully hijacks performance on non-Intel CPUs.
AMD is whining because their new products emphasize a new type of processing that these benchmarks, in their opinion, do not adequate use.
You'll get the fools here crying about Intel rigging the game, because they are poor and can't afford Intel and want to cry "conspiracy". The reality is probably very different, although AMD does have something of a point.
Intel had destroyed AMD in performance based on "conventional" workloads. BAPco reflects that. Bulldozer is not going to change anything there. AMD changed the way their processors work, by including two integer units, and emphasizing the GPU in processing. They need benchmarks to use software that will emphasize these advantages, or they will keep losing miserably.
Put another way, if you're using apps that don't use the extra integer unit on the Bulldozer, or the GPU, AMD processors are going to continue to be embarrassed for a long, long time. AMD needs a shift to take advantage of their newest, non-traditional resources, and BAPco obviously was not willing to do it.
You can't blame AMD for wanting this, except BD is not even out, and their Fusion is just out. My guess is that BAPco didn't show any desire to move their in the near future either, leaving AMD the choice of looking lousy in a benchmark they are part of, or having them look lousy in a benchmark they aren't part of.
You can bet your last dollar Intel had a hand in this to make AMD score bad on the test to make their product look that much better. Intel has a history of shady business practices aimed at downing AMD, even if that includes illegal sales incentives and patent violations. Same old same old.
Is anyone who is in the know going to pay any attention to what BAPco is saying on this matter?
BAPco has had its 15-mins of fame. Time for them to face up to the fact that their benchmark is an Intel marketing tool.
I agree with AMD'S decision to leave. Since the benchmark only comes out about every 5 years it should include software that will test the most updated scenarios such as GPU processing which is where processing is headed.
woops forgot Office that is tested as 2010, where the new Office 11 also supports the use of the GPU to lighten the workload for the CPU.
If nothing else all these examples show how out of date a benchmark not giving the GPU any value is today and I almost don\t dare to think how many of the programs on the list at http://www.bapco.com/products/sysm [...] ations.php will also have been switched with GPU accelerated versions in the year this bnchmark is supposed to represent by its name.
A clear fail, most likely due to BAPCo still favoring to Intel who would loose greatly if GPU friendly languages like OpenCL entered the picture. .
woops forgot Office that is tested as 2010, where the new Office 11 also supports the use of the GPU to lighten the workload for the CPU. If nothing else all these examples show how out of date a benchmark not giving the GPU any value is today and I almost don\t dare to think how many of the programs on the list at http://www.bapco.com/products/sysm [...] ations.php will also have been switched with GPU accelerated versions in the year this bnchmark is supposed to represent by its name.A clear fail, most likely due to BAPCo still favoring to Intel who would loose greatly if GPU friendly languages like OpenCL entered the picture. .
Somehow my previous message never posted...
I only pointed out that in the most used parts of the everyday experience, surfing the net, the software chosen somehow always was the last version before the software got GPU acceleration.
They choose IE8, where IE9 uses the GPU
and Firefox 3.6.8, where 3.7 was renamed Firefox 4 and use the GPU
finally they decided to go with Adobe Flash 10.1, where all later versions have GPU acceleration.
If AMD SYSmark is unfair for AMD’s processors then I agree with its decision in leaving the consortium .
Stop whining AMD and stop releasing junk.
Seeing a recent benchmark of AMD and intel CPUs was the most hilarious thing I've read in a long time. APUs are junk.
@otacon72
Given the right conditions a car could appear to be faster then an airplane (accelerating over 100m), must make you feel proud to believe your car is faster then an airplane.....
ps i think you missed the article about cracking an encrypted file with GPU assistance, junk indeed