- Jun 28, 2003
- 1
- 0
- 18,510
I read with interest the dispute between Nvidia, Futuremark and Ati over cheating and the benchmarks. I am a relative novice so forgive me for the comment I am about to make if I am wide of the mark.
It seems to me that the whole structure of benchmark testing set up under Futuremark is highly suspect if not completely misleading. Imagine an education system where the questions set in major examinations were determined by a collection of lobbyists comprising the school govenors and teachers. Where the teachers were allowed to return to the classroom armed with the fore knowledge of what the questions in the examinations were going to be, and to be allowed to prep their students to answer each question in the manner that would achieve the highest marks. The results would show the abilities of the students to answer specific questions but would hardly reflect the student's abilities within the subject as a whole. In the same way these manufacturers have not only been allowed to determine how the tests were conducted but were also allowed to prepare their products to perform best under the specific testing regime established by themselves. These benchmarks were then passed onto the public as a 'true' reflection of a card's performance, when in fact it was on a reflection of a card's specific performance within a restricted crtieria.
Would it not be better for an independent consumer organisation to determine the benchmark tests away from the inference of the OEMS and manufacturers?
It seems to me that the whole structure of benchmark testing set up under Futuremark is highly suspect if not completely misleading. Imagine an education system where the questions set in major examinations were determined by a collection of lobbyists comprising the school govenors and teachers. Where the teachers were allowed to return to the classroom armed with the fore knowledge of what the questions in the examinations were going to be, and to be allowed to prep their students to answer each question in the manner that would achieve the highest marks. The results would show the abilities of the students to answer specific questions but would hardly reflect the student's abilities within the subject as a whole. In the same way these manufacturers have not only been allowed to determine how the tests were conducted but were also allowed to prepare their products to perform best under the specific testing regime established by themselves. These benchmarks were then passed onto the public as a 'true' reflection of a card's performance, when in fact it was on a reflection of a card's specific performance within a restricted crtieria.
Would it not be better for an independent consumer organisation to determine the benchmark tests away from the inference of the OEMS and manufacturers?
Facebook
Twitter
Instagram