Futuremark backs down on Nvidia cheat claims

NEWS

Benchmark software company Futuremark has dropped its allegation that graphics card maker Nvidia cheated, ending the dispute between the two firms. "Futuremark now states that Nvidia's driver design is an application-specific optimisation and not a cheat," said Futuremark in a statement. In the mean time, new ZDNet lab tests show that the scores of Nvidia's latest hardware dropped by between 14 and 22 percent using Futuremark's updated testing software, although at higher image-quality settings the Nvidia chip still matches the performance of ATI's latest Radeon. The update of Futuremark's 3DMark03 eliminates the effects of Nvidia's optimisations. (See the full review: Nvidia GeForce FX 5900 Ultra: updated benchmarks) Nvidia and Futuremark issued a carefully-worded fence-mending joint statement on Tuesday. Explaining why it decided to drop its allegation that Nvidia was fudging results, Futuremark said its normal practice was to frown on optimised code, but said it may change this practice. "3DMark03 is designed as an un-optimised DirectX test and it provides performance comparisons accordingly. It does not contain manufacturer-specific optimised code paths," the company said. "Because all modifications that change the workload in 3DMark03 are forbidden, we were obliged to update the product to eliminate the effect of optimisations identified in different drivers so that 3DMark03 continued to produce comparable results. "However, recent developments in the graphics industry and game development suggest that a different approach for game performance benchmarking might be needed, where manufacturer-specific code path optimisation is directly in the code source. Futuremark will consider whether this approach is needed in its future benchmarks." Last week Futuremark, one of the leading benchmark software providers, alleged that Nvidia tweaked software needed to run its new GeForce FX 5900 processor to distort performance in Futuremark's 3DMark03 testing application. The company said drivers -- software files that govern how a component interacts with the rest of the PC -- for the new Nvidia chip were altered to detect activity characteristic of a benchmark and adjust performance accordingly. Benchmarks can be important to the prestige, if not the market share, of graphics chip makers. Nvidia is in the midst of a hard-fought battle with rival ATI Technologies to claim the performance lead in PC graphics processors. After years of Nvidia dominating both in market share and performance, ATI took the speed lead last year with new versions of its Radeon chips. After settling manufacturing issues that resulted in ongoing delays of product launches, Nvidia hoped to regain the performance lead this year with the 5900. When ZDNet testers originally ran 3DMark03 tests, using Build 320, Nvidia's 5900 Ultra ran circles around the ATI 9800 Pro 256MB. Under the updated Build 330, the 5900 Ultra's 3DMark03 scores dropped by between 14 and 22 percent, depending on the resolution and the feature settings, testers said. At both 1,024 by 768 and 1,600 by 1,200 with no advanced features enabled, the Radeon 9800 Pro 256MB is now noticeably faster. However, once anti-aliasing and anisotropic filtering are enabled, the performance of the two cards is almost identical. Results remained mixed for other tests, as they had been under the original Build 320 results, and testers said that neither card could be said to have taken a decisive lead. However, that is an improvement for Nvidia, whose previous GeForce FX 5800 Ultra did not measure up to the competition. ZDNet UK's Matthew Broersma and CNET News.com's David Becker contributed to this report.

See Chips Central for the latest headlines on processors and semiconductors. To find out more about the computers and hardware that these chips are being used in, see ZDNet UK's Hardware News Section. Let the Chips Central editor know what you think by email. And sign up for the weekly Chips Central newsletter.

Post your comment

In order to post a comment you need to be registered and logged in.

You can also log in with Facebook. Log in or create your ZDNet UK account below

By signing up for this service, you indicate that you agree to our Terms and Conditions and have read and understood our Privacy Policy. Questions about membership? Find the answers in the Community FAQ

ZDNet UK Live

I totally dislike pirating of works, I fear that artists will be deterred from creating works if they think that they are going to get ripped off....

27 minutes ago by GHar123 on ACTA stumbles in Germany

How dare film makers, artists or anybody that invests in creativity stop us pirating their works for free. I want to be able to walk into my local...

6 hours ago by JCB33 on ACTA stumbles in Germany

@GrueMaster. I prefer horses for courses rather than one size fits all. I, and I suspect most other computer users, do not really wish to have...

8 hours ago by Moley on A tale of two distros: Ubuntu and Linux Mint

The product that scares me every time I have to use it is the Office 2007 version of Excel. The first bug that I found was applying the median...

8 hours ago by greycynic on Ten flawed products that derail productivity

Nice review and very informative. One thing I'd like to add (in reply to whs001's 1st question), the main reason to have the same interface from...

10 hours ago by GrueMaster on A tale of two distros: Ubuntu and Linux Mint

I'be been using Mint 12 since the RC came out, and I am far more happy with the Cinnamon, the Mate, and, yes (with extensions), theGnome 3...

11 hours ago by Frederick Wrigley via Facebook on A tale of two distros: Ubuntu and Linux Mint

Excellent article. One small correction, though--although a fresh installation of Linux Mint 12 will, indeed, provide the user with a version of...

11 hours ago by bdantas on A tale of two distros: Ubuntu and Linux Mint

In related news, the ISPs club together to get the members of the Home Affairs Select Committee (ya goofed on that part, ZDNet UK) copies of "The...

12 hours ago by Alan Ralph via Facebook on MPs urge ISPs to take down terrorist material

In related news, the ISPs club together to get the members of the Home Affairs Select Committee (ya goofed on that part, ZDNet UK) copies of "The...

12 hours ago by Alan Ralph via Facebook on MPs urge ISPs to take down terrorist material

For Gnome 2 die-hards, it is possible to add icons to the bottom panel (or top top panel, if you prefer) which provide the exact Gnome 2...

13 hours ago by Moley on A tale of two distros: Ubuntu and Linux Mint

Your comments would seem pretty naive and immature. Your 'solution' appears to be, "gee, let's all just give in to the hackers and give them...

13 hours ago by ramwellian on Cloud computing security: no more oxymoron?

"Interesting thought ... If you installed Win7 as a dual boot on a machine that previously only had Linux, and it wrecked your Linux installation,...

13 hours ago by BugStalker on Windows 7 Declares War on GRUB

This is an excellent summary of Ubuntu and Mint and the interface differences between them. Most such articles take a very partisan position for...

13 hours ago by whs001 on A tale of two distros: Ubuntu and Linux Mint

@ewallace. Not so clear. Anyone can obtain the text, for example from here http://www.ustr.gov/webfm_send/2379. I support ACTA so long as it and...

13 hours ago by Moley on ACTA: Facts, misconceptions and questions

I think WinRT is fantastic. I just wish it was an option for people that didn't want to go through Microsoft's App Store with its attendant...

17 hours ago by 45283 on Why Windows 8 needs architectural hygiene for WOA

Nine people? £30m? Who's back pocket is that lot going in? And IF they say it is for new buildings, what about all the ones the government has...

18 hours ago by Burn-IT on Police set to launch three £30m e-crime hubs

Just to be clear, nobody knows what is in the text of ACTA, here is a photograph of the text of ACTA http://twitpic.com/8h9iju as submitted to the...

18 hours ago by ewallace on ACTA: Facts, misconceptions and questions

Unfortunately main issue is that ASUS is refusing to accept that they make some mistake on this version of asus Transformer prime. 1 - GPS sensor...

19 hours ago by fgvrg56 on Asus Eee Pad Transformer Prime Wi-Fi & GPS problems?

@Marcus A fair question. Just talked with Archos which said it was working on an announcement for next week....

20 hours ago by Ben Woods on Archos confirms G9 Ice Cream Sandwich update schedule

Any update on this, considering the claimed "first week of February"?

21 hours ago by Marcus Karlsson via Facebook on Archos confirms G9 Ice Cream Sandwich update schedule

Featured white papers

Latest jobs

Futuremark backs down on Nvidia cheat claims

Daily Newsletters

Topics

Related stories

Nvidia courts gamers with high-end chip

GeForce FX catches up to Radeon performance

Nvidia accused of tweaking benchmark scores

AMD looks to ARM itself for low-power tablets

Apple tops list of semiconductor buyers

Post your comment

ZDNet UK Live

Latest in Processors

AMD looks to ARM itself for low-power tablets

Apple tops list of semiconductor buyers

Featured white papers

Latest jobs

Test Analyst - Business Intelligence /Data Warehousing

Test Analyst - Business Intelligence /Data Warehousing

Technical MI Manager - 50-60k - Leeds

Inside ZDNet UK

A tale of two distros: Ubuntu and Linux Mint

2012 Predictions: VCE FastPath, VI SAN Probe & Hadoop

BlackBerry Bold 9790

Case study: How cloud enables growth

Ten factors that make Ubuntu 11.10 a hit

Toshiba Portégé Z830-10P Review

BT's archive: Pictures from the vault

News & Analysis

Reviews

Blogs

Resources

About Us

Member Services

Special Features

Advertising Features

ZDNet UK / News and Analysis / Workspace IT / Processors

Futuremark backs down on Nvidia cheat claims

Daily Newsletters

Topics

Related stories

Post your comment

Get ZDNet UK's daily newsletter

Enter your email address to sign up

ZDNet UK Live

Latest in Processors

Featured white papers

Latest jobs

Inside ZDNet UK

Resources

About Us

Member Services

Special Features

Advertising Features