Apple's 'fastest PC' claim scrutinised

NEWS

Analysts and others are raising questions over Apple's claim that its new Power Mac G5 is the world's fastest personal computer. In his keynote speech on Monday at the company's annual developer conference, Apple chief executive Steve Jobs introduced the aluminum-encased Power Mac and showed a variety of industry benchmarks that placed the machine ahead of 3GHz Dell machines using Pentium 4 and Xeon processors. Jobs also showed the Power Mac, built around an IBM chip dubbed the G5, outperforming the Dell on various applications. Although Apple has won praise for the new Macs as a substantial improvement over prior machines, some have criticised the choices made in putting together the rival Dell machine for use in tests developed by the Standard Performance Evaluation Corporation (SPEC). Apple's tests, which were conducted by third-party testing firm Veritest, used the same GCC compiler for both machines, with the Dell boxes running the Linux operating system. Critics charge that much higher benchmarks can be achieved using the Windows OS and an Intel-optimised compiler, rather than GCC. "It wasn't really a fair test," said Gartner analyst Martin Reynolds, who said that the Dell machines are capable of producing scores 30 percent to 40 percent higher than those produced under Apple's methodology. "The reason this happened is Apple had a third party go out and test a Dell under less than optimal conditions." In response, an Apple representative said it wanted to compare hardware performance, so it made sense to use the same compiler on the Mac and the Dell. The SPEC benchmark tests measure the performance of the hardware and the compiler. "We set out to conduct and report as fair a comparison as we could," Greg Joswiak, Apple's VP of hardware marketing, said in an interview on Tuesday. "SPEC measures a combination of hardware and compiler. The only way to do a hardware-to-hardware comparison is to normalise the compiler." Peter Glaskowsky, editor-in-chief of Microprocessor Report, said a company could get better benchmark results using a Dell machine with Intel and Microsoft compilers than with a Linux machine and GCC compiler. However, he also noted that Intel's chips perform disproportionately well on SPEC's tests because Intel has optimised its compiler for such tests. Meanwhile, some technology-focused Web sites also questioned the choice of compiler and other details in the Apple-commissioned tests, in particular some of the hundreds of settings used with the competing machines. Joswiak said that the Power Mac settings were representative of how the final machines will ship, even though a few settings did differ from the way current prototypes are configured. As for the Intel-based PCs, he noted that some of the settings that have been criticised were chosen because they actually improved the performance. The controversy highlights the notoriously thorny issue of computing benchmarks, which have long been criticised for not measuring typical performance and not providing an accurate basis for comparison. In addition to the benchmarks released by Apple, Jobs on Monday also showed demonstrations in which the new Power Macs outperformed the Dell by greater than 2-to-1 ratios on several programs, including Adobe's popular Photoshop image-editing software. Reynolds says he has no reason to contest those claims. "In the absence of other information, the application benchmarks look quite credible," Reynolds said. Those usage tests may also be more important than synthetic benchmarks, he said. "The SPEC benchmarks aren't that relevant anymore. People now are looking for things like multimedia (performance) and content management." Glaskowsky agreed, saying that in programs such as Photoshop, the G5 should routinely outperform the Pentium 4 and other processors because the chip has additional floating-point units and other performance enhancements that Photoshop can take advantage of. "If you are a Photoshop (user), Apple has a very strong story," Glaskowsky said. "I think Apple ought to be sticking to that." In any case, Reynolds said that it is clear Apple has gotten a significant boost from the G5, an architectural change that should help Apple for some time. "They were kind of looking a little tired on the processor side," he said, noting that the new systems offer competitive performance with Intel-based machines. Reynolds said he was also encouraged by Apple and IBM's commitment to ship 3GHz systems within 12 months.

What will Apple come up with next? For full Mac OS coverage, see ZDNet UK's Mac News Section. Let the editors know what you think in the Mailroom.

Post your comment

In order to post a comment you need to be registered and logged in.

You can also log in with Facebook. Log in or create your ZDNet UK account below

By signing up for this service, you indicate that you agree to our Terms and Conditions and have read and understood our Privacy Policy. Questions about membership? Find the answers in the Community FAQ

ZDNet UK Live

Keep the crap apps out?! How will they compete with Android and Apple's claim to fame of having so many life changing apps? I wonder if the media...

3 hours ago by Paul Fezziwig via Facebook on RIM: BlackBerry will keep 'garbage' apps out of store

It has been shown time after time that if there is an author store that sells the songs at even 1$ per song and gives you a high-quality digital...

4 hours ago by Aigars Mahinovs via Facebook on Copyright isn't working, says European Commission

""As a result of Butyka's alleged conduct, researchers were unable to use the computers for more than two months while NASA removed the malicious...

6 hours ago by awbMaven on US indicts Romanian over NASA climate change hack

It simultaneously worries me and uplifts me that a self-proclaimed group of internet activists name themselves after Indian mythical figures....

14 hours ago by subhorup on Anonymous activists release PCAnywhere source code

It's actually far easier to work anonymously on the internet than you think. With tools like Tor bouncing your traffic around the world before...

18 hours ago by naviathan on Anonymous activists release PCAnywhere source code

1000272134 and bluedalmatian with you both there but then I'm still in 10.04 land (and happy with it)

18 hours ago by Agnostic_OS on Ten factors that make Ubuntu 11.10 a hit

Interesting article and definitely see your points on the products mentioned. One of the top products for our Help Desk (approximately 20% of all...

1 day ago by apexwm on Ten flawed products that derail productivity

Absolutely - this should obviously not be handled my isp - but handled by their hosting operator. What's been suggested here is that my isp police...

1 day ago by Paul Hutchinson via Facebook on MPs urge ISPs to take down terrorist material

Looks like a great phone. I don't notice any deficiencies in WP7. used IOS before, that's pretty good. I don't spend much time in Apps, all i need...

1 day ago by Techs UK on Nokia pins US 're-entry' hopes on Lumia 900

Now with the help of these apps you are always synced with MS outlook while on the move. Just download apps like xobni or outlookreflex and get...

1 day ago by Larry Bloggy via Facebook on Outlook Social Connector beta 2 and the LinkedIn connector

Your details are wrong. The version currently being made is the one with 2 USB ports, 256MB RAM and a network port. This is the Model B. The...

1 day ago by mike40g123 on Raspberry Pi boards set to go on sale

The thing that has been puzzling me for quite a while is how Anonymous can remain anonymous whilst not only being active on the Internet but also...

2 days ago by Moley on Anonymous activists release PCAnywhere source code

If what Semantec is saying is rue, that is even worse and shows a complete disregard for thier users. If what Anonymous claims is true and the...

2 days ago by Don Dilly via Facebook on Anonymous activists release PCAnywhere source code

Didn't seem particularly biased to me either. Oh though you might have mentioned some other competitors with free search and email services...

2 days ago by MattChurchy on Time for an evil umpire: Google, Microsoft & privacy

James - exactly as much as anyone paid you for your comment; I don't feel that I need to say that I'm independant and unbiased, but just for you...

2 days ago by Simon Bisson and Mary Branscombe on Time for an evil umpire: Google, Microsoft & privacy

Once they realise symantec are willing to pay real money, they will simply keep extorting, unless of course symantec/authorities can use the...

2 days ago by Carl White via Facebook on Symantec offered hackers $50k in source code sting

You can find more information on BS 8878 by Jonathan Hassell its lead-author at http://www.hassellinclusion.com/bs8878/ The page includes a...

3 days ago by Jonathan Hassell on BSI publishes first British web accessibility standard

Thanks for this list. Now I know, what to include on my system to make it more functional.

3 days ago by servermanagement on Ten flawed products that derail productivity

What if it's a 4 car household? The point is, more bandwidth = more things you can do simultaneously, like streaming HD video in one room of the...

3 days ago by 1000092626 on Virgin Media beats 100Mbps schedule, hikes prices

No point whatsoever increasing broadband download speed. unless ever server on the net has access to massively up rated throughput. The worlds...

3 days ago by Gary Burton via Facebook on Virgin Media beats 100Mbps schedule, hikes prices

Featured white papers

Latest jobs

Apple's 'fastest PC' claim scrutinised

Daily Newsletters

Topics

Related stories

Jobs: G5 Power Macs will outperform any Windows PC

Apple slips out G5 chip details

Heart of England NHS begins massive digitisation plan

Hard-drive woes hit PC shipments in fourth quarter

Post your comment

ZDNet UK Live

Latest in IT Strategy

Heart of England NHS begins massive digitisation plan

Hard-drive woes hit PC shipments in fourth quarter

Featured white papers

Latest jobs

MS Office 2010 Trainer - Cambridge

Dynamics CRM Technical Consultant

Product Development Manager - Newcastle upon Tyne

Inside ZDNet UK

BlackBerry Bold 9790

Sponsor a Colossus valve to help Museum of Computing

2012 Olympics: Is your business prepared?

Ten factors that make Ubuntu 11.10 a hit

Toshiba Portégé Z830-10P Review

BT's archive: Pictures from the vault

How fast is your broadband?

News & Analysis

Reviews

Blogs

Resources

About Us

Member Services

Special Features

Advertising Features

ZDNet UK / News and Analysis / Business of IT / IT Strategy

Apple's 'fastest PC' claim scrutinised

Daily Newsletters

Topics

Related stories

Post your comment

Get ZDNet UK's daily newsletter

Enter your email address to sign up

ZDNet UK Live

Latest in IT Strategy

Featured white papers

Latest jobs

Inside ZDNet UK

Resources

About Us

Member Services

Special Features

Advertising Features