IBM edges out HP in server speed test

Daily Newsletters

Sign up to ZDNet UK's daily newsletter.

NEWS
IBM's top-end Unix server has moved ahead of its Hewlett-Packard competition in a widely watched server speed test - but HP expects to reclaim its position by the end of March. By doubling the memory in its 32-processor p690 "Regatta" server from 256GB to 512GB, IBM increased its speed measurement from 403,000 to 428,000 transactions per minute, a smidgen faster than the 423,000 from HP's 64-processor Superdome. HP's system remains less expensive, though, at $6.6m (£4.15m) to IBM's $7.6m (£4.78m). The test, run by the Transaction Performance Council (TPC), measures the performance of a server handling simulated database transactions such as checking inventory, placing orders and recording payments. The top-ranked machine still is a 128-processor behemoth from Fujitsu, but it uses unconventional database software. HP and IBM use Oracle 9i. Servers - powerful networked computers that typically run 24 hours a day - are a lucrative market, with $10.5bn in sales in the third quarter of 2002, according to research firm Gartner Dataquest. IBM, Sun Microsystems, HP and Dell all are scrapping for position in the market, which has been shrinking for two years with the recession and the decline of Internet-related spending. The TPC-C test has been dominated by servers running the Unix operating system, but those with Intel processors and Microsoft's Windows operating system have begun climbing the ladder in recent months. An NEC system with 32 Intel Itanium processors ranks sixth on the list, while a Unisys system using 32 Intel Xeon processors holds seventh place. HP disparaged IBM's TPC-C result as a "minor performance tune" and said in a statement that its Superdome server will surpass IBM by the end of March. Future Superdome upgrades will give the system a score of more than 1 million, the company said. Sun, which has the top market share in Unix servers, has stopped participating in the TPC-C test, arguing that it's no longer representative of true server tasks. "It is measuring a workload that is more than 10 years old and is no longer relevant," said Chief Competitive Officer Shahin Khan. The company favors benchmarks of specific applications, such as those from Oracle, PeopleSoft, J.D. Edwards and Manugistics, which Khan said are "more immediately translated to customer requirements." Sun's systems still are respectable, but it's probably not a coincidence that the company withdrew from that benchmark challenge. "There's no real reason to believe that Sun wouldn't perform adequately on TPC-C, but it's a good guess that they wouldn't be the leader," said Gordon Haff, an Illuminata analyst. But Sun's tirade against the benchmark means there's no graceful way it could re-enter the fray. "They've made so much noise about how TPC-C is meaningless that they can't really reverse themselves," he said. Sun's complaint with TPC-C more specifically is that each transaction in the test triggers just a small number of operations - for example, a debit command then a credit command. Nowadays, though, a single transaction typically requires thousands of instructions, Haff said. While a small number of transactions can be stored in high-speed cache memory, greatly speeding benchmark results, real-world applications often require information to be retrieved from slower main memory or even slower hard drives, Khan said. IBM, unsurprisingly, disagreed that TPC-C is irrelevant. "Benchmarks matter," said Carole Gottleib, manager of IBM's Unix server performance. "In the mind of customers they are still an important part of the sales process. The TPC-C benchmark is a good indicator of overall system performance for transaction processing workloads. It takes into account the processing architecture and speed, memory, storage subsystems and the database engine." Analyst firm IDC advises against relying too heavily on TPC-C, which it describes as "perhaps the most famous and frequently used" server transaction benchmark. The way TPC-C uses databases opens a "loophole" that testers can exploit but that customers aren't likely to benefit from, and IDC agrees with Sun that the TPC-C transactions are simpler than those required in the real world. "For true benchmark validity, customers should use a variety of independent software vendor benchmarks, such as Oracle, Baan or PeopleSoft, in conjunction with industry standards from organizations such as TPC and SPEC," the Standard Performance Evaluation Corporation, IDC said in a report.
More enterprise IT news in ZDNet UK's Tech Update Channel.

For a weekly round-up of the enterprise IT news, sign up for the Tech Update newsletter. Let the editors know what you think in the Mailroom.

Post your comment

In order to post a comment you need to be registered and logged in.

You can also log in with Facebook. Log in or create your ZDNet UK account below

  • Login

Will not be displayed with your comment

By signing up for this service, you indicate that you agree to our Terms and Conditions and have read and understood our Privacy Policy. Questions about membership? Find the answers in the Community FAQ

Get ZDNet UK's daily newsletter

Enter your email address to sign up

ZDNet UK Live

JCB33

How dare film makers, artists or anybody that invests in creativity stop us pirating their works for free. I want to be able to walk into my local...

12 minutes ago by JCB33 on ACTA stumbles in Germany
Moley

@GrueMaster. I prefer horses for courses rather than one size fits all. I, and I suspect most other computer users, do not really wish to have...

2 hours ago by Moley on A tale of two distros: Ubuntu and Linux Mint
greycynic

The product that scares me every time I have to use it is the Office 2007 version of Excel. The first bug that I found was applying the median...

2 hours ago by greycynic on Ten flawed products that derail productivity
GrueMaster

Nice review and very informative. One thing I'd like to add (in reply to whs001's 1st question), the main reason to have the same interface from...

4 hours ago by GrueMaster on A tale of two distros: Ubuntu and Linux Mint
Frederick Wrigley

I'be been using Mint 12 since the RC came out, and I am far more happy with the Cinnamon, the Mate, and, yes (with extensions), theGnome 3...

5 hours ago by Frederick Wrigley via Facebook on A tale of two distros: Ubuntu and Linux Mint
bdantas

Excellent article. One small correction, though--although a fresh installation of Linux Mint 12 will, indeed, provide the user with a version of...

5 hours ago by bdantas on A tale of two distros: Ubuntu and Linux Mint
Alan Ralph

In related news, the ISPs club together to get the members of the Home Affairs Select Committee (ya goofed on that part, ZDNet UK) copies of "The...

6 hours ago by Alan Ralph via Facebook on MPs urge ISPs to take down terrorist material
Alan Ralph

In related news, the ISPs club together to get the members of the Home Affairs Select Committee (ya goofed on that part, ZDNet UK) copies of "The...

6 hours ago by Alan Ralph via Facebook on MPs urge ISPs to take down terrorist material
Moley

For Gnome 2 die-hards, it is possible to add icons to the bottom panel (or top top panel, if you prefer) which provide the exact Gnome 2...

7 hours ago by Moley on A tale of two distros: Ubuntu and Linux Mint
ramwellian

Your comments would seem pretty naive and immature. Your 'solution' appears to be, "gee, let's all just give in to the hackers and give them...

7 hours ago by ramwellian on Cloud computing security: no more oxymoron?
BugStalker

"Interesting thought ... If you installed Win7 as a dual boot on a machine that previously only had Linux, and it wrecked your Linux installation,...

7 hours ago by BugStalker on Windows 7 Declares War on GRUB
whs001

This is an excellent summary of Ubuntu and Mint and the interface differences between them. Most such articles take a very partisan position for...

7 hours ago by whs001 on A tale of two distros: Ubuntu and Linux Mint
Moley

@ewallace. Not so clear. Anyone can obtain the text, for example from here http://www.ustr.gov/webfm_send/2379. I support ACTA so long as it and...

8 hours ago by Moley on ACTA: Facts, misconceptions and questions
45283

I think WinRT is fantastic. I just wish it was an option for people that didn't want to go through Microsoft's App Store with its attendant...

11 hours ago by 45283 on Why Windows 8 needs architectural hygiene for WOA
Burn-IT

Nine people? £30m? Who's back pocket is that lot going in? And IF they say it is for new buildings, what about all the ones the government has...

12 hours ago by Burn-IT on Police set to launch three £30m e-crime hubs
ewallace

Just to be clear, nobody knows what is in the text of ACTA, here is a photograph of the text of ACTA http://twitpic.com/8h9iju as submitted to the...

12 hours ago by ewallace on ACTA: Facts, misconceptions and questions
fgvrg56

Unfortunately main issue is that ASUS is refusing to accept that they make some mistake on this version of asus Transformer prime. 1 - GPS sensor...

13 hours ago by fgvrg56 on Asus Eee Pad Transformer Prime Wi-Fi & GPS problems?
Ben Woods

@Marcus A fair question. Just talked with Archos which said it was working on an announcement for next week....

14 hours ago by Ben Woods on Archos confirms G9 Ice Cream Sandwich update schedule
Marcus Karlsson

Any update on this, considering the claimed "first week of February"?

15 hours ago by Marcus Karlsson via Facebook on Archos confirms G9 Ice Cream Sandwich update schedule
apexwm

Bill Goodrich : Just as al_langevin pointed out, with Windows Server 2008 there is no Services for Macintosh anymore. It's gone, not available....

24 hours ago by apexwm on Windows Server 2008 drops the ball for Mac compatibility