Infiniband -- old before its time?

Daily Newsletters

Sign up to ZDNet UK's daily newsletter.

ANALYSIS
In its two-year life, Infiniband has had a tempestuous time. Proposed as a solution to maxed-out PCI-based server and storage systems, its prospects were blighted by reverses from two of its most significant early supporters. Microsoft has said that it no longer plans to include Infiniband support in .Net Server, due at the end of this year, and Intel has dropped plans to produce an Infiniband chip. Both remain involved with the Infiniband Trade Association (IBTA), the group of nearly 200 companies responsible for maintaining and propagating the standard, but their attitudes have been seen as ambivalent. Intel says that it still supports the standard, but its resources are better directed elsewhere. Infiniband is a high performance but complex specification - the most recent revision clocks in at over 1500 pages. It stems from two early initiatives, Future I/O from Compaq, IBM and HP; and Next Generation I/O, from Dell, Hitachi, Intel, Sun and others. In 1999, everyone on both sides got together in the IBTA, producing version 1.0 of the specification in 2000 and 1.0a in 2001. Unlike the PCI bus, it is designed specifically for data centre applications, connecting hosts and I/O devices through a switched or routed fabric. It's a serial connection with a basic speed of 2.5 Gigabit per second. For faster speeds, four or twelve connections can be effectively paralleled up for the 4X and 12X rates. Infiniband can connect disk arrays, SANs, LANs, servers and clusters together, but only supports point-to-point links: two devices are linked via a high-bandwidth, low-latency channel and communicate commands and data through a message passing scheme. Storage devices can be commanded to transfer data directly between themselves, rather than going through a host, and this third party I/O is an important factor in Infiniband's performance. Infiniband is closer to a network like Ethernet than a bus like PCI. It can route information through back-up paths if part of the fabric stops working, it has variable packet size and a very flexible message structure that can accommodate single messages up to two gigabytes in length. Connections are limited to ten or so metres with copper, up to 10 kilometres with fibre; although it would be possible to route Infiniband packets further than this, it would loosen the latency figures: Infiniband is best suited for interconnecting cabinets in a data centre or, via fibre, across town. Each Infiniband installation can contain multiple independent fabrics, each of which can contain thousands of subnodes -- and the subnodes can support tens of thousands of nodes. Everything is closely managed, with the subnet manager being a particularly important part of the system. It controls the routing of the packets, maintains alternative links, configures topology of the fabric and checks performance. So what about Microsoft and Intel's reticence , when it comes to active support? The storage world is a hotbed of excitement and change at the moment, with a variety of options being touted as the next big thing in data centre and clustered storage. Ethernet -- gigabit or ten gigabit, SCSI over IP -- iSCSI -- and IP over Fibre Channel are all technologies that mesh well with current expertise and experience, something that can't be said for Infiniband. There are some things that Infiniband does better than any alternative, but both Intel and Microsoft are betting that these won't translate into large sales across the board. Larger data centres and places with very strict latency rules may adopt the technology soon: others may choose to hold off. Also, Intel chose to develop its first Intelliband product around the 1x speed, while most interest has centred on the faster options -- rather than play catch-up, the chip company may have chosen to retire from the scene while the market settles down. Intel is still actively developing the APIs, compliance and performance tests, and co-chairing IBTA. Currently, products are expected in the first half of next year. Initial applications are expected to be network-addressable storage (NAS) systems, linking multiprocessor servers to storage in an easily scalable configuration. Whether the bigger vision -- of distributed, city-wide data centres using Infiniband across the board -- ever comes about is harder to say, but it's far too soon to write off the technology as a good idea at a bad time.

Post your comment

In order to post a comment you need to be registered and logged in.

You can also log in with Facebook. Log in or create your ZDNet UK account below

  • Login

Will not be displayed with your comment

By signing up for this service, you indicate that you agree to our Terms and Conditions and have read and understood our Privacy Policy. Questions about membership? Find the answers in the Community FAQ

Get ZDNet UK's daily newsletter

Enter your email address to sign up

ZDNet UK Live

45283

I think WinRT is fantastic. I just wish it was an option for people that didn't want to go through Microsoft's App Store with its attendant...

3 hours ago by 45283 on Why Windows 8 needs architectural hygiene for WOA
Burn-IT

Nine people? £30m? Who's back pocket is that lot going in? And IF they say it is for new buildings, what about all the ones the government has...

4 hours ago by Burn-IT on Police set to launch three £30m e-crime hubs
ewallace

Just to be clear, nobody knows what is in the text of ACTA, here is a photograph of the text of ACTA http://twitpic.com/8h9iju as submitted to the...

4 hours ago by ewallace on ACTA: Facts, misconceptions and questions
fgvrg56

Unfortunately main issue is that ASUS is refusing to accept that they make some mistake on this version of asus Transformer prime. 1 - GPS sensor...

5 hours ago by fgvrg56 on Asus Eee Pad Transformer Prime Wi-Fi & GPS problems?
Ben Woods

@Marcus A fair question. Just talked with Archos which said it was working on an announcement for next week....

6 hours ago by Ben Woods on Archos confirms G9 Ice Cream Sandwich update schedule
Marcus Karlsson

Any update on this, considering the claimed "first week of February"?

7 hours ago by Marcus Karlsson via Facebook on Archos confirms G9 Ice Cream Sandwich update schedule
apexwm

Bill Goodrich : Just as al_langevin pointed out, with Windows Server 2008 there is no Services for Macintosh anymore. It's gone, not available....

16 hours ago by apexwm on Windows Server 2008 drops the ball for Mac compatibility
txtrainguy

Replying to an old topic that I'm currently facing with my CEO (who is on a Mac). Our servers are primarily Windows Servers, office is about...

22 hours ago by txtrainguy on Windows Server 2008 drops the ball for Mac compatibility
k0tcs3

Sure, that makes perfect sense. Pay wrong-doers money and thank them for breaching your security and pointing out your flaws, that would surely...

23 hours ago by k0tcs3 on US indicts Romanian over NASA climate change hack
Random_Error

I think he's referring specifically to Android apps, as Apple do regulate their App Store, but Google seem to let any old crap onto the Android store!

23 hours ago by Random_Error on RIM: BlackBerry will keep 'garbage' apps out of store
Paul Fezziwig

Keep the crap apps out?! How will they compete with Android and Apple's claim to fame of having so many life changing apps? I wonder if the media...

1 day ago by Paul Fezziwig via Facebook on RIM: BlackBerry will keep 'garbage' apps out of store
Aigars Mahinovs

It has been shown time after time that if there is an author store that sells the songs at even 1$ per song and gives you a high-quality digital...

1 day ago by Aigars Mahinovs via Facebook on Copyright isn't working, says European Commission
awbMaven

""As a result of Butyka's alleged conduct, researchers were unable to use the computers for more than two months while NASA removed the malicious...

1 day ago by awbMaven on US indicts Romanian over NASA climate change hack
subhorup

It simultaneously worries me and uplifts me that a self-proclaimed group of internet activists name themselves after Indian mythical figures....

2 days ago by subhorup on Anonymous activists release PCAnywhere source code
naviathan

It's actually far easier to work anonymously on the internet than you think. With tools like Tor bouncing your traffic around the world before...

2 days ago by naviathan on Anonymous activists release PCAnywhere source code
Agnostic_OS

1000272134 and bluedalmatian with you both there but then I'm still in 10.04 land (and happy with it)

2 days ago by Agnostic_OS on Ten factors that make Ubuntu 11.10 a hit
apexwm

Interesting article and definitely see your points on the products mentioned. One of the top products for our Help Desk (approximately 20% of all...

2 days ago by apexwm on Ten flawed products that derail productivity
Paul Hutchinson

Absolutely - this should obviously not be handled my isp - but handled by their hosting operator. What's been suggested here is that my isp police...

2 days ago by Paul Hutchinson via Facebook on MPs urge ISPs to take down terrorist material
Techs UK

Looks like a great phone. I don't notice any deficiencies in WP7. used IOS before, that's pretty good. I don't spend much time in Apps, all i need...

2 days ago by Techs UK on Nokia pins US 're-entry' hopes on Lumia 900
Larry Bloggy

Now with the help of these apps you are always synced with MS outlook while on the move. Just download apps like xobni or outlookreflex and get...

2 days ago by Larry Bloggy via Facebook on Outlook Social Connector beta 2 and the LinkedIn connector