IP storage -- inspiration or insanity?

ANALYSIS

The world of storage area networks is no stranger to rip-roaring excitement -- and the most spine-tingling development of late, they say, is IP-based Storage Area Networks (SANs) where huge sets of hard disks, tape drives and other mass storage devices work in perfect harmony thanks to open internet protocols. Of course, using IP to access storage is nothing new. The venerable Network Filing System (NFS) and Common Internet Filing System (CIFS) have been used to connect clients to file servers for many years. But that gives file-level access, whereas SANs need block-level access to data, in effect removing the server and leaving the storage device directly connected to the network. SANs also typically allow multiple redundant links between host and storage device, and provide transparent mirroring and backup. They should also provide a single, simple management point to multiple linked devices. There's a lot of confusion over protocols and physical transport mechanisms in storage, due in part to the way SANs have evolved as a mix of storage and networking. Traditionally, if a hard disk was SCSI it meant that the disk had a fast SCSI parallel interface and responded to SCSI commands sent to it on that interface. The interface -- the physical transport mechanism -- and the command set -- the protocol -- were indivisible. These days, the two aspects are separated. The ANSI SCSI Architecture Model (SAM-2) defines the command and data transfer protocol as something that can be carried on any physical transport mechanism. Fibre Channel (FC), currently the most mature and widely installed SAN standard, carries a serial version of SAM-2 on top of a very fast physical transport layer. The FC standard copes with error correction, address translation, framing and so on at gigabit speeds, at up to 10 kilometre distances. More than that, and non-FC techniques have to be used -- either putting FC signals onto more efficient fibre optic systems, or sending FC packets through an IP tunnel. This system, called FC/IP, lets users set up what's in effect a virtual private network across an IP system, through which FC data flows as if through a transparent connection. That works for point-to-point systems, but the details of the SAN traffic is in effect invisible to the IP networks carrying it. This makes it hard to manage and prioritise with any degree of finesse, and prevents it from being routed between more than two points. For that, you need to put SAM-2 directly into IP -- a technology called Internet SCSI, or iSCSI. iSCSI was created by IBM and Cisco. It's not the only IP SAN protocol -- there are others from Adaptec, Nishan, et al -- but it's been through most of the IETF submission process and is the most widely known and discussed. There are also a few iSCSI devices available, reflecting the relative maturity of the standard. The advantages to building a SAN out of IP packets mostly boil down to the very high level of experience, tools and comfort most corporates have with the IP protocol. These are not to be sniffed at -- the benefits of being able to deploy, configure and control your storage area network seamlessly with the rest of your IP networking will be significant. The disadvantages, however, are currently legion. For a start, TCP -- the most common session protocol run over IP -- has much weaker error detection and correction than FC, which is statistically significant when dealing with very large data transfers. Streaming video doesn't cope well with TCP's habit of retransmitting blocks when an error's found. Sending huge amounts of corporate data over an IP network at very high speeds potentially reveals enormous numbers of company secrets, but encryption -- even for slow networks -- can require a lot of processor power. Speed and processor power remain the biggest problems for iSCSI. The proponents of the standard implicitly accept that it is less efficient than FC by coupling it with 10 gigabit Ethernet -- a new and untested standard that will have to succeed if iSCSI is to happen in a big way. But TCP can consume between two and four MHz of CPU speed for each Mbps of network bandwidth, even without encryption, so at gigabit Ethernet and above it imposes unreasonable demands on servers. The cure for that is dedicated hardware, a TCP Offload Engine (TOE) that does all the network processing and delivers a finished message to server memory independent of the server's own processor. Like 10 gigabit Ethernet, this is cutting edge technology that's not widely available or trusted yet. Only when all of the above have been out in the real world for long enough to establish themselves as real, reliable and interoperable systems will iSCSI be a serious competitor to Fibre Channel. Before that point, however, it may well be a useful complementary technology, linking islands of FC SAN across IP clouds or creating smaller, slower but more flexible SANs from existing Ethernet transport protocols. Basing today's SANs on what today's technology can demonstrably do, without writing off the potential of what's under development, is the sanest approach.

Have your say instantly in the Tech Update forum. Find out what's where in the new Tech Update with our Guided Tour. Let the editors know what you think in the Mailroom.

Post your comment

In order to post a comment you need to be registered and logged in.

You can also log in with Facebook. Log in or create your ZDNet UK account below

By signing up for this service, you indicate that you agree to our Terms and Conditions and have read and understood our Privacy Policy. Questions about membership? Find the answers in the Community FAQ

ZDNet UK Live

I agree with the previous commenter wholeheartedly. I couldn't say it better myself. This is very 'Big Brother'. And while I agree with protecting...

33 minutes ago by UnderINK on European e-identity plan to be unveiled this month

Nice to see that Turing's idea of a general purpose computer doing once-hardware-powered tasks in software is now universal ;-) Mary

6 hours ago by Simon Bisson and Mary Branscombe on Software with everything

seriously now. I've only bothered to read a small bit of the comments. do me and the rest of the world a favour. stop saying it does not work or...

10 hours ago by Jason Burchell via Facebook on Music industry negotiating over 24-bit downloads

Read about it and weep, John Donahoe ... In addition to Visa’s V.me, there is now MasterCard’s PayPass digital wallet soon to arrive; another...

14 hours ago by Philip Charles Cohen via Facebook on PayPal takes phone-based payments to the high street

Leslie Satenstein : Where have you ever seen Mozilla even mention this? Firefox is the most popular browser in the GNU/Linux OS, so I don't see...

15 hours ago by apexwm on Firefox rapid release improves Fedora Linux

SHleG: Do you remember building a clockwork scorpion kit (I'm pretty sure I have a photo of it somewhere) — I think it was called something like...

16 hours ago by songmaster on Software with everything

Good I love Yahoo! Their search engine is getting better than Google as of late. I find more of what I want on the first page, and usually within...

17 hours ago by Chris Wortman via Facebook on Linux Mint 13 ramps up for KDE release

openhgs has made the point for Windows 8 multiple monitors without realising it! With Windows 7 you have to switch the mouse and so your focus...

19 hours ago by PatrickG on Windows 8 could speed multi-monitor uptake

Mozilla has threatened to stop supporting Linux. I guess that UBUNTU is going with another browser. I indicated that if Mozilla stops supporting...

20 hours ago by Leslie Satenstein via Facebook on Firefox rapid release improves Fedora Linux

Much as I abhor Microsoft's licensing practices, this is almost certainly down to purchasing IT equipment via 3rd party consultants - you get the...

20 hours ago by Andy Bolstridge via Facebook on 6 million wasted licences and £1,200 PCs: welcome to government IT

@openhgs Windows users have had multiple desktops since Linus started writing Linux. They just haven't shipped as standard because not enough...

2 days ago by Jack Schofield on Windows 8 could speed multi-monitor uptake

@Phil at Cloud4 What, Microsoft gets £1,200 per PC and £1,622 per server? Gosh, I'm amazed....

2 days ago by Jack Schofield on 6 million wasted licences and £1,200 PCs: welcome to government IT

You guys have no idea what is going on at Autonomy. Autonomy could have been a much more profitable organization. The sales operations at Autonomy...

2 days ago by craigsc on HP cuts 27,000 staff as Autonomy chief Lynch leaves

How does this impact on dual or multi booting? Seems to me to more or less prohibit this, from Windows 8 anyway. Will Grub 2 recognise Windows 8,...

2 days ago by Moley on Windows 8 start-up speed forces USB boot workaround

I don't understand why there cannot be a slight pause during the boot process so the user can press a key. Many operating systems do this, even if...

2 days ago by apexwm on Windows 8 start-up speed forces USB boot workaround

You can now buy the Xi3 modular computer in the UK at http://www.ocdistribution.com . This can be bought with the Tand3m software, pricing and...

2 days ago by Gavin Goodman on CES 2012: Xi3 microSERV3R

I agree: Mike Lynch can clearly build a business and manage strategy. I suspect the exit of Mike is more likely the end of a planned handover...

2 days ago by Phil at Cloud4 on HP cuts 27,000 staff as Autonomy chief Lynch leaves

This is unbeleivable government wastage with only one winner... Microsoft 1 - Tax payer Nil!

2 days ago by Phil at Cloud4 on 6 million wasted licences and £1,200 PCs: welcome to government IT

So what do you do when you can't boot into windows? Why can't I just hold Shift while I power up instead of having to boot into windows and click a...

2 days ago by Mispam on Windows 8 start-up speed forces USB boot workaround

I've also seen that Mac OS X for Intel machines is supposed to run in VirtualBox, which would also be a nice solution. I've never tried it though.

2 days ago by apexwm on xTreme Triple Booting: Linux, Mac & Windows

Featured white papers

Latest jobs

IP storage -- inspiration or insanity?

Daily Newsletters

Topics

Related stories

Virtual Storage -- is it there yet?

Compaq exec has plans for HP's storage

Internet Backplane Protocol - Design, Details and Desire

Storage group seeks CIO participation

Citrix to deliver Windows desktops from the cloud

Post your comment

ZDNet UK Live

Latest in IT Strategy

Citrix to deliver Windows desktops from the cloud

Featured white papers

Latest jobs

Senior Business Analyst

Technical Project Manager

Software Support Engineer

Inside ZDNet UK

Indoor navigation coming to a mobile near you soon

Software with everything

Asus Transformer Pad TF300T

How IT is ganging up on organised cybercrime

HTC One V: First take

SharePoint deployment: The final chapter

Ten IT jobs to save up for those rare lulls

News & Analysis

Reviews

Blogs

Resources

About Us

Member Services

Special Features

Advertising Features

ZDNet UK / News and Analysis / Business of IT / IT Strategy

IP storage -- inspiration or insanity?

Daily Newsletters

Topics

Related stories

Post your comment

Get ZDNet UK's daily newsletter

Enter your email address to sign up

ZDNet UK Live

Latest in IT Strategy

Featured white papers

Latest jobs

Inside ZDNet UK

Resources

About Us

Member Services

Special Features

Advertising Features