Internet concepts build new ways of storage

ANALYSIS

Researchers at the University of Tennessee and the University of California Santa Barbara are taking their cue from another complex, heterogeneous distributed system -- the Internet -- to create a conceptually simple but very capable way of hooking users and storage together. The Internet Backbone Protocol (IBP) they're developing contrasts with the current most popular storage management idea -- the computer centre model. This assumes storage is expensive and scarce, and in need of strict management, authentication and access controls. The same assumptions inform the trend towards information grids, where different bits of storage coalesce into unified platforms that 'virtual organisations' can use. The Internet way of doing things, on the other hand, makes everything on the network available to everyone, with the links being as lightweight and simple to implement as possible concomitant with scalability and good-enough reliability. It's also much easier, with the Internet way of doing things, to add private resources to the general good. IBP is an attempt to marry these ideas to storage: while it remains experimental, it examines many of the problems of modern storage systems and offers some interesting new views on how to solve them. According to the researchers, IBP is "a mechanism developed for the purpose of sharing storage resources across networks ranging from rack-mounted clusters in a single machine room to global networks." To that end, much of its design mirrors that of IP -- in particular, IP datagrams. IP datagrams at one level just deliver packets of data from one place to another, but at another can be scaled to work at any size and complexity of network. In particular, datagrams don't care about the details of any particular connection. Packets can be linked together, hiding the details of the sizes of individual packets; there's only one fault mode -- a packet is dropped -- regardless of what caused the problem; and a global addressing scheme means nobody cares about local network configurations, or indeed if the local network is reconfigured at any time. And as anyone can send a packet anywhere on the network without worrying about who owns the intermediate stages, the whole thing scales to a truly global system. IBP takes these ideas and applies them to disk storage. Instead of datagrams, it considers the basic unit as blocks of data (on disks, tape or other media), managed as arrays of bytes. It can aggregate these into larger units, thus hiding whatever size limits there are on any particular storage device; it copes with any error by just discarding the faulty byte arrays; and it has a global address structure, analogous to IP addresses, that is only translated locally into different addressing schemes. These ideas let a uniform IBP model apply to storage resources across a global network, and thus allow what the researchers say is the most important difference between it and other schemes -- any IBP network member can access any storage resource in the network no matter who owns it. This creates a global storage service. As with IP networks, there are downsides. First, denial of service (DoS) attacks -- both deliberate and accidental -- are bad with IP services but worse with IBP: an IP DoS goes away once the attack is stopped. With IBP, an aggressive over-allocation of storage blocks leaves those blocks allocated after the attack is over. Moreover, there are real advantages to an attacker in taking over huge amounts of storage, while IP DoS just causes confusion and misery. The other big downside of IBP is that as with IP reliability isn't high on the lists of attributes. Yet with storage systems, reliability has always been of the utmost importance. IBP addresses these problems. The DoS problem is approached by limiting the amount of time storage belongs to a network member before it is released to global use again. Also, a request for storage can be refused in cases of over-allocation, as routers drop packets when they run out of resources: deciding when, where and how to do this gives a degree of tuning for the system, again much as setting limits on router behaviour fine-tunes an IP network. The reliability issue is coped with by higher levels of protocol that build on top of IBP, much as TCP builds on IP to make a reliable link out of a basically unreliable network. IBP is not reliable, but this does not limit the reliability of the overall storage network. Next week, we'll look at the details of how IBP copes with security, allocation policies, addressing and other practical aspects of a global data storage network.

Have your say instantly, and see what others have said. Go to the Tech Update forum. Let the editors know what you think in the Mailroom.

Post your comment

In order to post a comment you need to be registered and logged in.

You can also log in with Facebook. Log in or create your ZDNet UK account below

By signing up for this service, you indicate that you agree to our Terms and Conditions and have read and understood our Privacy Policy. Questions about membership? Find the answers in the Community FAQ

ZDNet UK Live

Hello ALL USERS OF THE PIRATE BAY I WOULD PUT AN EXPLANATION ON PIRACY Story Idea ILLIGALE AND SHARING THOSE THAT NET Dissent NOT WELL BUT TO CA...

6 hours ago by dede0202 on The Pirate Bay infringes copyright, High Court decides

do You know that? it can install 4G Ram. So i buy 4g and install It work! I can run call of duty 4,6,7 [Modern war... 1,2,3] Call of duty 1 was...

6 hours ago by Sungwoo on Loose Ends - Upgrading the Aspire One 522

2. Bad idea. Making up patch cables loses you your commission from the cable supplier. 3. If you tidy up, other people can understand where the...

12 hours ago by itsajob on Ten IT jobs to save up for those rare lulls

Now On Sale, Unlocked iPhone 4S / Galaxy Note In Factory Box. Roberto-Techie(UK) ”Now on Sales” Smartphone, Android,Tablets,Gadget &...

16 hours ago by Roberto_Store on Samsung Galaxy S III lined up for sale

Is this classic FUD? One thing I would definitely have notice is a Mozilla threat to stop supporting GNU/Linux.

18 hours ago by Paul Smyth via Facebook on Firefox rapid release improves Fedora Linux

I agree with the previous commenter wholeheartedly. I couldn't say it better myself. This is very 'Big Brother'. And while I agree with protecting...

22 hours ago by UnderINK on European e-identity plan to be unveiled this month

Nice to see that Turing's idea of a general purpose computer doing once-hardware-powered tasks in software is now universal ;-) Mary

1 day ago by Simon Bisson and Mary Branscombe on Software with everything

seriously now. I've only bothered to read a small bit of the comments. do me and the rest of the world a favour. stop saying it does not work or...

1 day ago by Jason Burchell via Facebook on Music industry negotiating over 24-bit downloads

Read about it and weep, John Donahoe ... In addition to Visa’s V.me, there is now MasterCard’s PayPass digital wallet soon to arrive; another...

1 day ago by Philip Charles Cohen via Facebook on PayPal takes phone-based payments to the high street

Leslie Satenstein : Where have you ever seen Mozilla even mention this? Firefox is the most popular browser in the GNU/Linux OS, so I don't see...

2 days ago by apexwm on Firefox rapid release improves Fedora Linux

SHleG: Do you remember building a clockwork scorpion kit (I'm pretty sure I have a photo of it somewhere) — I think it was called something like...

2 days ago by songmaster on Software with everything

Good I love Yahoo! Their search engine is getting better than Google as of late. I find more of what I want on the first page, and usually within...

2 days ago by Chris Wortman via Facebook on Linux Mint 13 ramps up for KDE release

openhgs has made the point for Windows 8 multiple monitors without realising it! With Windows 7 you have to switch the mouse and so your focus...

2 days ago by PatrickG on Windows 8 could speed multi-monitor uptake

Mozilla has threatened to stop supporting Linux. I guess that UBUNTU is going with another browser. I indicated that if Mozilla stops supporting...

2 days ago by Leslie Satenstein via Facebook on Firefox rapid release improves Fedora Linux

Much as I abhor Microsoft's licensing practices, this is almost certainly down to purchasing IT equipment via 3rd party consultants - you get the...

2 days ago by Andy Bolstridge via Facebook on 6 million wasted licences and £1,200 PCs: welcome to government IT

@openhgs Windows users have had multiple desktops since Linus started writing Linux. They just haven't shipped as standard because not enough...

2 days ago by Jack Schofield on Windows 8 could speed multi-monitor uptake

@Phil at Cloud4 What, Microsoft gets £1,200 per PC and £1,622 per server? Gosh, I'm amazed....

2 days ago by Jack Schofield on 6 million wasted licences and £1,200 PCs: welcome to government IT

You guys have no idea what is going on at Autonomy. Autonomy could have been a much more profitable organization. The sales operations at Autonomy...

2 days ago by craigsc on HP cuts 27,000 staff as Autonomy chief Lynch leaves

How does this impact on dual or multi booting? Seems to me to more or less prohibit this, from Windows 8 anyway. Will Grub 2 recognise Windows 8,...

2 days ago by Moley on Windows 8 start-up speed forces USB boot workaround

I don't understand why there cannot be a slight pause during the boot process so the user can press a key. Many operating systems do this, even if...

3 days ago by apexwm on Windows 8 start-up speed forces USB boot workaround

Featured white papers

Latest jobs

Internet concepts build new ways of storage

Daily Newsletters

Topics

Related stories

Compaq takes on HP in storage arena

Compaq's storage push pays off

EMC gets 'Mavericks' with Isilon file system

Google plugs Drive into Chrome OS

Post your comment

ZDNet UK Live

Latest in Storage

EMC gets 'Mavericks' with Isilon file system

Google plugs Drive into Chrome OS

Featured white papers

Latest jobs

Senior Business Analyst

Technical Project Manager

Software Support Engineer

Inside ZDNet UK

Indoor navigation coming to a mobile near you soon

Software with everything

Asus Transformer Pad TF300T

How IT is ganging up on organised cybercrime

HTC One V: First take

SharePoint deployment: The final chapter

Ten IT jobs to save up for those rare lulls

News & Analysis

Reviews

Blogs

Resources

About Us

Member Services

Special Features

Advertising Features

ZDNet UK / News and Analysis / Infrastructure / Storage

Internet concepts build new ways of storage

Daily Newsletters

Topics

Related stories

Post your comment

Get ZDNet UK's daily newsletter

Enter your email address to sign up

ZDNet UK Live

Latest in Storage

Featured white papers

Latest jobs

Inside ZDNet UK

Resources

About Us

Member Services

Special Features

Advertising Features