IBM plans open-source storage strategy

NEWS

To encourage the broadest possible support for its forthcoming "Storage Tank" technology, IBM will release an open-source version of the software needed to let servers tap into the next-generation storage system. Big Blue is working with an undisclosed open-source group on the software and will release the code when the product is generally available in 2003, said David Pease, manager of storage software at IBM's Almaden Research Center and leader of the 5-year-old Storage Tank project. In addition, IBM plans to publish the communication method fundamental to the next-generation storage project. The collaborative approach is the most recent example of IBM trying to capitalise on the momentum of the open-source movement. The company also backs the Linux operating system, the Globus Toolkit for supercomputing networks, and several other projects of the collaborative programming movement. IBM has tapped into the open-source community as a way to speed the development and adoption of technologies it favors and to give itself more cachet with in-the-know programmers. The company devotes many of its own resources to open-source projects, most notably its Linux Technology Center. Storage Tank -- fleetingly code-named Golden Retriever -- is a technology designed to get more use out of existing storage systems and make them easier to manage. With Storage Tank, existing systems can be linked, so larger amounts of data can be stored. The technology works by using a different way of keeping track of descriptive information -- "metadata" such as physical locations, file sizes or access permissions -- that accompanies the actual content within the files. Where most storage systems include this metadata in the storage system itself, Storage Tank spreads the information across a group of metadata servers, lower-end dual-processor Intel servers running Linux. The approach permits several advantages. For one thing, it can keep track of a lot of files. IBM's goal is for the system to control as many as a billion files, said Jai Menon, an IBM fellow and storage research manager at Big Blue's Almaden Research Center. In addition, files of a certain type can be automatically moved to a particular storage "pool". For example, video and audio streaming files can be physically stored automatically on a particular storage device suited to that task, while infrequently used text files can be stored on a device with lower performance. The use of the pools in conjunction with preset policies will let administrators automate tasks such as data backup, Menon said. The system also means the same files can be accessed directly by different operating systems. Currently, because most operating systems have their own ways of storing files, that's difficult to do without using file system software from a company such as Veritas Software. But for servers with multiple operating systems to tap into Storage Tank, a piece of software called an agent must be running to communicate with the metadata server. IBM plans to release a sample agent program as open-source software, Pease said. Releasing the example software will permit others to write agents to tap into Storage Tank, Pease said. In addition, IBM will describe the protocols the agents use to communicate with the metadata servers, allowing others to build their own metadata servers if they wish, he said. IBM hopes its strategy will make Storage Tank widely used. "Our goal for Storage Tank is nothing short of world domination," Pease said, only partly joking. IBM's Almaden labs are working on several technologies besides Storage Tank, showing off several products in a recent media tour of the facility. IBM expects only about 60 percent to 65 percent of its research lab projects to reach the product stage, Menon said. "We don't want to be more successful, because if we're not being crazy enough, we're not being challenged enough," he said. IBM has several other projects stewing at the lab: • A project code-named SledRunner is designed to give priority access to the programs that need a fast response time from hard drive arrays. Often low-priority jobs take up a storage system's time when those jobs could be postponed a few fractions of a second. The SledRunner name stems from the acronym SLE (service level enforcement). • IBM is taking a crack at a technology that it acknowledges has flopped in the past -- arranging blocks of data on a hard drive in the order it will be needed, which minimises the time the hard drive has to spend moving mechanical components to grab the next tidbit of information. This project, called Automatic Locality Improving Storage (ALIS), relies on arranging data after monitoring the order in which it's actually used as a computing process runs. • For a future version of Storage Tank, IBM plans a front-end "gateway" so that remote computers can tap into a tank over a network. It's similar in concept to EMC's Celerra product or Network Appliance's products in a deal with Hitachi Data Systems. • IBM is working on a "semantic file system", software to make it easier to find a specific file. Current file systems store files in an ever-more-complex cascade of directories, but a better method than indexed contents of files, for example, could help people find what they need faster -- "a sort of Google for enterprise file systems", Menon said. • "Differential remote copy" is a technology to speed up the process of copying data on one storage system to a distant site with the identical data that protects against disasters such as earthquakes. The technique sends only the data that has changed since the last update, Menon said.

Everybody needs storage. And almost every week some company manages to squeeze more storage into less space for a lower price. For the latest news, reviews and price checks on everything from USB flash cards and PCCard hard disks to storage area networks, see ZDNet UK's Storage News Section. Have your say instantly, and see what others have said. Go to the ZDNet news forum. Let the editors know what you think in the Mailroom.

Post your comment

In order to post a comment you need to be registered and logged in.

You can also log in with Facebook. Log in or create your ZDNet UK account below

By signing up for this service, you indicate that you agree to our Terms and Conditions and have read and understood our Privacy Policy. Questions about membership? Find the answers in the Community FAQ

ZDNet UK Live

In related news, the ISPs club together to get the members of the Home Affairs Select Committee (ya goofed on that part, ZDNet UK) copies of "The...

1 minute ago by Alan Ralph via Facebook on MPs urge ISPs to take down terrorist material

For Gnome 2 die-hards, it is possible to add icons to the bottom panel (or top top panel, if you prefer) which provide the exact Gnome 2...

46 minutes ago by Moley on A tale of two distros: Ubuntu and Linux Mint

Your comments would seem pretty naive and immature. Your 'solution' appears to be, "gee, let's all just give in to the hackers and give them...

59 minutes ago by ramwellian on Cloud computing security: no more oxymoron?

"Interesting thought ... If you installed Win7 as a dual boot on a machine that previously only had Linux, and it wrecked your Linux installation,...

1 hour ago by BugStalker on Windows 7 Declares War on GRUB

This is an excellent summary of Ubuntu and Mint and the interface differences between them. Most such articles take a very partisan position for...

1 hour ago by whs001 on A tale of two distros: Ubuntu and Linux Mint

@ewallace. Not so clear. Anyone can obtain the text, for example from here http://www.ustr.gov/webfm_send/2379. I support ACTA so long as it and...

2 hours ago by Moley on ACTA: Facts, misconceptions and questions

I think WinRT is fantastic. I just wish it was an option for people that didn't want to go through Microsoft's App Store with its attendant...

5 hours ago by 45283 on Why Windows 8 needs architectural hygiene for WOA

Nine people? £30m? Who's back pocket is that lot going in? And IF they say it is for new buildings, what about all the ones the government has...

6 hours ago by Burn-IT on Police set to launch three £30m e-crime hubs

Just to be clear, nobody knows what is in the text of ACTA, here is a photograph of the text of ACTA http://twitpic.com/8h9iju as submitted to the...

6 hours ago by ewallace on ACTA: Facts, misconceptions and questions

Unfortunately main issue is that ASUS is refusing to accept that they make some mistake on this version of asus Transformer prime. 1 - GPS sensor...

7 hours ago by fgvrg56 on Asus Eee Pad Transformer Prime Wi-Fi & GPS problems?

@Marcus A fair question. Just talked with Archos which said it was working on an announcement for next week....

8 hours ago by Ben Woods on Archos confirms G9 Ice Cream Sandwich update schedule

Any update on this, considering the claimed "first week of February"?

9 hours ago by Marcus Karlsson via Facebook on Archos confirms G9 Ice Cream Sandwich update schedule

Bill Goodrich : Just as al_langevin pointed out, with Windows Server 2008 there is no Services for Macintosh anymore. It's gone, not available....

18 hours ago by apexwm on Windows Server 2008 drops the ball for Mac compatibility

Replying to an old topic that I'm currently facing with my CEO (who is on a Mac). Our servers are primarily Windows Servers, office is about...

1 day ago by txtrainguy on Windows Server 2008 drops the ball for Mac compatibility

Sure, that makes perfect sense. Pay wrong-doers money and thank them for breaching your security and pointing out your flaws, that would surely...

1 day ago by k0tcs3 on US indicts Romanian over NASA climate change hack

I think he's referring specifically to Android apps, as Apple do regulate their App Store, but Google seem to let any old crap onto the Android store!

1 day ago by Random_Error on RIM: BlackBerry will keep 'garbage' apps out of store