Grid computing hooks up to open standards

ANALYSIS
Distributed computing is nothing new. The idea of taking a task too big for one computer and spreading it across many machines has been around since the sixties, especially in research, scientific and engineering communities. But as a result it has remained a deeply esoteric and specialist subject: fine for modelling a nuclear warhead, but not much cop for the small business. All that's changing, and fast. Where once only large establishments could afford networks of fast machines, fast networks and software engineers capable of understanding connectivity, now we all have Internet connectivity, cheap networks, processors running at gigahertz speeds and -- most importantly -- open standards that are ubiquitous, capable and well-understood. Each company is a huge well of untapped computing power: when each 2GHz Pentium spends all but a tiny fraction of its time waiting for key presses, the potential is clear. Cue the Globus Project. A hefty consortium of American academics, government agencies and IBM, Microsoft and Cisco, based in the US Argonne National Laboratory, Globus has been going for nearly six years developing the protocols, software and concepts necessary to produce open distributed computing. Although still focussed on scientific and technical projects, it has recently announced the Open Grid Services Architecture, OGSA, which makes the whole concept available to anyone. In addition, IBM has said that the Grid -- the concept of a sea of available processing linked by accessible networks -- and OGSA is one of its key corporate strategies. The company predicts that it's the "key to advancing e-business into the future and the next step in the evolution of the Internet towards a true computing platform." All this intense research has produced a solid consensus on the architecture of Grid technology and what is needed to make it happen. Standard protocols to request remote operations, swap data, manage tasks and perform essential security are key, as is a standard application programming interface (API) collection, code libraries, reusable components and debugging methods. Hence OGSA, which has developed out of experience with the already-available Globus Toolkit. It is based on a four-layer model: at the top are user applications; then comes what is known as collective services, which includes directory handling, diagnostics and monitoring; below that, resource and connectivity protocols handle access to servers and networks; and finally comes the Fabric, which is everything on the network -- storage, computers, connections, sensors and so on. The fabric and the user applications are familiar ground: it's the middle two layers that define the Grid. The Grid looks very different from standard networked computing. Most services these days are client-server, with security concerned with identifying clients, authorising them and defining what they can do on a server. With the Grid, the difference between client and server is much less clear -- one computer can ask a second computer to do a task while simultaneously carrying out another task for a third party. You don't want to have to authenticate both ways for each type of transaction, nor do you want to have to log onto each of the potentially hundreds of computers that may be running your tasks or have to authenticate everyone else who might want to do the same with yours. Also, you may well create a task on someone else's computer that itself creates tasks for further computers -- and, given the disparate nature of what runs on open standards, the security requirements for each may be different. It is quite impossible to relate all this to one individual: thus, the Grid depends on community authorisation. You become part of a community and what you do in that community's name depends on what the community is allowed to do. Other important aspects of Grid computing include its expectations of handling terabyte-sized data sets, and larger. Its protocols are designed to cope with this efficiently -- a legacy of the big-iron scientific work, but one that's becoming ever more appropriate to commercial needs. OGSA realises all of the above through a mixture of new protocols and existing, established concepts. Based around the idea of Virtual Organisations (VOs) it supports -- via standard interfaces and conventions -- the creation, termination, management, and invocation of transient services as named, managed entities with dynamic, managed lifetime. The conventions that define these services are defined using the existing Web Services Definition Language (WDSL), which is an XML-based way of saying how things can be built out of messages with data or executable contents. Various ways of linking this to standards such as SOAP, MIME and HTTP exist, but the emphasis is on adaptable ways of building in ideas as they prove appropriate. As you may surmise, the development of a global system of distributed computing is expected to take a fair amount of time, and involves many novel concepts. It's still very much a work in progress -- but one that shows every sign of going mainstream as these ideas take hold. For further reading, the Globus Project's Web site is an excellent starting point, and the Global Grid Forum covers much of the bigger picture.
ZDNet UK's Developer News Section delivers the latest headlines together with the best UK jobs, right to your browser. Have your say on all developer topics. From j2ee, to C++, from Visual Basic to Javascript plus much more. Share your experience with others on the Developers Forum. Let the editors know what you think in the Mailroom.

Post your comment

In order to post a comment you need to be registered and logged in.

You can also log in with Facebook. Log in or create your ZDNet UK account below

  • Login

Will not be displayed with your comment

By signing up for this service, you indicate that you agree to our Terms and Conditions and have read and understood our Privacy Policy. Questions about membership? Find the answers in the Community FAQ

Get ZDNet UK's daily newsletter

Enter your email address to sign up

ZDNet UK Live

bootlegger

Make that 13 people now - I got refused today at Manchester airport. I thought I was up to date on this legislation - I knew of the EU ruling from...

25 minutes ago by bootlegger on UK airport body scans will not be opt out
tinycg

Don't forget to check out apps like GoodReader or SlideShark either, they're indispensible for people on the go in presentation situations. Best...

3 hours ago by tinycg on Four top iPad apps for people on the move
TerryRK

Well it seems there is something a number of us agree on. Why is the Ubuntu Unity launcher so ugly? I thought perhaps it was something to do with...

8 hours ago by TerryRK on A tale of two distros: Ubuntu and Linux Mint
Freebies202

Duplicate comments are not made intentionally. Its very good to know that now you are keeping check on this problem because sometimes a commenter...

17 hours ago by Freebies202 on Microsoft fixes blog comments, speeds up blogs with open source
kevinmchapman

"the very significant number of users" and "many (most) of us" - you have no evidence for these statements. It is a fact that most users are saying...

1 day ago by kevinmchapman on A tale of two distros: Ubuntu and Linux Mint
Marg Menzies Harrison

Another grammar faux pas is the improper use of "you". When sitting down down in a restaurant, for example, I get cringe when the waitress...

1 day ago by Marg Menzies Harrison via Facebook on 10 flagrant grammar mistakes that make you look stupid
zdnetukuser

And NOW, folks, for Canonical's next trick... Kubuntu is late. Here's a pencil. Draw your own conclusions. cf.:...

1 day ago by zdnetukuser on Linux Minterface
Moley

@kevinmchapman. The discussion here reflects the very significant number of users who really do like the traditional menu system and who wish to...

1 day ago by Moley on A tale of two distros: Ubuntu and Linux Mint
kevinmchapman

Er, no... It is an efficient means of finding the application/file/setting you need in one place. The icons are a simply a fallback for when you...

1 day ago by kevinmchapman on A tale of two distros: Ubuntu and Linux Mint
TerryRK

Isn't the provision of a text based search an admission by the developers that the mass of icons approach does not work? I don't need to use a...

1 day ago by TerryRK on A tale of two distros: Ubuntu and Linux Mint
kevinmchapman

"Unity and GNOME 3 both abandon the old text-based cascading menus in favour of a graphical icon-driven system." Point truly missed. Both use a...

1 day ago by kevinmchapman on A tale of two distros: Ubuntu and Linux Mint
TerryRK

whs001 - Thank you, I'm glad you liked the article. I absolutely agree with you on your first point. I should perhaps have made it clearer that...

1 day ago by TerryRK on A tale of two distros: Ubuntu and Linux Mint

If we allow corporate interest to dictate the way our government circumvents due process against foreign entities then we should accept the same...

1 day ago by via Facebook on ACTA stumbles in Germany
GHar123

I totally dislike pirating of works, I fear that artists will be deterred from creating works if they think that they are going to get ripped off....

1 day ago by GHar123 on ACTA stumbles in Germany
JCB33

How dare film makers, artists or anybody that invests in creativity stop us pirating their works for free. I want to be able to walk into my local...

2 days ago by JCB33 on ACTA stumbles in Germany
Moley

@GrueMaster. I prefer horses for courses rather than one size fits all. I, and I suspect most other computer users, do not really wish to have...

2 days ago by Moley on A tale of two distros: Ubuntu and Linux Mint
greycynic

The product that scares me every time I have to use it is the Office 2007 version of Excel. The first bug that I found was applying the median...

2 days ago by greycynic on Ten flawed products that derail productivity
GrueMaster

Nice review and very informative. One thing I'd like to add (in reply to whs001's 1st question), the main reason to have the same interface from...

2 days ago by GrueMaster on A tale of two distros: Ubuntu and Linux Mint
Frederick Wrigley

I'be been using Mint 12 since the RC came out, and I am far more happy with the Cinnamon, the Mate, and, yes (with extensions), theGnome 3...

2 days ago by Frederick Wrigley via Facebook on A tale of two distros: Ubuntu and Linux Mint
bdantas

Excellent article. One small correction, though--although a fresh installation of Linux Mint 12 will, indeed, provide the user with a version of...

2 days ago by bdantas on A tale of two distros: Ubuntu and Linux Mint