IBM on Wednesday officially launched System S, a software platform built following five years of research into the real-time analysis of large amounts of unstructured business or scientific data. IBM calls the resulting technology "stream computing", because the software deals with streams of data.
Also on Wednesday, IBM opened the IBM European Stream Computing Centre, headquartered in Dublin. The centre will serve as a hub of research, customer support and advanced testing for stream-computing applications.
System S is IBM's answer to the growing problem of data overload, the company said. In particular, it is a response to the growing amount of unstructured data — such as web pages, emails, blogs, video and data captured from electronic sensors — that organisations are faced with processing.
The new IBM software is designed specifically to handle such information, as well as the structured data found in databases. It processes this data in real time, giving users the ability to make decisions based on that analysis right away, according to IBM.
"Traditional computing models retrospectively analyse stored data and cannot continuously process massive amounts of incoming data streams that affect critical decision-making," IBM said in a statement. "System S is designed to help clients become more 'real-world aware', seeing and responding to changes across complex systems."
The software is written using a programming language specifically developed for stream computing, called SPADE (Stream Processing Application Declarative Engine). It is designed to run on a variety of hardware platforms, including clusters, multicore architectures and chips such as the Cell processor, IBM said.
The system can be used to analyse data such as stock prices, retail sales and weather reports. IBM is aiming it at financial institutions, government and law enforcement agencies, and retailers, among other organisations.
System S is being used in a number of pilot projects that demonstrate the diverse types of applications IBM is targeting for the software.
Uppsala University and the Swedish Institute of Space Physics, for instance, are using a pilot system to analyse the way radio emissions from space affect energy transmission over power lines, communications via radio and TV signals, and airline and space travel, IBM said.
The Marine Institute of Ireland is using the system to monitor large volumes of underwater acoustic information, while TD Securities is using the software to develop a pilot of an automated options-trading system. A pilot at the University of Ontario Institute of Technology is using System S to monitor streams of biomedical data from critically ill premature babies.
The software is currently available in English directly from IBM, with prices ranging from $100,000 (£66,000) for a two-server installation up to several million pounds for a large cluster with hundreds of nodes, IBM said.
System S is scheduled to be released in multiple languages and through IBM business partners sometime in 2010.
Talkback
Great to see that also IBM thinks that CEP needs more then SQL alone and that they added a declarative language. This underpins the point Apama is making for years. See the apama blogs.