Rivals gear up for database clash

Daily Newsletters

Sign up to ZDNet UK's daily newsletter.

NEWS
IBM plans to debut the first fruits of a long-standing research project later this year, setting the stage for a clash with rivals in the multibillion-dollar database software market. Big Blue will announce later this month that it will ship by June the first product from Xperanto, an initiative aimed at helping companies fetch information from many data sources all at once, from sales records to documents stored in email servers. Meanwhile, Microsoft and BEA Systems are approaching the same problem with similar technology, while database market leader Oracle favours a different approach. At stake is the global market for database software and services, which was worth roughly $9bn in 2001. Each company is hoping to establish its technology as a way to sell new database servers or add-on servers specifically designed for integration, said analysts. Database companies have been tackling the idea of the "federated," or virtual, database for years, although many attempts have failed because of the poor performance of distributed queries, said Philip Russom, an analyst with Giga Information Group. System complexity and the lack of a universal data language such as Extensible Markup Language (XML) also sidetracked earlier efforts. But improvements in querying technology over the past two years, coupled with faster hardware and networks, make federated data or enterprise information integration (EII) systems -- such as those built using new database technology from IBM and others -- more credible, he said. One battleground for database makers supplying this new technology will be in customer-support call centres, which routinely need to access data from multiple sources. "If EII vendors can address performance issues, then call centres will be the killer application," said Russom. "But at this point the scenarios are theoretical. It's very difficult to find a reference site where a team has implemented an EII solution." Russom said EII is viable for running reports that analyse company operations that don't require rapid response from databases. Also, the federated data approach has its advantages over data warehousing projects, in which companies ship data to a central store at scheduled intervals. While data warehouses typically cost $1m a year to maintain, EII products cost tens of thousands of dollars and also deliver the most updated information, he noted. IBM's Xperanto, which builds on XML, a standard for data exchange, is based on the concept of federated data management. Instead of creating a single, larger database -- a model, in part, espoused by rival Oracle -- a federated scheme creates a virtual database linked to all the relevant data. In this model, data sources are queried from their native locations and database management servers consolidate the results and make them available to users. Proponents claim that the federated approach enables data to remain in the format and location where it best fits, allowing companies to avoid costly and error-prone data translations and new development. For example, instead of building an entirely new database system for a customer support application, Xperanto-based servers would make it possible for customer support representatives to draw on several different, incompatible systems to answer a customer inquiry. That's possible, but not easy, using conventional methods. IBM's competitors are also hard at work on technology to query varied data sources all at once. BEA Systems last year released its Liquid Data for WebLogic product, which relies on XML-based queries to cull data from multiple sources. In the first half of this year, Microsoft is expected to release a beta-test version of its SQL Server database code-named Yukon, which will make it easier for the database to manipulate XML data in different data sources, according to Microsoft. Microsoft is also planning a larger effort to integrate Yukon-like data query technology into its Windows operating system, a project in the works for more than a decade. A number of smaller companies, including Nimble Technology and MetaMatrix, have also entered the fray. "We believe this is very significant shift for the data management industry," said Nelson Mattos, director of information integration at IBM. "This is going to cause databases to move from the notion of managing data that is only physically stored within (them) to a federated approach." A long-standing debate
With Xperanto, IBM stirs up a longtime industry debate over how best to manage enterprise data. On the one side are IBM, BEA and Microsoft, which favour a federated approach. On the other side, the leading advocate of a more centralised approach is Oracle, which argues that fewer large databases are less expensive to maintain than a larger number of smaller databases. But Oracle databases can also query multiple data sources and handle XML as a data format, said Benny Souder, vice president of distributed database technology at Oracle. "We think that a smaller number of larger nodes (databases) gets you economies of scale," Souder said. IBM argues that companies need integration at multiple levels -- between information sources, applications, and business processes -- and it has invested in all three areas. By using IBM's programming tool, WebSphere Studio, a developer can create an application that exploits the capabilities of Xperanto, its WebSphereMQ application integration middleware and WebSphere Business Integrator. "Customers are finding that Xperanto increases the productivity of application developers. If they are writing a J2EE (Java 2 Enterprise Edition) application and need to bring in data from three databases, they have to connect to each, issue a query, extract the data and join it at the application server level," explained IBM's Mattos. "With Xperanto, they connect and do one query and get the data merged the way they want." IBM points to a handful of implementations in the life-sciences industry, where its customers used IBM's Data Joiner product, which was designed primarily for querying relational databases and mainframe-based flat-file systems. IBM is also trying to recruit software companies to exploit Xperanto within their own products. Crystal Decisions, which sells software to create business reports, has signed on as an Xperanto partner. IBM intends to manage information in relational databases, which are the cornerstone of most business applications, as well as in email and content management systems that store documents. To handle both the structured data in relational databases and "unstructured" documents, IBM will rely on XML technology. IBM will also include support for SQL (structured query language), a method for querying relational databases used by all database makers. "We don't believe in a revolutionary approach. Our customers back the idea of leveraging data in existing environments and looking to get quick returns. And there is a huge investment in SQL," Mattos said. IBM said the first Xperanto-enabled product will be a dedicated information integration server built on IBM's flagship DB2 database. It will include IBM's WebSphere Studio development tool for building applications that rely on distributed data, said Mattos. In a Xperanto release planned for 2004, IBM will add the ability to write queries using the XML-based XQuery language, which is still under development. Other future releases will improve the ability to search and analyse text documents, Mattos said.
More enterprise IT news in ZDNet UK's Tech Update Channel.

For a weekly round-up of the enterprise IT news, sign up for the Tech Update newsletter. Let the editors know what you think in the Mailroom.

Post your comment

In order to post a comment you need to be registered and logged in.

You can also log in with Facebook. Log in or create your ZDNet UK account below

  • Login

Will not be displayed with your comment

By signing up for this service, you indicate that you agree to our Terms and Conditions and have read and understood our Privacy Policy. Questions about membership? Find the answers in the Community FAQ

Get ZDNet UK's daily newsletter

Enter your email address to sign up

ZDNet UK Live

Moley

@GrueMaster. I prefer horses for courses rather than one size fits all. I, and I suspect most other computer users, do not really wish to have...

2 hours ago by Moley on A tale of two distros: Ubuntu and Linux Mint
greycynic

The product that scares me every time I have to use it is the Office 2007 version of Excel. The first bug that I found was applying the median...

2 hours ago by greycynic on Ten flawed products that derail productivity
GrueMaster

Nice review and very informative. One thing I'd like to add (in reply to whs001's 1st question), the main reason to have the same interface from...

3 hours ago by GrueMaster on A tale of two distros: Ubuntu and Linux Mint
Frederick Wrigley

I'be been using Mint 12 since the RC came out, and I am far more happy with the Cinnamon, the Mate, and, yes (with extensions), theGnome 3...

4 hours ago by Frederick Wrigley via Facebook on A tale of two distros: Ubuntu and Linux Mint
bdantas

Excellent article. One small correction, though--although a fresh installation of Linux Mint 12 will, indeed, provide the user with a version of...

5 hours ago by bdantas on A tale of two distros: Ubuntu and Linux Mint
Alan Ralph

In related news, the ISPs club together to get the members of the Home Affairs Select Committee (ya goofed on that part, ZDNet UK) copies of "The...

5 hours ago by Alan Ralph via Facebook on MPs urge ISPs to take down terrorist material
Alan Ralph

In related news, the ISPs club together to get the members of the Home Affairs Select Committee (ya goofed on that part, ZDNet UK) copies of "The...

6 hours ago by Alan Ralph via Facebook on MPs urge ISPs to take down terrorist material
Moley

For Gnome 2 die-hards, it is possible to add icons to the bottom panel (or top top panel, if you prefer) which provide the exact Gnome 2...

6 hours ago by Moley on A tale of two distros: Ubuntu and Linux Mint
ramwellian

Your comments would seem pretty naive and immature. Your 'solution' appears to be, "gee, let's all just give in to the hackers and give them...

6 hours ago by ramwellian on Cloud computing security: no more oxymoron?
BugStalker

"Interesting thought ... If you installed Win7 as a dual boot on a machine that previously only had Linux, and it wrecked your Linux installation,...

7 hours ago by BugStalker on Windows 7 Declares War on GRUB
whs001

This is an excellent summary of Ubuntu and Mint and the interface differences between them. Most such articles take a very partisan position for...

7 hours ago by whs001 on A tale of two distros: Ubuntu and Linux Mint
Moley

@ewallace. Not so clear. Anyone can obtain the text, for example from here http://www.ustr.gov/webfm_send/2379. I support ACTA so long as it and...

7 hours ago by Moley on ACTA: Facts, misconceptions and questions
45283

I think WinRT is fantastic. I just wish it was an option for people that didn't want to go through Microsoft's App Store with its attendant...

10 hours ago by 45283 on Why Windows 8 needs architectural hygiene for WOA
Burn-IT

Nine people? £30m? Who's back pocket is that lot going in? And IF they say it is for new buildings, what about all the ones the government has...

11 hours ago by Burn-IT on Police set to launch three £30m e-crime hubs
ewallace

Just to be clear, nobody knows what is in the text of ACTA, here is a photograph of the text of ACTA http://twitpic.com/8h9iju as submitted to the...

11 hours ago by ewallace on ACTA: Facts, misconceptions and questions
fgvrg56

Unfortunately main issue is that ASUS is refusing to accept that they make some mistake on this version of asus Transformer prime. 1 - GPS sensor...

13 hours ago by fgvrg56 on Asus Eee Pad Transformer Prime Wi-Fi & GPS problems?
Ben Woods

@Marcus A fair question. Just talked with Archos which said it was working on an announcement for next week....

14 hours ago by Ben Woods on Archos confirms G9 Ice Cream Sandwich update schedule
Marcus Karlsson

Any update on this, considering the claimed "first week of February"?

15 hours ago by Marcus Karlsson via Facebook on Archos confirms G9 Ice Cream Sandwich update schedule
apexwm

Bill Goodrich : Just as al_langevin pointed out, with Windows Server 2008 there is no Services for Macintosh anymore. It's gone, not available....

23 hours ago by apexwm on Windows Server 2008 drops the ball for Mac compatibility
txtrainguy

Replying to an old topic that I'm currently facing with my CEO (who is on a Mac). Our servers are primarily Windows Servers, office is about...

1 day ago by txtrainguy on Windows Server 2008 drops the ball for Mac compatibility

Latest in Application Development