Does Google's power threaten the Web?

Daily Newsletters

Sign up to ZDNet UK's daily newsletter.

NEWS
Patrick Ahern has witnessed the power of Google -- and the difficulties of trying to do business without it. Data Recovery Group, where he is president, would typically come up around the fourth listing on Google's popular search engine last year. Then in January, when Google removed the company from its listings without explanation, Data Recovery saw a 30 percent drop in business. "When you're No. 4 that plays well; when you fall off, you tend to lose phone traffic. And if you don't have the right relationship with Google to find out what you could have done wrong, you're out of luck," Ahern said, noting that this can have a dangerous domino effect. "If you're not ranked in Google, Yahoo won't list you. It's incestuous." In the dot-com shakeout, Google has not only survived but reigns supreme. Web surfers have flocked to the service, effectively voting it the best search engine around. So powerful has Google become that many companies view it as the Web itself: If you're not listed on its indexes, they say, you might as well not exist. And if you don't advertise on Google or otherwise curry favour, critics add, you may never find out what it takes to get a prominent listing. Pragmatists in the industry even say its dominance in Web search gives Google a new responsibility to maintain fair access to as many sites as possible, leading some to suggest that it be regulated as a quasi-public agency. Last week, for example, an Oklahoma marketing firm filed suit against Google in federal court charging that Google unfairly began listing the company lower in search results. "So many people are dependent on Google's free editorial traffic that it's like food out of their mouths to lose ranking," said Danny Sullivan, who runs Searchenginewatch.com. "Search engines are not in the business of supporting people's companies. But if they are going to provide editorial, they need to provide support. These are some of the issues they face." Only a few years ago, when traffic was more evenly distributed among search services, Web sites clamoured to get free listings from familiar names such as Lycos and AltaVista. But the dot-com collapse led portals and search engines to sell sponsored links and license editorial results from a third party -- a market that Google, based in Mountain View, California, has come to dominate since its founding in 1998. Leading portals and Internet service providers such as Yahoo, America Online and EarthLink have turned to Google to power their searches because of its simple, straightforward style and consistency for serving up germane results. Such companies typically mix Google's results with listings of their own to maintain some autonomy and uniqueness on the Web. It is these deals that have catapulted Google ahead of competitors and sent Web site operators scrambling for prominent listings in its search results. "It's not like we've put all our eggs in one basket -- it's just that there is no other basket," said Greg Boser, president of Web marketing consultancy WebGuerrilla, which helps companies improve their visibility in search engines. In many ways, this is no exaggeration. Google averages about 15 million visitor hours each month, compared with Yahoo search at 6 million hours, according to Sullivan. Search hours are calculated by factoring the number of site visitors by the average number of minutes each spends at the site. Yahoo recently renewed its partnership with Google for an unspecified term, a deal some doubted would happen because of the search darling's growing threat. Yahoo has even given Google more editorial voice and played down its own directory results. Search engine experts say that in comparison tests, a search on Google and on Yahoo varies little for popular terms like Britney Spears or NFL. Google software engineer Matt Cutts said the search engine business is healthier and more competitive than ever, with many niche providers and international forces. "What we worry about is providing the best results to users; we don't worry about market share," he said. "That will all work itself out." Exactly how the system works itself out, however, is what worries people in the industry. Boser and others are concerned that paid advertisers get crucial advice that maximizes their editorial listings. "As you're spending money with them as an advertiser, that spending does not buy you position; that spending buys you advice on how to get position -- a byproduct of the advertising sport," said Data Recovery's Ahern, a client of WebGuerrilla. Ahern learned that the term "data recovery" was a valuable commodity in paid search, worth as much as $10 per click. As a result, he was forced to spend several thousand dollars a month on pay-per-click advertising on Google and rival Overture to compensate for losing up to 85 percent of his traffic earlier this year. Ahern no longer buys Google ads because his top position has been restored, but it has been an expensive process. The depth of concern about the search industry's practices was made clear at a conference earlier this year, where participants stressed the need for policies to protect Web sites dependent on the engines. Among the proposals were calls for fair and consistent spam-reporting policies in which Google and others reply to all complaints, not just those from advertisers. Also suggested were standards for a formal review system that helped sites understand why they're not listed and thereby give them information necessary to improve their chances. Craig Silverstein, Google's chief technology officer, denies that advertisers get preferential treatment in its editorial listings. On the issue of information about changes in rankings, he said it is impractical to provide support for everyone, considering that the company indexes nearly 2.1 billion pages. But Google is examining its system, well aware that growing criticism could damage its credibility with the public at large. In an effort to beat Google at its own game, some marketers have adopted guerrilla tactics that try to manipulate search rankings. This has led to a proliferation of "link farms" -- elaborate linking schemes designed to manipulate one of Google's only publicised algorithms, PageRank, which factors a site's popularity based on the number of Web pages that link to that site. Many industry executives speculate that Google changed its search algorithm in September to combat link farms, which caused a shift in listings and a lower number of documents served up for any given query. The changes have thrown Webmasters into a frenzy, as shown in thousands of messages on industry sites such as SearchEngineForums. Daniel Brandt, who publishes the watchdog site Google-watch.org, complains that PageRank is the equivalent of a popularity contest that favours major, established Web sites. "We don't know which comes first -- whether Google is reflecting popularity or if it's creating popularity," he said. Silverstein asserts that Google does not provide preferential treatment to advertisers in text results or target smaller sites for delisting. Google alters its algorithms all the time to improve search quality, he said, and sites might have seen changes recently because of a "fresh crawl" that updates up to 3 million documents more regularly. As for tactics such as spam and link farms, Google says those just make accurate searches more difficult for surfers. That, in turn, could affect Google's credibility at a time when trust is more important to the company than ever. "There's a constant battle between abusive technologies and providing relevant search results," Silverstein said. "When you use something as a tool and you don't have control over it, that's an issue, an issue of trust. You need to be able to trust us that we are acting in the best interests of our user." Others dismiss much of the complaints about Google as conspiracy theory, saying it should not be required to baby-sit sites that have simply fallen victim to the Internet's evolution. "Google is a great scapegoat when people get mad. But it's about protecting relevancy," said Jessie Stricciola, a consultant who helps companies improve traffic to their Web sites. "The cannibalisation of search results has the potential to become problematic, because you have one chance with 10 distribution channels. But that's the nature of how the Web is evolving -- that's not Google's fault."
For everything Internet-related, from the latest legal and policy-related news, to domain name updates, see ZDNet UK's Internet News Section. Have your say instantly, and see what others have said. Go to the ZDNet news forum. Let the editors know what you think in the Mailroom.

Talkback

very good article....and totally true.....power corrupts. Google is very powerful.

via Facebook 5 December, 2003 17:49
Reply

Post your comment

In order to post a comment you need to be registered and logged in.

You can also log in with Facebook. Log in or create your ZDNet UK account below

  • Login

Will not be displayed with your comment

By signing up for this service, you indicate that you agree to our Terms and Conditions and have read and understood our Privacy Policy. Questions about membership? Find the answers in the Community FAQ

Get ZDNet UK's daily newsletter

Enter your email address to sign up

ZDNet UK Live

TerryRK

Well it seems there is something a number of us agree on. Why is the Ubuntu Unity launcher so ugly? I thought perhaps it was something to do with...

2 hours ago by TerryRK on A tale of two distros: Ubuntu and Linux Mint
Freebies202

Duplicate comments are not made intentionally. Its very good to know that now you are keeping check on this problem because sometimes a commenter...

11 hours ago by Freebies202 on Microsoft fixes blog comments, speeds up blogs with open source
kevinmchapman

"the very significant number of users" and "many (most) of us" - you have no evidence for these statements. It is a fact that most users are saying...

19 hours ago by kevinmchapman on A tale of two distros: Ubuntu and Linux Mint
Marg Menzies Harrison

Another grammar faux pas is the improper use of "you". When sitting down down in a restaurant, for example, I get cringe when the waitress...

21 hours ago by Marg Menzies Harrison via Facebook on 10 flagrant grammar mistakes that make you look stupid
zdnetukuser

And NOW, folks, for Canonical's next trick... Kubuntu is late. Here's a pencil. Draw your own conclusions. cf.:...

21 hours ago by zdnetukuser on Linux Minterface
Moley

@kevinmchapman. The discussion here reflects the very significant number of users who really do like the traditional menu system and who wish to...

23 hours ago by Moley on A tale of two distros: Ubuntu and Linux Mint
kevinmchapman

Er, no... It is an efficient means of finding the application/file/setting you need in one place. The icons are a simply a fallback for when you...

1 day ago by kevinmchapman on A tale of two distros: Ubuntu and Linux Mint
TerryRK

Isn't the provision of a text based search an admission by the developers that the mass of icons approach does not work? I don't need to use a...

1 day ago by TerryRK on A tale of two distros: Ubuntu and Linux Mint
kevinmchapman

"Unity and GNOME 3 both abandon the old text-based cascading menus in favour of a graphical icon-driven system." Point truly missed. Both use a...

1 day ago by kevinmchapman on A tale of two distros: Ubuntu and Linux Mint
TerryRK

whs001 - Thank you, I'm glad you liked the article. I absolutely agree with you on your first point. I should perhaps have made it clearer that...

1 day ago by TerryRK on A tale of two distros: Ubuntu and Linux Mint
Dennis Nilsson

If we allow corporate interest to dictate the way our government circumvents due process against foreign entities then we should accept the same...

1 day ago by Dennis Nilsson via Facebook on ACTA stumbles in Germany
GHar123

I totally dislike pirating of works, I fear that artists will be deterred from creating works if they think that they are going to get ripped off....

1 day ago by GHar123 on ACTA stumbles in Germany
JCB33

How dare film makers, artists or anybody that invests in creativity stop us pirating their works for free. I want to be able to walk into my local...

1 day ago by JCB33 on ACTA stumbles in Germany
Moley

@GrueMaster. I prefer horses for courses rather than one size fits all. I, and I suspect most other computer users, do not really wish to have...

2 days ago by Moley on A tale of two distros: Ubuntu and Linux Mint
greycynic

The product that scares me every time I have to use it is the Office 2007 version of Excel. The first bug that I found was applying the median...

2 days ago by greycynic on Ten flawed products that derail productivity
GrueMaster

Nice review and very informative. One thing I'd like to add (in reply to whs001's 1st question), the main reason to have the same interface from...

2 days ago by GrueMaster on A tale of two distros: Ubuntu and Linux Mint
Frederick Wrigley

I'be been using Mint 12 since the RC came out, and I am far more happy with the Cinnamon, the Mate, and, yes (with extensions), theGnome 3...

2 days ago by Frederick Wrigley via Facebook on A tale of two distros: Ubuntu and Linux Mint
bdantas

Excellent article. One small correction, though--although a fresh installation of Linux Mint 12 will, indeed, provide the user with a version of...

2 days ago by bdantas on A tale of two distros: Ubuntu and Linux Mint
Alan Ralph

In related news, the ISPs club together to get the members of the Home Affairs Select Committee (ya goofed on that part, ZDNet UK) copies of "The...

2 days ago by Alan Ralph via Facebook on MPs urge ISPs to take down terrorist material
Alan Ralph

In related news, the ISPs club together to get the members of the Home Affairs Select Committee (ya goofed on that part, ZDNet UK) copies of "The...

2 days ago by Alan Ralph via Facebook on MPs urge ISPs to take down terrorist material