SpamNet signs up surfers to fight junk email

By Stefanie Olsen, CNET News, 19 June, 2002 14:09

NEWS

Ordinary Web surfers could play a major role in stemming the rising tide of junk email crippling the Net, if a new anti-spam company hits its mark. After operating in stealth mode for nearly two-and-a-half years, Cloudmark on Wednesday is taking the wraps off a new spam-fighting tool, called SpamNet, which aims to use the power of the people to weed out unsolicited commercial email. Conceived by Napster co-founder Jordan Ritter and open-source developer Vipul Ved Prakash, the company is touting the benefits of democracy, networking and collaboration in the war against unscrupulous email marketers. The company does face challenges. It is charged with transforming a tool that's geared for a small Unix developer community into a product for the masses. It also has to offer up a system that's simple and effective to build a critical mass. Finally, it must build in financial support for such a system. Then there is there is the Internet itself, whose enormous strengths of openness, flexibility and redundancy have proven insurmountable foes for legions of companies that have marched off before to vanquish the hordes of spam. Many, such as SpamCop and SpamKiller, already include tools to allow email recipients to report spam to their Internet service providers, a form of democracy in action that has not proven terribly effective. Still, technology pundits say that most existing anti-spam solutions haven't been able to keep up with the rising flood of junk and the sophistication of marketers sending it. In this environment, Cloudmark is drawing attention for what some analysts call a new approach to the problem. "What's exciting about Cloudmark is that it's a distributed response to a distributed problem," said Kevin Werbach, technology analyst at EDventure Holdings. "There are so many spammers out there," he said, "that it's difficult to come up with sophisticated algorithms to catch all the spam and not catch all the email. But if you harness the power of thousand or potentially millions of people on the network, then you can grow the response to the spam almost as fast as the spam itself is growing." Despite repeated attempts to keep spam down to size, the enemy has proliferated: Internet researcher Jupiter estimates that consumers will receive 206 billion junk emailings in 2006 -- an average of 1,400 per person, compared with about 700 per person this year. If Cloudmark is not the first company to address the problem, its claims are among the boldest. Prakash drew inspiration for the company from the sci-fi novel A Fire Upon The Deep, by computer science professor Vernon Vinge, who wrote about a router the size of a planet "that could filter spam," Prakash said. In an interview, Prakash and company chief executive Karl Jacob said their company's software solves the problem of identifying spam and quickly updating email filters by harnessing the intelligence of the Web community at large. Building on a foundation of trust, "It operates on a trust evaluation system, it evaluates the trustworthiness of the user's suggestion to identify a spam message," said Jacob, an investor in the company who recently left his job as chief executive of advice site Keen.com. "It's based on how long they've been in the community, how many messages they've sent that were verified. The effect is it allows a democratic vote." The software is based on Prakash's open-source software Razor, a collaborative spam-filtering system that sifts out about five million messages per day. The technology has about 5,000 "users" or Internet Protocol addresses linked to the community, with more than 60 medium-sized ISP. SpamNet will count new users as individuals, however. Cloudmark's solution requires a free plug-in that plays a minor role in the background of Microsoft's Outlook, the only email client that the product is currently available for. Consumers will see a new file folder on the left side of Outlook deemed for spam and a toolbar at the top for reporting spam or "revoking a spam decision." Every time a user receives a new message he considers spam he would report the message to the program by clicking the first button. As the software stands now, it filters junk into the spam folder based on 2.5 million "signatures" or combinations of zeros and ones, which are used to identify a junk mail message. The underlying technology attaches a signature to each incoming message, and based on a consensus among users, it will mark a signature as spam in real time. So the more people who participate, the greater depth the database will have with additional marked signatures. The signatures are unlike typical spam-fighting tools that are based on "rules" or filters built around spoken language, headers or IP addresses of commercial messages. Anti-spam software company Brightmail uses rules-based filtering, for example. But Jacob says that the model doesn't scale well because it depends on humans to constantly write new rules and technology that can get slowed by comparing too many rules to each incoming message. In contrast, Cloudmark uses algorithms to efficiently find numerals or signatures in the database that are similar to another without scanning the entire set. A spokesman for Brightmail, one of the largest spam-filtering services, said that the company filtered more than 10 billion emails and blocked 1.5 billion junk mails, in the past 12 months. The company's rules-based system is constantly optimised to avoid latency in scanning messages, he said, adding that the vast majority of rules are written automatically, with some exceptions for those particularly challenging spam attacks. Cloudmark plans to always offer a free product to consumers, with eventual plans to sell a more advanced service. It also plans to license its technology to enterprise customers, of which it already has some beta customers. If anything, the company has the angst of Web users on its side. "A community effort against spam is not something we've seen before, at least not on the scale on what they're attempting to gather," said Ray Everett-Church, chief privacy officer at ePrivacy Group, a Philadelphia-based consultancy. "At least they've got a very fertile community who are sick of spam and who are willing to try something new if it will stop it."

For everything Internet-related, from the latest legal and policy-related news, to domain name updates, see ZDNet UK's Internet News Section. Have your say instantly, and see what others have said. Go to the ZDNet news forum. Let the editors know what you think in the Mailroom.

Post your comment

In order to post a comment you need to be registered and logged in.

You can also log in with Facebook. Log in or create your ZDNet UK account below

By signing up for this service, you indicate that you agree to our Terms and Conditions and have read and understood our Privacy Policy. Questions about membership? Find the answers in the Community FAQ

ZDNet UK Live

I think WinRT is fantastic. I just wish it was an option for people that didn't want to go through Microsoft's App Store with its attendant...

25 minutes ago by 45283 on Why Windows 8 needs architectural hygiene for WOA

Nine people? £30m? Who's back pocket is that lot going in? And IF they say it is for new buildings, what about all the ones the government has...

2 hours ago by Burn-IT on Police set to launch three £30m e-crime hubs

Just to be clear, nobody knows what is in the text of ACTA, here is a photograph of the text of ACTA http://twitpic.com/8h9iju as submitted to the...

2 hours ago by ewallace on ACTA: Facts, misconceptions and questions

Unfortunately main issue is that ASUS is refusing to accept that they make some mistake on this version of asus Transformer prime. 1 - GPS sensor...

3 hours ago by fgvrg56 on Asus Eee Pad Transformer Prime Wi-Fi & GPS problems?

@Marcus A fair question. Just talked with Archos which said it was working on an announcement for next week....

4 hours ago by Ben Woods on Archos confirms G9 Ice Cream Sandwich update schedule

Any update on this, considering the claimed "first week of February"?

5 hours ago by Marcus Karlsson via Facebook on Archos confirms G9 Ice Cream Sandwich update schedule

Bill Goodrich : Just as al_langevin pointed out, with Windows Server 2008 there is no Services for Macintosh anymore. It's gone, not available....

13 hours ago by apexwm on Windows Server 2008 drops the ball for Mac compatibility

Replying to an old topic that I'm currently facing with my CEO (who is on a Mac). Our servers are primarily Windows Servers, office is about...

20 hours ago by txtrainguy on Windows Server 2008 drops the ball for Mac compatibility

Sure, that makes perfect sense. Pay wrong-doers money and thank them for breaching your security and pointing out your flaws, that would surely...

20 hours ago by k0tcs3 on US indicts Romanian over NASA climate change hack

I think he's referring specifically to Android apps, as Apple do regulate their App Store, but Google seem to let any old crap onto the Android store!

20 hours ago by Random_Error on RIM: BlackBerry will keep 'garbage' apps out of store