Spam filter: A boon or a bomb?

Daily Newsletters

Sign up to ZDNet UK's daily newsletter.

NEWS
A meeting reminder from the boss, a lascivious letter from a lover, or the daily tally from a fantasy football league: Which email would you read first? Programmers at a small software company say they have the answer and that it can help millions of workers cope with the growing spam menace. The software categorises email on a scale from one to 100, then sorts messages according to the recipient's behavior and preferences. Important notes with high scores float to the top of the in-box, while unwanted spam, newsletters and other banalities sink to the bottom. San Francisco-based Banter plans to launch the software -- now only available as part of a $75,000 suite of programs -- later this year as a standalone product. Executives don't know how much they will charge for the email application, and they are still conducting market research to find a catchier name than Banter Server for Email Productivity. The software theoretically does what the brain attempts to do, by automating hundreds of mental calculations to create a list of priorities, without getting tripped up by human emotions, guilt or tired eyes. Banter secured a patent on 18 June for the so-called natural language technology. But Banter's product has sparked debate among industrial psychologists and human resource executives, who argue that the program -- and a wave of other content-categorising applications -- could be a political guillotine for aspiring managers. They worry that the software, even if it helps workers slog through email faster, could offend those who rank at the bottom of priority lists. But Banter executives insist the concept is apolitical and inoffensive -- a clever way to address the deluge of unwanted email among American office workers. According to research firm Gartner, unnecessary email costs the average American business with 10,000 employees about $16m (£10.2m) a year. Spam has been growing exponentially for years, jumping fivefold in the last year from about 1 million messages last June to just under 5 million this year, according to a report earlier this month by ISP filtering company Brightmail. "Current methods of managing email are insufficient to deal with the vast explosion of written communication, and people want smarter, adaptive mechanisms," said Yoram Nelken, chief technology officer of Banter. "Everyone needs help with email, and that's what we're trying to give to people." Learning your email habits
Banter's Email Productivity differs sharply from automatic routing functions of Outlook and other email applications. Those programs allow people to click on icons and route email from a specific person or with a specific subject line directly to the trash -- wiping junk away before the recipient sees it. Banter's software, by contrast, monitors people's email habits -- even without input from the person -- and prioritises mail so that the most important items rise to the top of the in-box and the chaff sinks. Items with low priority (from zero to about 20) fall to the bottom of the in-box so people don't see them when they first open their email application. High-priority items (about 80 to 100) rise to the top. No email necessarily gets sent to the trash bin. The program monitors people's habits for a couple of weeks, quietly making decisions based on what it has "learned". A couple of weeks after installation, for example, the program might determine that a worker rarely responds to certain bulk email from the human resources department, and so those emails would receive low-priority placement. In theory, the longer the software is in use, the more precise it becomes at prioritising. Email Productivity might give low importance to email based on the number of exclamation points in the subject line or the number of times the word "Viagra" or "insurance" appears in text -- clear indications of spam. People may also click on icons that say "low priority" or "high priority" to help the software understand their preferences more quickly. Matt Schvimmer, a 32-year-old Banter product manager in San Francisco, is one of the few people who has used the software for several months. (Banter would not release an early copy of the program to CNET News.com because executives say it is not ready for consumer use.) Schvimmer volunteered to be the "alpha guinea pig" because he felt he was wasting too much time sorting through roughly 150 emails in his in-box every morning. "I used to spend typically half my day, from 8 o'clock to noon, just reading emails that I had to act on -- service agreements and things," Schvimmer said. "I was sceptical that this would work -- that anything could work." As the software recorded which emails Schvimmer was deleting or responding to, it assigned priority. High marks went to email from certain customers and from his counterpart in Banter's Israel office, as well as anything from colleagues that mentioned an "urgent" response was required. Low marks went to all mail from bulletin boards, subscriptions to CRM Today and other newsletters, personal emails about fantasy football, and anything not addressed directly to Schvimmer. (His pet peeve is nonurgent email CC'ed to him.) "It bubbles up the high-priority email so that if something has immediate action required, I can read it first," Schvimmer said. "It has made my mornings a lot more organised." Banter is one of dozens of technology companies -- ranging from Microsoft to Silicon Valley start-ups -- eager to sell products to spam-weary workers. Instant messenger providers, including Yahoo! and AOL, are pushing IM to corporate users as a more efficient means of communication than email; providers say IM seems more urgent and personal than bulk emails, and it doesn't clutter in-boxes. Banter is also one of many companies focusing on the hot software niche known as content categorisation. RuleSpace Contexion Services, for example, has a patent to categorise 75,000 Web sites per day, sorting them according to child-friendly preferences that parents can pick. Autonomy, Semio, Verity and Quiver also offer "taxonomy" software that automatically categorises Internet content. Efficiency boon or political bomb?
But Banter bills itself as the first categorisation specialist to deal with a new and increasingly common form of junk email known as "occupational spam". Occupational spam is any email from a colleague or business contact that isn't strictly necessary or urgent. It could be a calendar item to 1,000 workers informing them of the office picnic next week. It could be a bulk email from the chief executive about the success of the company's newest product or a recent earnings report. Or -- the worst form of occupational spam, according to many recipients -- it could be a "reply all" response that simply says, "Thanks!" or "I second that!" Only 27 percent of all email office workers receive in an average day demands their immediate attention, according to Gartner, and 34 percent of interoffice email is useless. If a company could somehow purge occupational spam from its servers, it could boost time efficiency by 30 percent, estimated Gartner research director Neil MacDonald. But whether a colleague's email is junk is a touchy subject involving both office politics and time management elements. Because of that, many business experts are critical of Banter's concept. Industrial psychologists say the product could send the wrong message -- especially if co-workers or bosses found out their email ranked as a low priority. And the software could be even more problematic outside of the relatively unemotional world of work: Would a spouse or mother take kindly to the idea that their prolific correspondences were automatically sinking to the bottom of the priority list? Management professors also worry that the slightest bug in any categorisation software could result in an urgent email that gets improperly routed to the bottom of the in-box, causing a worker to miss a deadline or otherwise put a damper on his or her career prospects. They also note that savvy workers occasionally inflate the importance of a single email for the sake of currying favor with a boss or new co-worker -- regardless of whether the actual content is important. "I realise it's very annoying to read about the hard-working custodian who has given 15 years of service, and now the company is having a wine and cheese reception 23 July for her," said Andrew DuBrin, a professor of management and industrial psychologist at the College of Business at the Rochester Institute of Technology. "But ignoring that email, or even using the software in the first place, could be seen as a violation of a very important principle of office politics: Be nice to people. "If you used this, you could be seen as someone who doesn't get out of the cubicle, doesn't smile at people or thank them. These are all important aspects of being a leader," DuBrin said. "You can't just relegate these messages to the bottom of your priority list." Admittedly resentful of spam and its drag on time management, DuBrin said the software might work wonders for people who have little interest in climbing the company ladder or making friends with colleagues. But his advice to aspiring managers tempted to use such software was blunt: "It could come back to haunt you." Others were not so dismissive. Tim Hatcher, an associate professor of human resources at the University of Louisville and author of a book on ethics and human resource development, said the software was no different than the subconscious or conscious categorising that people do every day. He said whether Banter's software gains acceptance as a time management tool or gets shunned as a political bomb will depend on how companies introduce it. "If the program is less than effectively and positively introduced into the organisation or is seen as somehow clandestine or oddly out of the corporate norm, then no matter how well it works, most employees will avoid it," Hatcher said. "But if top management supports it, introduces it in an above-board and positive light... and there's been time for it to become part of the corporate culture, then it will be used." But even if it's introduced effectively, Hatcher warned some workers to avoid the software -- especially people who are extremely concerned about appearances and politics. "For people tenuous in their jobs or new to a profession, I suggest that they avoid anything that might put them in a less than positive light with anyone who can impact their career -- this includes content categorising software," Hatcher said. "For others who are well-established in a job and already socialised into a career, I anticipate few negative repercussions with their use of the email filter program, especially if it's an accepted part of the organisation."
See the Software News Section for the latest headlines on everything from peer to peer clients to Office software and beyond. Have your say instantly, and see what others have said. Go to the ZDNet news forum. Let the editors know what you think in the Mailroom.

Post your comment

In order to post a comment you need to be registered and logged in.

You can also log in with Facebook. Log in or create your ZDNet UK account below

  • Login

Will not be displayed with your comment

By signing up for this service, you indicate that you agree to our Terms and Conditions and have read and understood our Privacy Policy. Questions about membership? Find the answers in the Community FAQ

Get ZDNet UK's daily newsletter

Enter your email address to sign up

ZDNet UK Live

TerryRK

Well it seems there is something a number of us agree on. Why is the Ubuntu Unity launcher so ugly? I thought perhaps it was something to do with...

4 hours ago by TerryRK on A tale of two distros: Ubuntu and Linux Mint
Freebies202

Duplicate comments are not made intentionally. Its very good to know that now you are keeping check on this problem because sometimes a commenter...

13 hours ago by Freebies202 on Microsoft fixes blog comments, speeds up blogs with open source
kevinmchapman

"the very significant number of users" and "many (most) of us" - you have no evidence for these statements. It is a fact that most users are saying...

21 hours ago by kevinmchapman on A tale of two distros: Ubuntu and Linux Mint
Marg Menzies Harrison

Another grammar faux pas is the improper use of "you". When sitting down down in a restaurant, for example, I get cringe when the waitress...

23 hours ago by Marg Menzies Harrison via Facebook on 10 flagrant grammar mistakes that make you look stupid
zdnetukuser

And NOW, folks, for Canonical's next trick... Kubuntu is late. Here's a pencil. Draw your own conclusions. cf.:...

23 hours ago by zdnetukuser on Linux Minterface
Moley

@kevinmchapman. The discussion here reflects the very significant number of users who really do like the traditional menu system and who wish to...

1 day ago by Moley on A tale of two distros: Ubuntu and Linux Mint
kevinmchapman

Er, no... It is an efficient means of finding the application/file/setting you need in one place. The icons are a simply a fallback for when you...

1 day ago by kevinmchapman on A tale of two distros: Ubuntu and Linux Mint
TerryRK

Isn't the provision of a text based search an admission by the developers that the mass of icons approach does not work? I don't need to use a...

1 day ago by TerryRK on A tale of two distros: Ubuntu and Linux Mint
kevinmchapman

"Unity and GNOME 3 both abandon the old text-based cascading menus in favour of a graphical icon-driven system." Point truly missed. Both use a...

1 day ago by kevinmchapman on A tale of two distros: Ubuntu and Linux Mint
TerryRK

whs001 - Thank you, I'm glad you liked the article. I absolutely agree with you on your first point. I should perhaps have made it clearer that...

1 day ago by TerryRK on A tale of two distros: Ubuntu and Linux Mint
Dennis Nilsson

If we allow corporate interest to dictate the way our government circumvents due process against foreign entities then we should accept the same...

1 day ago by Dennis Nilsson via Facebook on ACTA stumbles in Germany
GHar123

I totally dislike pirating of works, I fear that artists will be deterred from creating works if they think that they are going to get ripped off....

1 day ago by GHar123 on ACTA stumbles in Germany
JCB33

How dare film makers, artists or anybody that invests in creativity stop us pirating their works for free. I want to be able to walk into my local...

2 days ago by JCB33 on ACTA stumbles in Germany
Moley

@GrueMaster. I prefer horses for courses rather than one size fits all. I, and I suspect most other computer users, do not really wish to have...

2 days ago by Moley on A tale of two distros: Ubuntu and Linux Mint
greycynic

The product that scares me every time I have to use it is the Office 2007 version of Excel. The first bug that I found was applying the median...

2 days ago by greycynic on Ten flawed products that derail productivity
GrueMaster

Nice review and very informative. One thing I'd like to add (in reply to whs001's 1st question), the main reason to have the same interface from...

2 days ago by GrueMaster on A tale of two distros: Ubuntu and Linux Mint
Frederick Wrigley

I'be been using Mint 12 since the RC came out, and I am far more happy with the Cinnamon, the Mate, and, yes (with extensions), theGnome 3...

2 days ago by Frederick Wrigley via Facebook on A tale of two distros: Ubuntu and Linux Mint
bdantas

Excellent article. One small correction, though--although a fresh installation of Linux Mint 12 will, indeed, provide the user with a version of...

2 days ago by bdantas on A tale of two distros: Ubuntu and Linux Mint
Alan Ralph

In related news, the ISPs club together to get the members of the Home Affairs Select Committee (ya goofed on that part, ZDNet UK) copies of "The...

2 days ago by Alan Ralph via Facebook on MPs urge ISPs to take down terrorist material
Alan Ralph

In related news, the ISPs club together to get the members of the Home Affairs Select Committee (ya goofed on that part, ZDNet UK) copies of "The...

2 days ago by Alan Ralph via Facebook on MPs urge ISPs to take down terrorist material