Using a five-layer filter to cut spam

Daily Newsletters

Sign up to ZDNet UK's daily newsletter.

CASE STUDY

TechRepublic Member: Curtis Birnbach

Job: President, Hudson Research Inc., which runs an electro-optics foundry including an optical shop, an electronics lab, an electro-optics lab, and mechanical fabrication areas, and produces devices for the military and the telecommunications industry

Industry: Electro-optics

Problem: Reducing the amount of spam employees have to delete

Solution
We have a five-layer spam filtration process that eliminates much of the problem. We get between 400 and 800 pieces a day, of which about 85 percent comes from China. Our layers are:

  • Brightmail
  • Router/hardware firewall
  • McAfee Spam-Killer
  • Symantec Software Firewall/Anti-Virus
  • E-mail client
  • This combination eliminates all but 50 to 100 pieces. The biggest problem is that our two Web sites attract spiders through the info@xxx general addresses. We can eliminate the bulk of the remaining spam by adding JavaScripts to the site, but that would compromise the ability of our sites to go through firewalls without requiring entries into the firewall database. We have always tried to maintain the maximum level of availability on our sites by minimizing the number and types of JavaScripts and using code that is highly cross-platform compatible.

    Client does a lot of the work
    We have elected to put a substantial portion of our defenses on the client rather than the server as it makes our system less vulnerable. It is annoying to administer, but worth the effort as it has prevented virus- and worm-based attacks. Given the number of security holes in the Windows servers, the client-based approach has obvious benefits. It works. The spammers are not anticipating this, and they focus their attack on the server. While we take as much care as possible to protect our servers, they are but one layer and a deception as far as the spammers are concerned.

    At this point, we are faced with the choice of rewriting a substantial portion of two Web sites to mitigate the problem or continuing to spend about a half hour per day on directly spam-related screening.

    Blocking tactics
    We tune our various filters to block primarily by domain, secondarily on key words. Due to the highly specific and technical nature of our products and services, we block all mail from non-NATO countries. However, advanced spammers routinely send mail through third parties, particularly through free services such as Yahoo, MSN, Excite, Lycos, etc. These services represent one of the biggest problems facing us as we also get a portion of legitimate email through these ISPs and cannot afford to summarily block these services.

    I can tell you that the impact of spam on small businesses is proportionally greater than the impact on large businesses. We have less manpower, less money, sometimes no IT department at all, and to devote even a half an hour a day to this issue is a terrible burden.

    Talkback

    Surely Fortinet's FortiGate will be a lot better - one point of easy administration and update, and a lot more precise than all the layers you've put in ... And the price is right too.

    via Facebook 17 December, 2003 16:07
    Reply

    I don't see how that is five layers of filtering. Maybe a one layer system with the filtering spread out over five tiers. You might call it a five tiered system with 1 layer of spam protection. I don't see how any of your tiers are overlapping.

    Anyway, JavaScript doesn't require any special firewall rules to use it to mask your email addresses. Although it's probably too late now, you're already on every spammer's mailing lists.

    I would highly recommend hring a consultant or looking to see what is available before whipping up your own "spam solution". There are other ones out there for less admin work and less cost than what you have implemented that block more spam and with rare false positives.

    An interesting read though, to see how the average joe is being forced to deal with their organization's spam problem without any guidance.

    via Facebook 17 December, 2003 17:44
    Reply

    The strategies used by this company are interesting. But, as is always the case, there are better solutions. We are publishers of an agricultural commodity market news service, with customers in 60 countries. We recently solved the problem of having our website spidered for email addresses by creating a form -- similar to this -- and a perl script to manage the input. The page contains no javascript and is therefore compatible with all browsers and users behind forewalls report no problems. We had been receiving over 500 spam emails per day. We eliminated almost half the spam by carefully reviewing the email addresses which were being used to reach us and removing those which are not commonly used from our mail server. For the balance, we use a server based solution -- a antispam filter system we created which scans all inbound messages received on our Mercury32 mail server. On average, no more than 10 messages get past the filters, and all that do are used to generate new rules. Companies which have installed our system on their Mercury32 mail servers report similar results -- eliminating between 95% and 98% of spam each day. We deal with email viruses in two ways. We deny messages which have attachments which are obviously executible content. We then use AVG antivirus to scan all messages with attachments which make it through the prefiltering phase. This has been close to 100% effective and often traps new email viruses before anti-virus definitions have been created. We would love to figure out how to trun our system from a freely available one to one on which we can make money in order to recover the cost of maintaining the filter set. However, we will not stop working on the filter set because it ha proven extremely effective for us and for the companies which are using it to combat spam in their systems. The filter is available for download from http://www.stat-communications.com

    via Facebook 18 December, 2003 02:49
    Reply

    InboxMaster a relative unknown gem by Secluda Technologies can add the finishing touch. It separates known and unknown email and detains the unknown at server level. At users request this is reported by email at convenient moments. Thru hotspots the users can decide to receive the message, trust the sender, show a safe content copy or ......do nothing.....meaning it will be discarded after a chosen period! Less networktraffic, no infected mail in the inbox, minimal management by the enduser and no disturbance op productivity by 'mailpings'!
    The outgoing emailbehavior per enduser, automatically builds the 'trusted'database per user. http://www.secluda.com.

    via Facebook 16 March, 2004 09:18
    Reply

    Post your comment

    In order to post a comment you need to be registered and logged in.

    You can also log in with Facebook. Log in or create your ZDNet UK account below

    • Login

    Will not be displayed with your comment

    By signing up for this service, you indicate that you agree to our Terms and Conditions and have read and understood our Privacy Policy. Questions about membership? Find the answers in the Community FAQ

    Get ZDNet UK's daily newsletter

    Enter your email address to sign up

    ZDNet UK Live

    bordero

    ike fuelband is great for every healthminded person ! to work out! theres this website called textme4free.com that you can use to text anywhere in...

    8 hours ago by bordero on Nike's FuelBand wristband gamifies exercise
    BrownieBoy

    > I'm told it's somewhat annoying when people have their Macs stolen > and Apple stores treat the thief as the owner, but there you go. Ouch,...

    10 hours ago by BrownieBoy on AMD Ultrathins to challenge Intel Ultrabooks
    Moley

    @kevinmchapman. OK, I acknowledge that 'most' was a gratuitous throwaway comment as an afterthought and too presumptuous. As to proof, as you...

    15 hours ago by Moley on A tale of two distros: Ubuntu and Linux Mint
    Jack Schofield

    @BrownieBoy > Works really well for thieves.... >> Nice attempt to deflect the argument by tossing in a point that's totally >> irrelevant, even...

    16 hours ago by Jack Schofield on AMD Ultrathins to challenge Intel Ultrabooks
    raskolnikof

    fantastic that the so called piracy bills have been withdrawn. however, these anti-democracy supporters are still in the shadows so lets be alert...

    17 hours ago by raskolnikof on SOPA, Protect IP support wavers in face of online protest
    Tony Douglas

    Please God no; teach them anything you like - thinking rationally, the uses and misuses of data, what data is and what it's not - but leave the...

    19 hours ago by Tony Douglas via Facebook on Kids are the future. Teach ’em to code.
    BrownieBoy

    @Jack, > Works really well for thieves.... Nice attempt to deflect the argument by tossing in a point that's totally irrelevant, even it were...

    1 day ago by BrownieBoy on AMD Ultrathins to challenge Intel Ultrabooks
    bootlegger

    Make that 13 people now - I got refused today at Manchester airport. I thought I was up to date on this legislation - I knew of the EU ruling from...

    2 days ago by bootlegger on UK airport body scans will not be opt out
    tinycg

    Don't forget to check out apps like GoodReader or SlideShark either, they're indispensible for people on the go in presentation situations. Best...

    2 days ago by tinycg on Four top iPad apps for people on the move
    TerryRK

    Well it seems there is something a number of us agree on. Why is the Ubuntu Unity launcher so ugly? I thought perhaps it was something to do with...

    2 days ago by TerryRK on A tale of two distros: Ubuntu and Linux Mint
    Freebies202

    Duplicate comments are not made intentionally. Its very good to know that now you are keeping check on this problem because sometimes a commenter...

    2 days ago by Freebies202 on Microsoft fixes blog comments, speeds up blogs with open source
    kevinmchapman

    "the very significant number of users" and "many (most) of us" - you have no evidence for these statements. It is a fact that most users are saying...

    3 days ago by kevinmchapman on A tale of two distros: Ubuntu and Linux Mint
    Marg Menzies Harrison

    Another grammar faux pas is the improper use of "you". When sitting down down in a restaurant, for example, I get cringe when the waitress...

    3 days ago by Marg Menzies Harrison via Facebook on 10 flagrant grammar mistakes that make you look stupid
    zdnetukuser

    And NOW, folks, for Canonical's next trick... Kubuntu is late. Here's a pencil. Draw your own conclusions. cf.:...

    3 days ago by zdnetukuser on Linux Minterface
    Moley

    @kevinmchapman. The discussion here reflects the very significant number of users who really do like the traditional menu system and who wish to...

    3 days ago by Moley on A tale of two distros: Ubuntu and Linux Mint
    kevinmchapman

    Er, no... It is an efficient means of finding the application/file/setting you need in one place. The icons are a simply a fallback for when you...

    3 days ago by kevinmchapman on A tale of two distros: Ubuntu and Linux Mint
    TerryRK

    Isn't the provision of a text based search an admission by the developers that the mass of icons approach does not work? I don't need to use a...

    3 days ago by TerryRK on A tale of two distros: Ubuntu and Linux Mint
    kevinmchapman

    "Unity and GNOME 3 both abandon the old text-based cascading menus in favour of a graphical icon-driven system." Point truly missed. Both use a...

    3 days ago by kevinmchapman on A tale of two distros: Ubuntu and Linux Mint
    TerryRK

    whs001 - Thank you, I'm glad you liked the article. I absolutely agree with you on your first point. I should perhaps have made it clearer that...

    3 days ago by TerryRK on A tale of two distros: Ubuntu and Linux Mint
    Dennis Nilsson

    If we allow corporate interest to dictate the way our government circumvents due process against foreign entities then we should accept the same...

    3 days ago by Dennis Nilsson via Facebook on ACTA stumbles in Germany