Linux Today: Linux News On Internet Time.
Search Linux Today
Linux News Sections:  Blog -  Developer -  High Performance -  Infrastructure -  IT Management -  Security -  Storage -
Linux Today Navigation
LT Home
Preferences
Contribute
Link to Us
Search
Linux Jobs

Linux Today
Enterprise Linux Today
Apache Today
JustLinux.com
Linux Planet
PHPBuilder
All Linux Devices
Technology Jobs

JustTechJobs.com

LinuxToday Newsletters
Server Daily
IT Management Daily
Subscribe News
Subscribe PR
Subscribe Security

internet.com
Internet News
Small Business

Advertise
Newsletters
Tech Jobs
E-mail Offers

 






Current Newswire:

Time to dispel open source myths, says Liam Maxwell

SECURITY: Nmap Inside and Out

Eight features Windows 8 'borrowed' from Linux

Malware devs embrace open-source

A tale of two distros: Ubuntu and Linux Mint

Raspberry Pi benchmarked against Beagleboard, low price is long term

20 popular Ubuntu Linux apps you may want to try

A Selection of the Very Best Open Source Tutorials and Tools

Android Ice Cream Sandwich ported to x86 tablets, netbooks and notebooks

SECURITY: Google Chrome 17 Improves Security



Applications Management Engineer Sr (NYC)
Next Step Systems
US-NY-New York

Justtechjobs.com Post A Job | Post A Resume
:Putting the Kybosh on Spam (Part 1)
Putting the Kybosh on Spam (Part 1)
Oct 13, 2005, 00 :15 UTC (11 Talkback[s]) (5497 reads)

(Other stories by Brandioch Conner)

By Brandioch Conner

Here's the short answer on how you ("you" being the recipient) can stop spam: you can't. The real problem is the other email admins and ISP's do not see the need to correctly configure and maintain their own systems.

Spam isn't a problem just because it means you get a lot of mail. Spam eats up bandwidth and there's an increasing probability that you'll delete a legitimate message while wading through the spam.

I'm not even going to define what "spam" is because it means different things to different people and there's always an argument about "what if such and such and such happened, would it still be 'spam'?" Even if you only consider the machine sending it you still run into problems. Right now, I know of five different ways to send spam (listed in order of annoyance to me).

  • Spam zombies
  • Open relays
  • Free email accounts (phisher's phavorite)
  • Legitimate companies that get stupid
  • Spam companies/"bulletproof" ISP's that use their own servers/addresses

"Spam zombies" are bad, right? But how do you identify a spam zombie during the SMTP connection? You can't check the machine itself for infections. All you can check is the data that is published (or the absence thereof) and its actions. Here are some of the characteristics of a "spam zombie."

  • It is in an ISP's "home" or dynamically assigned IP range.
    • But so are some legitimate mail servers run by people who don't understand why they should spend money for a static IP address (and "static" in this context does not mean "I haven't seen it change").
    • Not all ISP's correctly identify those ranges.
  • It does not have a correct DNS/rDNS configuration.
    • But there are also email admins who don't have that either. (And one of those admins also has a box in a dynamic range from their ISP.)
  • Currently, it fails to re-send if it gets a non-fatal error from the receiving server.
    • This means that "greylisting" is, currently, very effective against these.
    • But there are also email admins who have not correctly configured their systems to handle non-fatal errors, either.
    • Not everyone is happy with the delay on legitimate messages.

I'm sure everyone can see where this is going now. I work for a small insurance company and I've still had to make seven specific exceptions for clients who fit one or more the above cases. I'm sure it only gets worse as your company gets larger. And that isn't even counting the spammer's ability to adapt faster than many of the email admins. Spammers are one of the first groups to adopt SPF. I know the problems with SPF so don't bother with that. The point is that the spammers will adopt anything that they believe will get their spam through your defenses.

Spam zombies would be almost completely wiped out if the ISP's would:

  • Correctly identify their sub-nets
  • Completely block outgoing port 25 on their dynamic sub-net.(Businesses should already be blocking outgoing port 25 at their firewall, except for their legitimate mail server.)

But that's not going to happen soon because it isn't financially reasonable for them to do so. For each person who used to send via port 25, the ISP's tech support people would have to deal with a support call from that person. Not to mention the additional training those support techs would need. Not to mention any infrastructure changes that they'd have to implement. Not to mention that some of them do not have the expertise necessary to do so. Long story short, it's not going to happen. Some will (Comcast does), many won't.

Right now, I've dramatically reduced the spam we receive with a combination of tests based upon the above three criteria that cumulate in an unknown box being forced into greylisting. But this is only a temporary and very brittle fix. All it would take for the spam zombies to defeat it would be for them to re-send their spam after 1 hour. That should be a minor code change and it should be easy to push out to all the zombies. Like I said, the spammers are faster to adapt than a lot of the legitimate email admins.

In preparation for that day, I'm collecting statistics on all our sent/received email. When worse comes to worst, I'll fall back to personal white/black lists. Yes, they suck. They suck badly. They require far too much manual labour to maintain or they are too easily defeated if scripted.

The good news is that it looks like 80% (by item, not size) of our email is from/to the same servers, day after day. If you work for an Internet sales company, your numbers are probably a lot different. The bad news is that not all of that 80% is business related. Most of it seems to be personal messages. So the remaining 20% may be more important from a business aspect than the 80%. So the good news may not be that good.

On the other hand, the Spamassassin tests are getting better every day. So even if I accept email from a spam zombie v2.0, there is still a very good chance that it will be correctly identified as spam. The downside is that once my system has accepted the email, I cannot risk deleting it before the user sees it, just in case my system is wrong. So the end user still has to wade through the spam. But the more accurate my system is, the more my users will come to accept its evaluation and so legitimate email may be deleted by them just because they didn't have time to verify it and took the machine's opinion as fact. Not to mention that a lot of the tests being run depend upon other people already receiving the spam and correctly identifying it and reporting it to the sites that my system will check. This is great as long as I'm last on the spammer's list, but when I'm first, the junk comes through.


Index Mode   |   Flat Mode   |   Thread Mode   |   Thread Flat  
  Talkback(s) Name  and Date
I saw an excellent presentation on this  ...   Reducing spam   
Vance
Oct 13, 2005, 02:58:21
 
Spam zombies would be almost completely  ...   ISP port blocking?   
DrSmile
Oct 13, 2005, 04:12:01
 
Brandioch claims that Comcast blocks out ...   Port 25 Blocking   
Dave Uhring
Oct 13, 2005, 05:04:48
 
Completely block outgoing port 25 on the ...   Blocking port 25 outgoing is no good   
Tim
Oct 13, 2005, 05:39:38
 
Check the article at:http://www.freesoft ...   Another person's ideas   
Adrian Hicks
Oct 13, 2005, 09:26:16
 
Those also seem to be using greylisting  ...   re: Reducing spam   
Brandioch Conner
Oct 13, 2005, 12:13:51
 
It seems to be blocked on the network I& ...   re: Port 25 Blocking   
Brandioch Conner
Oct 13, 2005, 12:16:42
 
That's already been covered. But so  ...   re: Blocking port 25 outgoing   
Brandioch Conner
Oct 13, 2005, 12:26:30
 
 Some will (Comcast does), many won' ...   comcast   
jp
Oct 13, 2005, 15:50:52
 
Those also seem to be using greylisting  ...   re: Reducing spam   
Vance
Oct 13, 2005, 16:44:26
 
...Of course, if Windows ever comes with ...   re: re: Reducing spam   
Brandioch Conner
Oct 13, 2005, 21:26:39
 
  Home | Search Talkbacks | Customize View    Top of Page  



Enter your comments below:

* Your Name:

* Your Email Address:

* Subject:

CC: [will also send this talkback to an E-Mail address]

* Comments:

Tags allowed:<I>,<B> and <U>. See our talkback-policy for more about talkback content.

Fields marked with * are required!

..............................




All times are recorded in UTC.
Linux is a trademark of Linus Torvalds.
Powered by Linux, Apache and PHP