Fighting Spam with Bayesian Filtering
Low End Mac Reader Specials Memory To Go Special: New 2008 iMac 2GB $42 / iMac Intel Core2 DUO & MacBook Pro 2GB $36 - 1GB $20. MacPro 8 Core Memory 4GB kit $154 / 2GB kit $94 -- Free shipping available. Download Typestyler, still the Ultimate Styling Tool for Internet, Print and Video
Graphics. Works great in Classic with a Native OS X Version on the way. Free
Tryout: www.typestyler.com  LA Computer Company: Specials on AppleCare, iMac's, Apple Batteries and Apple A/C Adapters. Also Great prices on Used Apple Computers. Call 1-800-941-7654 Click Here.
OWC: NewerTech miniStack FireWire/USB 2.0 HD & Hub Up to 1.0TB of Performance Storage + FW/USB2 Powered Hubs - convenient & sleek 6.5" x 6.5" x 1.5" Featured: 500GB $169.99; 750GB $209.99; 1.0TB $339.99 Mac users can finally play Party Poker for Mac. Not only that, they can also learn how to play PokerStars for Mac.  Laptop Hardware Provided by TechRestore - Overnight Mac & iPod Repairs.
Compare products like desktop computers, laptops, and LCD TVs side by side! All the information and reviews to make the best purchasing decision for a new cell phone GPS products or MP3 players. The Ciao network makes searching products easy for you.  New MacPro Memory 800Mhz With Apple Spec Heat Sink 2GB $88 / 4GB $138 / 8GB $274 - Click to Maximize your Macs...
- 2003.02.27
My recent article on spam filtering led
reader Lee Williams to send me this message. - A slight variant on your suggestion is based in AI, and it's
called bayesian classification. Rather than having the user
explain to the machine every keyword it wants to flag, the
bayesian classifier simply assigns probabilities to each (word,
phrase) based on what class you put the email in. Then, when it
sees another email, it is able to use these probabilities to
estimate the class it belongs in. It's actually a lot simpler than
having the enduser manually create these filters.
Paul Graham discusses this in his "plan
for spam".
The key element in both solutions is that they are completely
customizable. The existence of individual filters would not
necessarily eliminate 100% of spam to each person, but in the
aggregate it would mean that each email reaches considerably fewer
people, thereby hopefully making it at least somewhat less
cost-effective.
That article is good reading. I think it would be something I would
definitely try. An email client with such filtering would be a great
hit, in my opinion. [Editor's note: Apple's Mail client in
OS X 10.2 includes a Bayesian filter. I've been using it for
over a month and am still training it. dk] I wonder if a combination of the traditional manual filtering and
this would be even better. The manual filtering would allow you to
set a rule for specific phrase or person (say your ex for example)
which gives a 100% probability of being filtered. One interesting point related to your statement about the email
reaching fewer people - which he doesn't make either - is that if a
user actually wanted to receive these emails - after all, someone
must be responding to them - they'd like this filter, too, because
they'd sort the spam they like into the "keep" folder. Contrary to Graham's hypothesis, spam need not end. It would
become highly targeted at those people most likely to respond to it.
The rest of us would ignore it. If everyone had such filters, the
things you're most interested in would be the only things that would
get through. Everyone would like this type of filtering. Haters of spam,
responders of spam, and senders of spam. Now for an even spookier thought - apply the same technology to a
TiVo with voice recognition and filter your TV commercials the same
way.
Jeff Adkins is a science teacher who isn't afraid to state his preferences in computing platforms. In his classroom he has everything from a beige All-in-One to a a G4 XServe, and they all work together nicely. He calls himself the "poster child for technology integration" in the classroom. He was the 2006 Outstanding Educator of the Year for the California Computer Using Educators (CUE) organization. He also maintains a site for astronomy teachers at www.AstronomyTeacher.com. Recent Mac Lab ReportsLinks for the Day- Mac of the Day: Centris 650, Feb. 1993 - The replacement for the Quadra 700 has room for an internal CD-ROM.
- List of the Day: Old Mac MP covers 604-based multiprocessor Macs and clones.
- September 7 in LEM history: 98: Banner exchanges - 00: Tips from the Mac manager - Getting a Mac job - 01: Apple and the gray market - Repositioning the 'Books - 04: Tray loading iMac a good choice for OS X? - Pismo CPU upgrades - 06: Mac mini value equation - Setting up a Mac Classic II - Putting the Intel transition in perspective - 07: Region free DVD viewing, - My Newton - Solving Mac disk and hardware problems - 2 apps every MacBook should have
Recent Content on Low End Mac- Anticipation: New iPods Now, New Macs Later, Kev Kitchens, Kitchens Sync, 09.05.
The season of new iPods is at hand, but new Macs may wait until 2009.
- Buy a MacBook Now or Wait?, MacBook touch Patents, Samsung X360 Takes on MBA, and More, The 'Book Review, 09.05.
Also 20 years of portable Macs, data backup and preservation, universal U-Charge battery charger for Mac 'Books, bargain 'Books from $150 to $2,699, and more.
- Listen to Just the Music with the V-Moda Vibe Earbuds, Tommy Thomas, Welcome to Macintosh, 09.05.
Well built, the noise canceling earbuds will let you hear all the nuances of your music without letting through background noise.
- Source of iPhone 3G Problems, Army Uses iPods as Field Translators, Gains with Business, and More, iNews Review, 09.05.
Also UK bans iPhone ad as 'misleading', iPhone password easy to bypass, GM to offer radios with USB in 2009 models, weather tracking software, and more.
- Macs Gain Ground in August, Consumers Most Likely to Buy Macs, LaCie USB Speakers, and More, Mac News Review, 09.05.
Also migrating Time Machine to a new drive and two new keyboards from Logitech.
- Best iPod touch Deals, Low End Mac Deals, 09.05.
Refurb 8 GB, $199; new, $284; refurb 16 GB, $299; new, $370; refurb 32 GB, $399; new, $453.
- Best 15" MacBook Pro Deals, Low End Mac Deals, 09.05.
Used 1.83 GHz Core Duo, $999; 2.16, $1,125; new, 2.2, $1,450 after rebate; refurb 2.4, $1,699; 2.5, $1,999; 2.6 Santa Rosa, $1,849; rebates on new.
- Best iMac G4 Deals, Low End Mac Deals, 09.05.
Used 15" 700 MHz CD-RW, $279; 800 Combo, $300; 1 GHz $390; 17" 800 MHz SD, $439; 1.25 GHz, $449; 20", $569.
- Overclocking a Mac mini Got Me Hooked on Souping Up Macs, Adam Geller, My First Mac, 09.04.
Stories of hot rodding iBooks, G3 iMacs, and PCI Power Macs on the cheap.
- Apple Will Not Abandon Optical Drives, the Mac Drought, Purposeful Mac Acquisition, and More, Dan Knight, Low End Mac Mailbag, 09.04.
Also Mac OS X 10.5 on a G4-upgraded Blue & White G3 and problems using a flat panel display with a Quadra 700.
- Only Leopard Runs Routine Maintenance Tasks after Startup or Waking from Sleep, Charles W. Moore, Miscellaneous Ramblings, 09.04.
Mac OS X 10.5 runs routine system maintenance scripts as soon as possible after starting up or waking up your Mac. Earlier versions of OS X do not do this.
- Tomorrow's Solid State Drives and Notebooks, Dan Knight, Mac Musings, 09.04.
Flash drives are great but have some shortcomings. Some thoughts on building better SSDs and notebooks to use them.
- Best 12" PowerBook G4 Deals, Low End Mac Deals, 09.04.
Used 867 MHz Combo, no APX, $490; 1 GHz, $550; SuperDrive, $625; 1.5 GHz w/o APX, $660; w/APX, $675.
- Best Mac mini Deals, Low End Mac Deals, 09.04.
Used 1.25 GHz G4 SD, $549; 1.42 Combo, $409; new 1.83 Core2 Combo, $569 after rebate; 2.0 SD, $769 after rebate.
- Best 17" PowerBook G4 Deals, Low End Mac Deals, 09.04.
Used 1 GHz, $779; 1.33 GHz, $799; 1.5 GHz, $859; 1.67 GHz, $910.
- 11 Mac Browsers Compared, Simon Royal, Mac Spectrum, 09.03.
The latest versions of Internet Explorer, Opera, Safari, Shiira, iCab, Radon, Firefox, Netscape Navigator, SeaMonkey, Flock, and Camino tested in Leopard.
- Save Internet Radio, USB and Hard Drives, Hardware Manufacturers vs. Linux, and More, Dan Knight, Low End Mac Mailbag, 09.03.
Also Mac won't book after cleaning, newer versions of OS X improve wake from sleep, downgrading to OS 8.6, unreadable pages on Low End Mac, and more.
- Another Free POP3 Provider, Recharging a Dead PRAM Battery, Current Kanga Value, and More, Charles W. Moore, Miscellaneous Ramblings, 09.03.
GMX email now available in US, Panasonic UJ-841S drive won't burn discs, restoring a dead PRAM battery in a Pismo, and thoughts on Kanga value today.
- Best eMac Deals, Low End Mac Deals, 09.03.
Used 700 MHz Combo, $120; 1.25 GHz SuperDrive, $150; 1.42 GHz, $349.
- Best Mac OS X 10.5 'Leopard' Deals, Low End Mac Deals, 09.03.
Mac OS X 10.5, single user, $99; 5 users, $140; 10.5 Server, 10 users, $395; unlimited, $850.
- Best MacBook Air Deals, Low End Mac Deals, 09.03.
Refurb 1.6 HD, $1,499; new, $1,690 after rebate; refurb 1.8, $1,699; new, $1,919 a/r; refurb 1.6 SSD, $2,099; new, $2,294 a/r; refurb 1.8, $2,299; new, $2,400 a/r.
- Psystar Strikes Back, Countersues Apple, Frank Fox, Stop the Noiz, 09.03.
Psystar is trying to paint Apple as a monopoly and force it to license the Mac OS.
- More links in our archive.
|
