* New manual page
* spamprobe.cc (process_stream): Added -o tokenized option
to allow people to use an external tokenizer with spamprobe.
* SpamFilter.cc (scoreToken): Reduced sorting overhead by
pre-computing and integer sort value with sorting priorities
reflected in the value. This eliminates several calculations
inside of the sort routine.
* SpamFilter.cc (computeRatio): Capped ratios in calculations to
within MIN_PROB and MAX_PROB. Widened that range. This avoids
problems with div/0 and makes it easier to sort terms.
* spamprobe.cc (dump_words): dump command can now optionally
accept a regular expression as an argument and will only dump
terms matching the regular expression.
(purge_terms): Added purge-terms command to purge from the
database all terms matching a regular expression.
Patch submitted by Ossi Herrala <PGP: 0x78CD0337> in private email.
Patch provided by Ossi Herrala <$MAINTAINER> in private mail.
CHANGED:
* This release moves from Paul's original formula to a slightly modified
one that yields more evenly distributed scores. To continue using old
formula, use -o orig-score command line option.
ADDED:
* -C <number> command line option. This tells SpamProbe to assign a default,
somewhat neutral, probability to any term that does not have a weighted
(good count doubled) count of at least specified number in the database.
This prevents terms which have been seen only a few times from having
an unreasonable influence on the score of an email containing them.
Default count have changed. It is now 5. Old was 3.
* Added -o <option_name> command line option to specify alternate way of
scoring. Consult README.txt for more info.
* Added -l <number> command line option. Changes the spam probability
threshold for emails from the default (0.7) to <number>.
* Added tokenize command. Prints the tokens found in the file one word
per line in human readable format with spam probability, good count,
spam count, message count, and word in columns separated by whitespace.
IMPROVED:
* -H command line option to add more headers to scan.
* Improved performance by removing some redundant calculations and
reducing the amount of I/O in train-* mode.
Spamprobe is a fast, intelligent, automatic spam detector using Bayesian
analysis of terms contained in emails. Works with procmail, maildrop or a
similar tool to produce a complete server or client side spam filtering
system.
Provided by Daniel Farrugia in PR#20286, buildlinkified by me.
