[gentoo-server] Dspam Users, Stand Up Please

[gentoo-server] Dspam Users, Stand Up Please

[Ow Mun Heng]

Hi All,

	I just made a mail-server that does

Postfix->amavisd(clamav+Spamassassin+Dspam)->cyrus

Now, I'm wondering how to properly configure Dspam. Dspam seems to work
well enough but I"m having trouble with dspam not properly
tagging/recognising SPAM. SPAMassassin seems to do fine.

X-DSPAM-Result: Innocent
X-DSPAM-Confidence: 0.5219
X-DSPAM-Probability: 0.0000
X-DSPAM-Signature: 43377f38319151441717014
X-DSPAM-Factors: 27,
X-Virus-Scanned: amavisd-new at localhost
X-Spam-Status: Yes, hits=9.152 tagged_above=-99 required=6.31
tests=[MSGID_FROM_MTA_HEADER=0.036, NA_DOLLARS=2.078,
NIGERIAN_BODY1=2.48, NIGERIAN_BODY2=2.4, NIGERIAN_BODY3=1.395,
SUBJ_ALL_CAPS=0.763]
X-Spam-Level: *********
X-Spam-Flag: YES

There's a conflict of interest so to speak. 

BTW, anyone here has any tips for doing a solely DSPAM filter that does
not integrate into amavisd-new? I'm trying to see if it will do better
in this case. 

Frankly, I'm attracted to dspam mainly for it's web-based cgi where
users can flag/unflag spam and do quarantine. (Power to the user!)






-- 
Ow Mun Heng
Gentoo/Linux on DELL D600 1.4Ghz 1.5GB RAM
98% Microsoft(tm) Free!! 
Neuromancer 16:19:44 up 1 day, 21:06, 5 users, load average: 1.39, 0.89,
0.62 


-- 
gentoo-server@gentoo.org mailing list

Re: [gentoo-server] Dspam Users, Stand Up Please

[theboywho]

Hi,

I use a postfix->dspam->cyrus setup for my mail server, which works pretty 
well. The way I have it set up is that postfix uses dspam as its 
'content_filter', and dspam reinjects mail into the postfix queue by using 
'sendmail' as the TrustedDevliveryAgent.

I have the following two extra lines in my master.cf for postfix:

dspam               unix       -       n       n       -       10      pipe
        flags=Ru user=dspam argv=/usr/bin/dspam --deliver=innocent --user 
${recipient} -f ${sender} -- ${recipient}

dspam-retrain   unix    -       n       n       -       10      pipe
        flags=Ru user=dspam argv=/usr/local/bin/dspam-retrain.sh ${nexthop} 
${sender} ${recipient}

and then my dspam.conf is as follows:

## $Id: dspam.conf.in,v 1.2 2004/11/12 16:29:19 jonz Exp $
## dspam.conf -- DSPAM configuration file
##

#
# DSPAM Home: Specifies the base directory to be used for DSPAM storage
#
Home /etc/mail/dspam

TrustedDeliveryAgent "/usr/sbin/sendmail"
UntrustedDeliveryAgent "/usr/sbin/sendmail"
OnFail error
Trust root
Trust dspam
Trust apache
Trust nobody

TrainingMode teft

Feature chained
Feature tb=4
Feature whitelist
Feature noise

Algorithm graham burton

PValue graham

Preference "spamAction=deliver"
Preference "signatureLocation=headers"	# 'message' or 'headers'
Preference "showFactors=on"
#Preference "spamAction=tag"
#Preference "spamSubject=SPAM"

AllowOverride trainingMode
# AllowOverride spamAction spamSubject
AllowOverride statisticalSedation
AllowOverride enableBNR
AllowOverride enableWhitelist
# AllowOverride signatureLocation
AllowOverride showFactors
AllowOverride optIn optOut
AllowOverride whitelistThreshold

Notifications	off

PurgeSignature	off # Specified in purge.sql
PurgeNeutral   30
PurgeUnused    off # Specified in purge.sql
PurgeHapaxes   off # Specified in purge.sql
PurgeHits1S    off # Specified in purge.sql
PurgeHits1I    off # Specified in purge.sql

LocalMX 127.0.0.1

SystemLog on
UserLog   on

Opt in

MySQLServer    /var/run/mysqld.sock
MySQLPort
MySQLUser      dspamuser
MySQLPass      *******
MySQLDb        dspamdb
MySQLCompress  true

I use 'Opt-in' because i do not want to process out-going email. 

Hope that helps!!


On Monday 26 Sep 2005 09:24, Ow Mun Heng wrote:
> Hi All,
>
> 	I just made a mail-server that does
>
> Postfix->amavisd(clamav+Spamassassin+Dspam)->cyrus
>
> Now, I'm wondering how to properly configure Dspam. Dspam seems to work
> well enough but I"m having trouble with dspam not properly
> tagging/recognising SPAM. SPAMassassin seems to do fine.
>
> X-DSPAM-Result: Innocent
> X-DSPAM-Confidence: 0.5219
> X-DSPAM-Probability: 0.0000
> X-DSPAM-Signature: 43377f38319151441717014
> X-DSPAM-Factors: 27,
> X-Virus-Scanned: amavisd-new at localhost
> X-Spam-Status: Yes, hits=9.152 tagged_above=-99 required=6.31
> tests=[MSGID_FROM_MTA_HEADER=0.036, NA_DOLLARS=2.078,
> NIGERIAN_BODY1=2.48, NIGERIAN_BODY2=2.4, NIGERIAN_BODY3=1.395,
> SUBJ_ALL_CAPS=0.763]
> X-Spam-Level: *********
> X-Spam-Flag: YES
>
> There's a conflict of interest so to speak.
>
> BTW, anyone here has any tips for doing a solely DSPAM filter that does
> not integrate into amavisd-new? I'm trying to see if it will do better
> in this case.
>
> Frankly, I'm attracted to dspam mainly for it's web-based cgi where
> users can flag/unflag spam and do quarantine. (Power to the user!)
>
>
>
>
>
>
> --
> Ow Mun Heng
> Gentoo/Linux on DELL D600 1.4Ghz 1.5GB RAM
> 98% Microsoft(tm) Free!!
> Neuromancer 16:19:44 up 1 day, 21:06, 5 users, load average: 1.39, 0.89,
> 0.62
-- 
gentoo-server@gentoo.org mailing list

Re: [gentoo-server] Dspam Users, Stand Up Please

[Ow Mun Heng]

On Mon, 2005-09-26 at 11:22 +0100, theboywho wrote:
> Hi,
> 
> I use a postfix->dspam->cyrus setup for my mail server, which works pretty 
> well. The way I have it set up is that postfix uses dspam as its 
> 'content_filter', and dspam reinjects mail into the postfix queue by using 
> 'sendmail' as the TrustedDevliveryAgent.


So you have both sendmail and postfix in the same server? Or is sendmail
just an alias to postfix?

> 
> I have the following two extra lines in my master.cf for postfix:
> 
> dspam               unix       -       n       n       -       10      pipe
>         flags=Ru user=dspam argv=/usr/bin/dspam --deliver=innocent --user 
> ${recipient} -f ${sender} -- ${recipient}
> 
> dspam-retrain   unix    -       n       n       -       10      pipe
>         flags=Ru user=dspam argv=/usr/local/bin/dspam-retrain.sh ${nexthop} 
> ${sender} ${recipient}


That's from the docs right? I'm doing it via amavisd, so it's a bit
different. I'll go this path once I figure out if this or the above is
better.

We'll see.

PS : what's dspam-retrain.sh? how do you pass it through?

-- 
Ow Mun Heng
Gentoo/Linux on DELL D600 1.4Ghz 1.5GB RAM
98% Microsoft(tm) Free!! 
Neuromancer 09:12:09 up 2 days, 13:58, 9 users, load average: 0.06,
0.21, 0.54 


-- 
gentoo-server@gentoo.org mailing list

Re: [gentoo-server] Dspam Users, Stand Up Please

[Kurt Lieber]

[-- Attachment #1: Type: text/plain, Size: 190 bytes --]

On Tue, Sep 27, 2005 at 09:13:53AM +0800 or thereabouts, Ow Mun Heng wrote:
> I'm doing it via amavisd

Mind posting some info about how you got it to work with amavisd and SA
both?

--kurt

[-- Attachment #2: Type: application/pgp-signature, Size: 189 bytes --]

Re: [gentoo-server] Dspam Users, Stand Up Please

[Ow Mun Heng]

On Tue, 2005-09-27 at 01:18 +0000, Kurt Lieber wrote:
> On Tue, Sep 27, 2005 at 09:13:53AM +0800 or thereabouts, Ow Mun Heng wrote:
> > I'm doing it via amavisd
> 
> Mind posting some info about how you got it to work with amavisd and SA
> both?

Not really :-)

it's actually integrated of sorts.

# grep dspam /etc/amavisd.conf 
$dspam  = 'dspam';

# /usr/sbin/amavisd debug 2>&1 | grep -i spam 
/usr/sbin/amavisd[26210]: Module Mail::SpamAssassin  3.000004
/usr/sbin/amavisd[26210]: ANTI-SPAM  code    loaded
/usr/sbin/amavisd[26210]: Found $dspam           at /usr/bin/dspam
/usr/sbin/amavisd[26210]: SpamControl: initializing Mail::SpamAssassin
/usr/sbin/amavisd[26210]: SpamControl: done

That's about it. 

It works hand in hand with SA actually, (it it finds dspam in its path)


-- 
Ow Mun Heng
Gentoo/Linux on DELL D600 1.4Ghz 1.5GB RAM
98% Microsoft(tm) Free!! 
Neuromancer 10:31:41 up 2 days, 15:18, 7 users, load average: 0.12,
0.16, 0.17 


-- 
gentoo-server@gentoo.org mailing list

Re: [gentoo-server] Dspam Users, Stand Up Please

[theboywho]

Is there a way to DSPAM work with amavisd, but *without* spamassassin?

The sendmail binary in my dspam config is part of the Postfix install.

The dspam-retrain.sh script is one I found on a dspam-wiki here:

http://dspamwiki.woozle.org/DspamRetrainScript

However, I couldn't get this version of it work so created a much more simpler 
one:

#!/bin/sh

PATH=/usr/local/bin:/usr/bin:/bin

# Get arguments
class="$1"; shift
user="$1"; shift

dspam --user $user --class=$class --source=error



HTH!!

--
theboywho
theboywho@ruddyperl.com
-- 
gentoo-server@gentoo.org mailing list

Re: [gentoo-server] Dspam Users, Stand Up Please

[Ow Mun Heng]

On Wed, 2005-09-28 at 14:15 +0100, theboywho wrote:
> Is there a way to DSPAM work with amavisd, but *without* spamassassin?

Not that I know of _yet_ :-)

> 
> The sendmail binary in my dspam config is part of the Postfix install.

Ah..

> #!/bin/sh
> 
> PATH=/usr/local/bin:/usr/bin:/bin
> 
> # Get arguments
> class="$1"; shift
> user="$1"; shift
> 
> dspam --user $user --class=$class --source=error

Hmm.. thanks, but for some reason, feeding it the entire message from
the cyrus mail spool doesn't work. I kept getting errors. In the end, I
choose to use the "--signature" instead.

So, what I did was essentially, retrain it sort of manually using

$ cat SPAM-Mail | grep -i dspam-signature | awk -F: '{print $2}'
> /tmp/dspam
$  for i in `cat /tmp/dspam`; do echo "Processing Signature $i"; dspam
--user amavis --source=error --class=spam --signature=$i ; done

That works




-- 
Ow Mun Heng
Gentoo/Linux on DELL D600 1.4Ghz 1.5GB RAM
98% Microsoft(tm) Free!! 
Neuromancer 10:50:21 up 4 days, 15:36, 7 users, load average: 0.22,
0.22, 0.34 


-- 
gentoo-server@gentoo.org mailing list

[gentoo-server] Re: Dspam Users, Stand Up Please

[Thomas Kirchner]

[-- Attachment #1: Type: text/plain, Size: 727 bytes --]

* On Sep 26 16:24, Ow Mun Heng (gentoo-server@lists.gentoo.org) wrote:
> Now, I'm wondering how to properly configure Dspam. Dspam seems to work
> well enough but I"m having trouble with dspam not properly
> tagging/recognising SPAM. SPAMassassin seems to do fine.

I was really excited about trying DSPAM, but I had the same result as 
you - it just couldn't tag spam.  I scoured the manuals and mailing 
lists, learned all about the configuration system, but DSPAM just 
couldn't be anywhere near as accurate as Spamassassin.  Spamassassin is a 
bit slower to run, but it just simply does a better job.  I, too, liked 
the CGI interface, but if it's an interface to a failing spam filter, 
what's the point?
Tom

[-- Attachment #2: Type: application/pgp-signature, Size: 189 bytes --]

Re: [gentoo-server] Re: Dspam Users, Stand Up Please

[Jose Gonzalez Gomez]

2005/9/26, Thomas Kirchner <lists@halffull.org>:
> * On Sep 26 16:24, Ow Mun Heng (gentoo-server@lists.gentoo.org) wrote:
> > Now, I'm wondering how to properly configure Dspam. Dspam seems to work
> > well enough but I"m having trouble with dspam not properly
> > tagging/recognising SPAM. SPAMassassin seems to do fine.
>
> I was really excited about trying DSPAM, but I had the same result as
> you - it just couldn't tag spam.  I scoured the manuals and mailing
> lists, learned all about the configuration system, but DSPAM just
> couldn't be anywhere near as accurate as Spamassassin.  Spamassassin is a
> bit slower to run, but it just simply does a better job.  I, too, liked
> the CGI interface, but if it's an interface to a failing spam filter,
> what's the point?

As far as I know about DSPAM (anybody correct me if I'm wrong), you
must train it in order to begin detecting spam. I have never
configured it, but I'm using it, and it provides two special addresses
per user: spam-user@yourdomain.com and fp-user@yourdomain.com.
Whenever you receive spam not detected by DSPAM you must forward it to
the first address. Whenever DSPAM incorrectly tags a mail as SPAM you
must forward it to the second address (false positive). The more you
train it, the more accurate it gets.

HTH, best regards
Jose

-- 
gentoo-server@gentoo.org mailing list

[gentoo-server] Re: Re: Dspam Users, Stand Up Please

[Thomas Kirchner]

[-- Attachment #1: Type: text/plain, Size: 814 bytes --]

* On Sep 26 14:57, Jose Gonzalez Gomez (gentoo-server@lists.gentoo.org) wrote:
> As far as I know about DSPAM (anybody correct me if I'm wrong), you
> must train it in order to begin detecting spam. I have never
> configured it, but I'm using it, and it provides two special addresses
> per user: spam-user@yourdomain.com and fp-user@yourdomain.com.
> Whenever you receive spam not detected by DSPAM you must forward it to
> the first address. Whenever DSPAM incorrectly tags a mail as SPAM you
> must forward it to the second address (false positive). The more you
> train it, the more accurate it gets.

I trained DSPAM for over 6 months.  It never gained accuracy past the 
first week, topping off at about 93%.  (And yes, I did check that it was 
still learning, picking up new tokens, etc.)
Tom

[-- Attachment #2: Type: application/pgp-signature, Size: 189 bytes --]

Re: [gentoo-server] Re: Dspam Users, Stand Up Please

[radu herinean]

I was also eager to try it but couldn't get it to work on my qmail-vpopmail 
configuration. if anyone has tips on installing it please do post a howto on 
the forums and point it out for me.


----- Original Message ----- 
From: "Jose Gonzalez Gomez" <jgonzalez.openinput@gmail.com>
To: <gentoo-server@lists.gentoo.org>
Sent: Monday, September 26, 2005 3:57 PM
Subject: Re: [gentoo-server] Re: Dspam Users, Stand Up Please


> 2005/9/26, Thomas Kirchner <lists@halffull.org>:
>> * On Sep 26 16:24, Ow Mun Heng (gentoo-server@lists.gentoo.org) wrote:
>> > Now, I'm wondering how to properly configure Dspam. Dspam seems to work
>> > well enough but I"m having trouble with dspam not properly
>> > tagging/recognising SPAM. SPAMassassin seems to do fine.
>>
>> I was really excited about trying DSPAM, but I had the same result as
>> you - it just couldn't tag spam.  I scoured the manuals and mailing
>> lists, learned all about the configuration system, but DSPAM just
>> couldn't be anywhere near as accurate as Spamassassin.  Spamassassin is a
>> bit slower to run, but it just simply does a better job.  I, too, liked
>> the CGI interface, but if it's an interface to a failing spam filter,
>> what's the point?
>
> As far as I know about DSPAM (anybody correct me if I'm wrong), you
> must train it in order to begin detecting spam. I have never
> configured it, but I'm using it, and it provides two special addresses
> per user: spam-user@yourdomain.com and fp-user@yourdomain.com.
> Whenever you receive spam not detected by DSPAM you must forward it to
> the first address. Whenever DSPAM incorrectly tags a mail as SPAM you
> must forward it to the second address (false positive). The more you
> train it, the more accurate it gets.
>
> HTH, best regards
> Jose
>
> -- 
> gentoo-server@gentoo.org mailing list
>
> 

-- 
gentoo-server@gentoo.org mailing list

Re: [gentoo-server] Re: Dspam Users, Stand Up Please

[Ow Mun Heng]

On Mon, 2005-09-26 at 08:49 -0400, Thomas Kirchner wrote:
> * On Sep 26 16:24, Ow Mun Heng (gentoo-server@lists.gentoo.org) wrote:
> > Now, I'm wondering how to properly configure Dspam. Dspam seems to work
> > well enough but I"m having trouble with dspam not properly
> > tagging/recognising SPAM. SPAMassassin seems to do fine.
> 
> I was really excited about trying DSPAM, but I had the same result as 
> you - it just couldn't tag spam.  

It's tagging it. but it's doesn't seem to be working :-)

>  I, too, liked 
> the CGI interface, but if it's an interface to a failing spam filter, 
> what's the point?

The point being to let users not have to send it to
fp-spam@yourdomain.com but to have them click on it on a web-page.
Simpler.


-- 
Ow Mun Heng
Gentoo/Linux on DELL D600 1.4Ghz 1.5GB RAM
98% Microsoft(tm) Free!! 
Neuromancer 09:11:46 up 2 days, 13:58, 9 users, load average: 0.09,
0.23, 0.56 


-- 
gentoo-server@gentoo.org mailing list