[gentoo-server] Tracking bandwidth usage

[gentoo-server] Tracking bandwidth usage

[A. Khattri]

I have a web server with 100 IP aliases on it.

I want to be able to track bandwidth usage on each IP.
(Maybe MRTG graphs?)

Anyone come up with an elegant solution?


-- 

-- 
gentoo-server@gentoo.org mailing list

Re: [gentoo-server] Tracking bandwidth usage

[Arturo 'Buanzo' Busleiman]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

A. Khattri wrote:
> I want to be able to track bandwidth usage on each IP.
> (Maybe MRTG graphs?)
> Anyone come up with an elegant solution?

ntop not working? I believe there are some graph modules available for ntop

- --
Arturo "Buanzo" Busleiman - www.buanzo.com.ar
Consultor en Seguridad Informatica
President, Open Information System Security Group - Argentina
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.1 (GNU/Linux)
Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org

iD8DBQFC6VykAlpOsGhXcE0RAuasAJ4kkgRglJNMkkkJ0DrY4cC0jXBXzgCfUyRf
fRidEH7ge3X3CtXnkkri/6g=
=FlpY
-----END PGP SIGNATURE-----
-- 
gentoo-server@gentoo.org mailing list

Re: [gentoo-server] Tracking bandwidth usage

[kashani]

A. Khattri wrote:
> I have a web server with 100 IP aliases on it.
> 
> I want to be able to track bandwidth usage on each IP.
> (Maybe MRTG graphs?)
> 
> Anyone come up with an elegant solution?

Anything snmp based, MRTG, Cacti, isn't going to work unless things have 
changed significantly since I last toyed with it. The IP aliases don't 
show up as real interfaces so you can't grab stats.

kashani
-- 
gentoo-server@gentoo.org mailing list

Re: [gentoo-server] Tracking bandwidth usage

[Wendall Cada]

On Thu, 2005-07-28 at 17:38 -0500, kashani wrote:
A. Khattri wrote:
> I have a web server with 100 IP aliases on it.
> 
> I want to be able to track bandwidth usage on each IP.
> (Maybe MRTG graphs?)
> 
> Anyone come up with an elegant solution?

ntop works well. Graphing is a part of it's built in functionality. I
have been using it on my primary router for over a year without issues.

net-analyzer/ntop
http://www.ntop.org/ntop.html

HTH

Wendall

-- 
gentoo-server@gentoo.org mailing list

Re: [gentoo-server] Tracking bandwidth usage

[A. Khattri]

On Thu, 28 Jul 2005, Wendall Cada wrote:

> On Thu, 2005-07-28 at 17:38 -0500, kashani wrote:
> A. Khattri wrote:
> > I have a web server with 100 IP aliases on it.
> >
> > I want to be able to track bandwidth usage on each IP.
> > (Maybe MRTG graphs?)
> >
> > Anyone come up with an elegant solution?
>
> ntop works well. Graphing is a part of it's built in functionality. I
> have been using it on my primary router for over a year without issues.

The only problem being that last time I looked at ntop is does take away a
chunk of CPU time from your server (unless you have it on a separate box).


-- 

-- 
gentoo-server@gentoo.org mailing list

RE: [gentoo-server] Tracking bandwidth usage

[Joe Rizzo]

I believe you could accomplish what you want with iptables.  IE Match
the IP address with an iptables rule.  The rule has counters for the
packets and bytes.

I believe there are tools / projects that provide iptables accounting.

Hope that helps.

Joe 

-----Original Message-----
From: A. Khattri [mailto:ajai@bway.net] 
Sent: Thursday, July 28, 2005 9:10 PM
To: gentoo-server@lists.gentoo.org
Subject: Re: [gentoo-server] Tracking bandwidth usage

On Thu, 28 Jul 2005, Wendall Cada wrote:

> On Thu, 2005-07-28 at 17:38 -0500, kashani wrote:
> A. Khattri wrote:
> > I have a web server with 100 IP aliases on it.
> >
> > I want to be able to track bandwidth usage on each IP.
> > (Maybe MRTG graphs?)
> >
> > Anyone come up with an elegant solution?
>
> ntop works well. Graphing is a part of it's built in functionality. I
> have been using it on my primary router for over a year without
issues.

The only problem being that last time I looked at ntop is does take away
a
chunk of CPU time from your server (unless you have it on a separate
box).


-- 

-- 
gentoo-server@gentoo.org mailing list


-- 
gentoo-server@gentoo.org mailing list

RE: [gentoo-server] Tracking bandwidth usage

[A. Khattri]

On Fri, 29 Jul 2005, Joe Rizzo wrote:

> I believe you could accomplish what you want with iptables.  IE Match
> the IP address with an iptables rule.  The rule has counters for the
> packets and bytes.

Yes that was the other route I was looking at.

I will have to hack a script that grabs all the IP aliases and then
creates a chain with a rule for each IP. (I was hoping someone had done
this already :-) BTW, would those counters be accessible through SNMP
then? (Would be nice to use cacti to graph it).

> I believe there are tools / projects that provide iptables accounting.
>
> Hope that helps.
>
> Joe
>
> -----Original Message-----
> From: A. Khattri [mailto:ajai@bway.net]
> Sent: Thursday, July 28, 2005 9:10 PM
> To: gentoo-server@lists.gentoo.org
> Subject: Re: [gentoo-server] Tracking bandwidth usage
>
> On Thu, 28 Jul 2005, Wendall Cada wrote:
>
> > On Thu, 2005-07-28 at 17:38 -0500, kashani wrote:
> > A. Khattri wrote:
> > > I have a web server with 100 IP aliases on it.
> > >
> > > I want to be able to track bandwidth usage on each IP.
> > > (Maybe MRTG graphs?)
> > >
> > > Anyone come up with an elegant solution?
> >
> > ntop works well. Graphing is a part of it's built in functionality. I
> > have been using it on my primary router for over a year without
> issues.
>
> The only problem being that last time I looked at ntop is does take away
> a
> chunk of CPU time from your server (unless you have it on a separate
> box).
>
>
>

-- 
smoke and mirrors n.

 Marketing deceptions.  The term is
   mainstream in this general sense.  Among hackers it's strongly
   associated with bogus demos and crocked benchmarks (see also
   MIPS, machoflops).  "They claim their new box cranks 50
   MIPS for under $5000, but didn't specify the instruction mix --
   sounds like smoke and mirrors to me."  The phrase, popularized by
   newspaper columnist Jimmy Breslin c.1975, has been said to
   derive from carnie slang for magic acts and `freak show' displays
   that depend on `trompe l'oeil' effects, but also calls to mind
   the fierce Aztec god Tezcatlipoca (lit. "Smoking Mirror") for
   whom the hearts of huge numbers of human sacrificial victims were
   regularly cut out.  Upon hearing about a rigged demo or yet another
   round of fantasy-based marketing promises, hackers often feel
   analogously disheartened.  See also stealth manager.

-- 
gentoo-server@gentoo.org mailing list

Re: [gentoo-server] Tracking bandwidth usage

[Jonathan Nichols]

A. Khattri wrote:
> I have a web server with 100 IP aliases on it.
> 
> I want to be able to track bandwidth usage on each IP.
> (Maybe MRTG graphs?)
> 
> Anyone come up with an elegant solution?
> 
> 

Wait a second.. are you just trying to monitor the bandwidth each 
*website* uses?

I think mod_watch will do that. I never got it to work, but others have. :)


-- 
gentoo-server@gentoo.org mailing list

Re: [gentoo-server] Tracking bandwidth usage

[A. Khattri]

On Fri, 29 Jul 2005, Jonathan Nichols wrote:

> Wait a second.. are you just trying to monitor the bandwidth each
> *website* uses?

Yes (each site has its own IP alias) - ideally would like to graph each
IP's incoming and outgoing port 80 (and maybe 143) traffic and store
historical data like RRD.

> I think mod_watch will do that. I never got it to work, but others have. :)

Ill have a look...


Thanks,
-- 

-- 
gentoo-server@gentoo.org mailing list

Re: [gentoo-server] Tracking bandwidth usage

[Arturo 'Buanzo' Busleiman]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

A. Khattri wrote:
> On Fri, 29 Jul 2005, Jonathan Nichols wrote:
> 
> 
>>Wait a second.. are you just trying to monitor the bandwidth each
>>*website* uses?
> 
> 
> Yes (each site has its own IP alias) - ideally would like to graph each
> IP's incoming and outgoing port 80 (and maybe 143) traffic and store
> historical data like RRD.

What about webalizer?

check out my stats at http://stats.buanzo.com.ar - you can have that for each of your virtual hosts,
as long as you have apache log :P

- --
Arturo "Buanzo" Busleiman - www.buanzo.com.ar
Consultor en Seguridad Informatica
President, Open Information System Security Group - Argentina
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.1 (GNU/Linux)
Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org

iD8DBQFC6oO9AlpOsGhXcE0RAvxuAJ9MHrwuJAPpfkqqQ8mtmL/aFWjK8ACdGTvJ
oX5nQvvvMOcWQ4J8NjCvUDE=
=S0md
-----END PGP SIGNATURE-----
-- 
gentoo-server@gentoo.org mailing list

Re: [gentoo-server] Tracking bandwidth usage

[A. Khattri]

On Fri, 29 Jul 2005, Arturo 'Buanzo' Busleiman wrote:

> What about webalizer?
>
> check out my stats at http://stats.buanzo.com.ar - you can have that for each of your virtual hosts,
> as long as you have apache log :P

We're using analog + reportmagic to generate weekly reports for each site
- I wrote some custom scripts to manage logs, do DNS resolving and to
generate the reports. (Each site has separate access logs). Mainly these
"pretty" reports are for the customers to look at ;-)

On our side, we would like to look at bandwidth usage of each site over a
period of time to determine which ones are heavy with traffic and to look
at the long-term trends. Eventually, it would be nice to manage bandwidth
and track total usage for billing purposes.


-- 


-- 
gentoo-server@gentoo.org mailing list

RE: [gentoo-server] Tracking bandwidth usage

[Christopher Schwerdt]

> Yes (each site has its own IP alias) - ideally would like to 
> graph each
> IP's incoming and outgoing port 80 (and maybe 143) traffic and store
> historical data like RRD.

Check out mod_throttle also.  It will save total traffic used.  You can
then write an app to parse the report and submit those stats to a
graphing application.  Mod_throttle also lets you enforce policy so that
once someone has gone over their bandwidth usage their vhost will return
an error (for example, ThrottlePolicy Volume 20G 5w).  Note,
mod_throttle only works on Apache 1.x.

-- 
gentoo-server@gentoo.org mailing list

Re: [gentoo-server] Tracking bandwidth usage

[Andreas Prieß]

[-- Attachment #1: Type: text/plain, Size: 1051 bytes --]

A. Khattri wrote:
> On our side, we would like to look at bandwidth usage of each site over a
> period of time to determine which ones are heavy with traffic and to look
> at the long-term trends. Eventually, it would be nice to manage bandwidth
> and track total usage for billing purposes.

When it comes to network accounting the following may be of interest -
there was a presentation at the linuxtag open source conference:

http://www.linuxtag.org/typo3site/freecongress-details.html?&talkid=131

Network accounting was demonstrated based on the ip_conntrack module in
the kernel. Some new enhancements of ip_conntrack solve some problems
you have with accounting in userspace with single ip_tables rules for
each IP-Address or similar userspace solutions. You don't have the
overhead of transfering huge amounts of data to userspace or getting
endless rulesets as you have with previous approaches.

Sorry, I did not use it myself and I don't know a link to further
information, but searching for ip_conntrack may give some hints.

-- 
Andreas

[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 256 bytes --]

RE: [gentoo-server] Tracking bandwidth usage

[A. Khattri]

On Fri, 29 Jul 2005, Christopher Schwerdt wrote:

> Check out mod_throttle also.  It will save total traffic used.  You can
> then write an app to parse the report and submit those stats to a
> graphing application.  Mod_throttle also lets you enforce policy so that
> once someone has gone over their bandwidth usage their vhost will return
> an error (for example, ThrottlePolicy Volume 20G 5w).  Note,
> mod_throttle only works on Apache 1.x.

This sounds promising, it just so happens I am using Apache 1.x and have
mod_throttle installed...


-- 

-- 
gentoo-server@gentoo.org mailing list