From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from pigeon.gentoo.org ([208.92.234.80] helo=lists.gentoo.org) by finch.gentoo.org with esmtp (Exim 4.60) (envelope-from ) id 1RIsO4-0004cK-Nk for garchives@archives.gentoo.org; Wed, 26 Oct 2011 01:34:36 +0000 Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id BF97321C0C9; Wed, 26 Oct 2011 01:34:27 +0000 (UTC) Received: from svr-us4.tirtonadi.com (svr-us4.tirtonadi.com [69.65.43.212]) by pigeon.gentoo.org (Postfix) with ESMTP id D3B9C21C0E4 for ; Wed, 26 Oct 2011 01:33:34 +0000 (UTC) Received: from mail-fx0-f53.google.com ([209.85.161.53]) by svr-us4.tirtonadi.com with esmtpsa (TLSv1:RC4-SHA:128) (Exim 4.69) (envelope-from ) id 1RIsN4-003G7M-EN for gentoo-user@lists.gentoo.org; Wed, 26 Oct 2011 08:33:34 +0700 Received: by faai28 with SMTP id i28so1364183faa.40 for ; Tue, 25 Oct 2011 18:33:30 -0700 (PDT) Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-user@lists.gentoo.org Reply-to: gentoo-user@lists.gentoo.org MIME-Version: 1.0 Received: by 10.223.15.13 with SMTP id i13mr18795819faa.36.1319592810906; Tue, 25 Oct 2011 18:33:30 -0700 (PDT) Received: by 10.223.70.133 with HTTP; Tue, 25 Oct 2011 18:33:30 -0700 (PDT) Received: by 10.223.70.133 with HTTP; Tue, 25 Oct 2011 18:33:30 -0700 (PDT) In-Reply-To: References: Date: Wed, 26 Oct 2011 08:33:30 +0700 Message-ID: Subject: Re: [gentoo-user] Re: How to record memory usage & bandwidth usage? From: Pandu Poluan To: gentoo-user@lists.gentoo.org Content-Type: multipart/alternative; boundary=001517479538be079f04b029a4e6 X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - svr-us4.tirtonadi.com X-AntiAbuse: Original Domain - lists.gentoo.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - poluan.info X-Archives-Salt: X-Archives-Hash: 9800c7ad134d13eb33c1cc35529c31f8 --001517479538be079f04b029a4e6 Content-Type: text/plain; charset=UTF-8 (My age surely is catching up with me, I forgot to include the URL for dstat) [1] http://dag.wieers.com/home-made/dstat/ Rgds, On Oct 26, 2011 8:27 AM, "Pandu Poluan" wrote: > (Sorry for the late reply; somehow this thread got lost in the mess) > > On Oct 12, 2011 2:03 AM, "James" wrote: > > > > Pandu Poluan poluan.info> writes: > > > > > > > The head honcho of my company just asked me to "plan for migration of > > > X into the cloud" (where "X" is the online trading server that our > > > investors used). > > > > This is a single server or many at different locations. > > If a WAN monitoring is what you are after, along with individual > > server resources, you have many choices. > > > > It's a single server that's part of a three-server system. The server needs > to communicate with its 2 cohorts continuously, so I have to provision > enough backhaul bandwidth from the cloud to my data center. > > In addition to provisioning enough RAM and CPU, of course. > > > > Now, I need to monitor how much RAM is used throughout the day by X, > > > also how much bandwidth gets eaten by X throughout the day. > > > > Most of the packages monitor ram as well as other resource utilization > > of the servers, firewall, routers and other SNMP devices in your network. > > some experimentation may be warranted to find what your team likes best. > > > > Currently I've settled on a simple solution: run dstat[1] with nohup 30 > minutes before 1st trading session, stop it 30 minutes after 2nd trading > session, and send the CSV record via email. Less intrusion into the system > (which the Systems guys rightly have reservations of). > > > > What tools do you recommend? > > > > OH boy. I like JFFNMS very very much. It has a very old version in > portage > > (masked) but a very new version out there for Debian and Ubuntu. It > > runs on all nix, if you want to driectly compile and install. > > > > I'll be putting together a new ebuild, as soon as I get it working > > with the latest postgresql. Mysql works out of the box. Postgresql-9 > > has many new and very cool features. > > > > Cool! I *love* Postgresql! Update me when the ebuild's done? > > > > Remember: The data will be used for 'post-mortem' analysis, so I don't > > > need any fancy schmancy presentation. Just raw data, taken every N > > > seconds. > > > > Personally, I have some large, high risk design work going on. JFFNMS > > and pg9 are the best choices from my research. A whiz like yourself > > could easily look at the old JFFNMS ebuild and create a new one. > > Naaah, I'm going to wait for your ebuild. I'm sometimes lazy, you know ;-) > > > PG-9 (please no flame wars on mysql vs pg9) is very cool and what > > my work is migrating too, once I get some breathing room. > > > > Craig at jffnms.org is very cool and responsive. He also works closely > > with those that submit patches. Nagios is a large, disorder array that > > had many devs fork off since the project leader (was/is an a_ole) > > is quite difficult to work with. > > > > That sounds really cool. I've been hesitant to go the Nagios route because > of the mess. I'll sure to be checking out JFFNMS. > > > JFFNMS rules and is very cool for managing cisco and other routers, > > not to mention a myriad of snmp(1,2.3) devices and all types > > of servers. The original guy, Javier, was snapped up by someone > > worth billions, to manage and extend his financial network, but, Craig > > is probably stronger coder, and extraordinarily nice human being. > > It's mostly php. Lots of folks extend JFFNMS, Craig keeps it clean > > and well written and documented code. > > > > http://www.jffnms.org/ > > > > hth, > > James > > > > Thanks for the heads-up! Although the original problem is solved already > (granted, in a somewhat kludgy way), your post is a great write-opener! Much > appreciated :-) > > Rgds, > --001517479538be079f04b029a4e6 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable

(My age surely is catching up with me, I forgot to include the URL for d= stat)

[1] http://dag.wieers= .com/home-made/dstat/

Rgds,

On Oct 26, 2011 8:27 AM, "Pandu Poluan"= ; <pandu@poluan.info> wrote:=

(Sorry for the late reply; somehow this thread got lost in the mess)

On Oct 12, 2011 2:03 AM, "James" <wireless@tampabay.rr.com> wrote= :
>
> Pandu Poluan <pandu <at> poluan.info> writes:
>
>
> > The head honcho of my company just asked me to "plan for mig= ration of
> > X into the cloud" (where "X" is the online trading= server that our
> > investors used).
>
> This is a single server or many at different locations.
> If a WAN monitoring is what you are after, along with individual
> server resources, you have many choices.
>

It's a single server that's part of a three-server system. The s= erver needs to communicate with its 2 cohorts continuously, so I have to pr= ovision enough backhaul bandwidth from the cloud to my data center.

In addition to provisioning enough RAM and CPU, of course.

> > Now, I need to monitor how much RAM is used throughout the day= by X,
> > also how much bandwidth gets eaten by X throughout the day.
>
> Most of the packages monitor ram as well as other resource utilization=
> of the servers, firewall, routers and other SNMP devices in your netwo= rk.
> some experimentation may be warranted to find what your team likes bes= t.
>

Currently I've settled on a simple solution: run dstat[1] with nohup= 30 minutes before 1st trading session, stop it 30 minutes after 2nd tradin= g session, and send the CSV record via email. Less intrusion into the syste= m (which the Systems guys rightly have reservations of).

> > What tools do you recommend?
>
> OH boy. I like JFFNMS very very much. It has a very old version in por= tage
> (masked) but a very new version out there for Debian and Ubuntu. It > runs on all nix, if you want to driectly compile and install.
>
> I'll be putting together a new ebuild, as soon as I get it working=
> with the latest postgresql. Mysql works out of the box. Postgresql-9 > has many new and very cool features.
>

Cool! I *love* Postgresql! Update me when the ebuild's done?

> > Remember: The data will be used for 'post-mortem' anal= ysis, so I don't
> > need any fancy schmancy presentation. Just raw data, taken every = N
> > seconds.
>
> Personally, I have some large, high risk design work going on. JFFNMS<= br> > and pg9 are the best choices from my research. A whiz like yourself > could easily look at the old JFFNMS ebuild and create a new one.

Naaah, I'm going to wait for your ebuild. I'm sometimes lazy, yo= u know ;-)

> PG-9 (please no flame wars on mysql vs pg9) is very cool and what > my work is migrating too, once I get some breathing room.
>
> Craig at jffnms.org is very cool and responsive. He also works closely
> with those that submit patches. Nagios is a large, disorder array that=
> had many devs fork off since the project leader (was/is an a_ole)
> is quite difficult to work with.
>

That sounds really cool. I've been hesitant to go the Nagios route b= ecause of the mess. I'll sure to be checking out JFFNMS.

> JFFNMS rules and is very cool for managing cisco and other routers,=
> not to mention a myriad of snmp(1,2.3) devices and all types
> of servers. The original guy, Javier, was snapped =C2=A0up by someone<= br> > worth billions, to manage and extend his financial network, but, Craig=
> is probably stronger coder, and extraordinarily nice human being.
> It's mostly php. Lots of folks extend JFFNMS, Craig keeps it clean=
> and well written and documented code.
>
> http://www.jffnms= .org/
>
> hth,
> James
>

Thanks for the heads-up! Although the original problem is solved already= (granted, in a somewhat kludgy way), your post is a great write-opener! Mu= ch appreciated :-)

Rgds,

--001517479538be079f04b029a4e6--