[gentoo-user] monitoring system resource usage

[gentoo-user] monitoring system resource usage

[Grant]

Can anyone recommend a method for monitoring system resource usage in
a way that would allow me to correlate a rise in my web server's
response time with the usage of a particular system resource if such a
correlation exists?  I don't need it to be 100% accurate, just
accurate enough to be able to make the correlation with a reasonable
degree of certainty.

- Grant

[gentoo-user] Re: monitoring system resource usage

[walt]

On 06/14/2013 12:56 AM, Grant wrote:
> Can anyone recommend a method for monitoring system resource usage in
> a way that would allow me to correlate a rise in my web server's
> response time with the usage of a particular system resource if such a
> correlation exists?  I don't need it to be 100% accurate, just
> accurate enough to be able to make the correlation with a reasonable
> degree of certainty.

Is the server local or remote, and can you use gui-based tools that need
an X session to be running?

Re: [gentoo-user] Re: monitoring system resource usage

[Grant]

>> Can anyone recommend a method for monitoring system resource usage in
>> a way that would allow me to correlate a rise in my web server's
>> response time with the usage of a particular system resource if such a
>> correlation exists?  I don't need it to be 100% accurate, just
>> accurate enough to be able to make the correlation with a reasonable
>> degree of certainty.
>
> Is the server local or remote, and can you use gui-based tools that need
> an X session to be running?

The system is remote and does not have X installed.

- Grant

Re: [gentoo-user] monitoring system resource usage

[Michael Hampicke]

Am 2013-06-14 09:56, schrieb Grant:
> Can anyone recommend a method for monitoring system resource usage in
> a way that would allow me to correlate a rise in my web server's
> response time with the usage of a particular system resource if such a
> correlation exists?  I don't need it to be 100% accurate, just
> accurate enough to be able to make the correlation with a reasonable
> degree of certainty.
> 
> - Grant

http://munin-monitoring.org/

;-)

Re: [gentoo-user] monitoring system resource usage

[Grant]

>> Can anyone recommend a method for monitoring system resource usage in
>> a way that would allow me to correlate a rise in my web server's
>> response time with the usage of a particular system resource if such a
>> correlation exists?  I don't need it to be 100% accurate, just
>> accurate enough to be able to make the correlation with a reasonable
>> degree of certainty.
>>
>> - Grant
>
>
> http://munin-monitoring.org/

Looks very cool indeed!  I am reading more about it now.  Do you find
it easy to set up and maintain?

- Grant

Re: [gentoo-user] monitoring system resource usage

[Michael Hampicke]

[-- Attachment #1: Type: text/plain, Size: 924 bytes --]

Am 15.06.2013 17:04, schrieb Grant:
>>> Can anyone recommend a method for monitoring system resource usage in
>>> a way that would allow me to correlate a rise in my web server's
>>> response time with the usage of a particular system resource if such a
>>> correlation exists?  I don't need it to be 100% accurate, just
>>> accurate enough to be able to make the correlation with a reasonable
>>> degree of certainty.
>>>
>>> - Grant
>>
>>
>> http://munin-monitoring.org/
> 
> Looks very cool indeed!  I am reading more about it now.  Do you find
> it easy to set up and maintain?
> 
> - Grant
> 

In my opinion it's very easy to setup. Basically you just merge it,
enable your plugins (via symlink), add munin-node to the runlevel and
make sure the munin cron job is enabled. Then just browse to
http://localhost/munin

There's also a entry on the gentoo wiki: http://wiki.gentoo.org/wiki/Munin


[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 490 bytes --]

Re: [gentoo-user] monitoring system resource usage

[Grant]

>>>> Can anyone recommend a method for monitoring system resource usage in
>>>> a way that would allow me to correlate a rise in my web server's
>>>> response time with the usage of a particular system resource if such a
>>>> correlation exists?  I don't need it to be 100% accurate, just
>>>> accurate enough to be able to make the correlation with a reasonable
>>>> degree of certainty.
>>>>
>>>> - Grant
>>>
>>>
>>> http://munin-monitoring.org/
>>
>> Looks very cool indeed!  I am reading more about it now.  Do you find
>> it easy to set up and maintain?
>>
>> - Grant
>>
>
> In my opinion it's very easy to setup. Basically you just merge it,
> enable your plugins (via symlink), add munin-node to the runlevel and
> make sure the munin cron job is enabled. Then just browse to
> http://localhost/munin
>
> There's also a entry on the gentoo wiki: http://wiki.gentoo.org/wiki/Munin

Agreed!  Although getting apache, mysql, and nginx plugins fully
working is proving to be a little trickier.  To get those going it's
necessary to edit /etc/munin/plugin-conf.d/munin-node as well as some
apache and nginx config.  Still working on getting it all 100%.

- Grant

Re: [gentoo-user] monitoring system resource usage

[Dale]

Grant wrote:
> Agreed! Although getting apache, mysql, and nginx plugins fully
> working is proving to be a little trickier. To get those going it's
> necessary to edit /etc/munin/plugin-conf.d/munin-node as well as some
> apache and nginx config. Still working on getting it all 100%. - Grant 

If you have a fairly basic setup, post what you are using to help others
later on.  At least it could give someone a config to go by. 

Dale

:-)  :-) 

-- 
I am only responsible for what I said ... Not for what you understood or how you interpreted my words!

Re: [gentoo-user] monitoring system resource usage

[Grant]

>> Agreed! Although getting apache, mysql, and nginx plugins fully
>> working is proving to be a little trickier. To get those going it's
>> necessary to edit /etc/munin/plugin-conf.d/munin-node as well as some
>> apache and nginx config. Still working on getting it all 100%. - Grant
>
> If you have a fairly basic setup, post what you are using to help others
> later on.  At least it could give someone a config to go by.

I promise I will do this once I feel good about my config.

- Grant

Re: [gentoo-user] monitoring system resource usage

[Dale]

Grant wrote:
>>> Agreed! Although getting apache, mysql, and nginx plugins fully
>>> working is proving to be a little trickier. To get those going it's
>>> necessary to edit /etc/munin/plugin-conf.d/munin-node as well as some
>>> apache and nginx config. Still working on getting it all 100%. - Grant
>> If you have a fairly basic setup, post what you are using to help others
>> later on.  At least it could give someone a config to go by.
> I promise I will do this once I feel good about my config.
>
> - Grant
>
>

That's good.  Sometimes when I am setting up something, I google for the
config file to see if I can find something to go by at least.  I did
that the other day with my xorg.conf file.  I found out that when I
logout and leave, my monitor never goes to standby.  I found a config
file that someone posted that had the info I needed.  It was MUCH faster
than trying to read man pages and find it. 

I thought about setting up a site or something and putting different
config files there and allowing others to post theirs.  Thing is, I'm
sort of low income and I don't know how much that would end up costing
me.  I'd do it for free so I'd pay for whatever it was.  I think a
central place for this sort of thing would be great. 

Anyway, it may help the next person if you post what works for you and
maybe how you are using it.  At least give someone a start.  If they
google, they will find it. 

Dale

:-)

-- 
I am only responsible for what I said ... Not for what you understood or how you interpreted my words!

Re: [gentoo-user] monitoring system resource usage

[Grant]

>>>> Agreed! Although getting apache, mysql, and nginx plugins fully
>>>> working is proving to be a little trickier. To get those going it's
>>>> necessary to edit /etc/munin/plugin-conf.d/munin-node as well as some
>>>> apache and nginx config. Still working on getting it all 100%. - Grant
>>> If you have a fairly basic setup, post what you are using to help others
>>> later on.  At least it could give someone a config to go by.
>> I promise I will do this once I feel good about my config.
>>
>> - Grant
>
> That's good.  Sometimes when I am setting up something, I google for the
> config file to see if I can find something to go by at least.  I did
> that the other day with my xorg.conf file.  I found out that when I
> logout and leave, my monitor never goes to standby.  I found a config
> file that someone posted that had the info I needed.  It was MUCH faster
> than trying to read man pages and find it.
>
> I thought about setting up a site or something and putting different
> config files there and allowing others to post theirs.  Thing is, I'm
> sort of low income and I don't know how much that would end up costing
> me.  I'd do it for free so I'd pay for whatever it was.  I think a
> central place for this sort of thing would be great.
>
> Anyway, it may help the next person if you post what works for you and
> maybe how you are using it.  At least give someone a start.  If they
> google, they will find it.

I used this as a base which is excellent:

http://wiki.gentoo.org/wiki/Munin

Extra config is required if you want to get other plugins working like
apache, mysql, and nginx  The extra config takes place in
/etc/munin/plugin-conf.d/munin-node and in whatever program you are
configuring the plugin for.  This setup assumes the master and node
are on the same machine.

apache:

/etc/munin/plugin-conf.d/munin-node:
[apache_*]
env.ports 80
env.url http://127.0.0.1:80/server-status?auto

/etc/conf.d/apache2:
add "-D STATUS" to APACHE2_OPTS (apache must be compiled with
APACHE2_MODULES="status")

mysql:

/etc/munin/plugin-conf.d/munin-node:
[mysql*]
env.mysqlopts -u root --password=PASSWORDHERE
(I'm still having a problem with the myisam and InnoDB graphs.)

nginx:

This should work but it doesn't for me yet:
http://www.nginxtips.com/nginx-configuration-for-munin/

It's a good idea to change the following for security as long as the
master and node are on the same machine:

#host *
host 127.0.0.1

It's handy to use 'munin-run PLUGIN_NAME' to test a plugin.

- Grant

Re: [gentoo-user] monitoring system resource usage

[Grant]

>>>> Can anyone recommend a method for monitoring system resource usage in
>>>> a way that would allow me to correlate a rise in my web server's
>>>> response time with the usage of a particular system resource if such a
>>>> correlation exists?  I don't need it to be 100% accurate, just
>>>> accurate enough to be able to make the correlation with a reasonable
>>>> degree of certainty.
>>>
>>> http://munin-monitoring.org/
>>
>> Looks very cool indeed!  I am reading more about it now.  Do you find
>> it easy to set up and maintain?
>
> In my opinion it's very easy to setup. Basically you just merge it,
> enable your plugins (via symlink), add munin-node to the runlevel and
> make sure the munin cron job is enabled. Then just browse to
> http://localhost/munin
>
> There's also a entry on the gentoo wiki: http://wiki.gentoo.org/wiki/Munin

Do you have CGI graphs working?  I can generate CGI HTML and I can CGI
zoom on graphs but I can't get munin to generate CGI graphs instead of
generating them statically.  I'm not sure Gentoo's
/etc/apache2/vhosts.d/munin.include is right since it doesn't
reference /munin-cgi/munin-cgi-html/ at all.

- Grant

Re: [gentoo-user] monitoring system resource usage

[Mick]

[-- Attachment #1: Type: Text/Plain, Size: 1490 bytes --]

On Tuesday 18 Jun 2013 13:55:41 Grant wrote:
> >>>> Can anyone recommend a method for monitoring system resource usage in
> >>>> a way that would allow me to correlate a rise in my web server's
> >>>> response time with the usage of a particular system resource if such a
> >>>> correlation exists?  I don't need it to be 100% accurate, just
> >>>> accurate enough to be able to make the correlation with a reasonable
> >>>> degree of certainty.
> >>> 
> >>> http://munin-monitoring.org/
> >> 
> >> Looks very cool indeed!  I am reading more about it now.  Do you find
> >> it easy to set up and maintain?
> > 
> > In my opinion it's very easy to setup. Basically you just merge it,
> > enable your plugins (via symlink), add munin-node to the runlevel and
> > make sure the munin cron job is enabled. Then just browse to
> > http://localhost/munin
> > 
> > There's also a entry on the gentoo wiki:
> > http://wiki.gentoo.org/wiki/Munin
> 
> Do you have CGI graphs working?  I can generate CGI HTML and I can CGI
> zoom on graphs but I can't get munin to generate CGI graphs instead of
> generating them statically.  I'm not sure Gentoo's
> /etc/apache2/vhosts.d/munin.include is right since it doesn't
> reference /munin-cgi/munin-cgi-html/ at all.

I haven't tried munin, but in case it helps, you'd want to set user or group 
to be readable/executable by apache to dynamically be running the cgi scripts 
when you visit the web page.

-- 
Regards,
Mick

[-- Attachment #2: This is a digitally signed message part. --]
[-- Type: application/pgp-signature, Size: 490 bytes --]

Re: [gentoo-user] monitoring system resource usage

[Grant]

>> >>>> Can anyone recommend a method for monitoring system resource usage in
>> >>>> a way that would allow me to correlate a rise in my web server's
>> >>>> response time with the usage of a particular system resource if such a
>> >>>> correlation exists?  I don't need it to be 100% accurate, just
>> >>>> accurate enough to be able to make the correlation with a reasonable
>> >>>> degree of certainty.
>> >>>
>> >>> http://munin-monitoring.org/
>> >>
>> >> Looks very cool indeed!  I am reading more about it now.  Do you find
>> >> it easy to set up and maintain?
>> >
>> > In my opinion it's very easy to setup. Basically you just merge it,
>> > enable your plugins (via symlink), add munin-node to the runlevel and
>> > make sure the munin cron job is enabled. Then just browse to
>> > http://localhost/munin
>> >
>> > There's also a entry on the gentoo wiki:
>> > http://wiki.gentoo.org/wiki/Munin
>>
>> Do you have CGI graphs working?  I can generate CGI HTML and I can CGI
>> zoom on graphs but I can't get munin to generate CGI graphs instead of
>> generating them statically.  I'm not sure Gentoo's
>> /etc/apache2/vhosts.d/munin.include is right since it doesn't
>> reference /munin-cgi/munin-cgi-html/ at all.
>
> I haven't tried munin, but in case it helps, you'd want to set user or group
> to be readable/executable by apache to dynamically be running the cgi scripts
> when you visit the web page.

The thing is, there are 3 CGI components.  There is HTML generation,
graph zooming, and graph generation.  The first two work for me so CGI
must be working.  I think there is a problem with the Gentoo's
munin.include for apache since it doesn't reference
/munin-cgi/munin-cgi-graph/.  I've filed a bug:

https://bugs.gentoo.org/show_bug.cgi?id=473698

Actually, I think I just fixed it and I've updated the bug.  It's a
Gentoo issue.

- Grant