[gentoo-user] swap usage creeping up

[gentoo-user] swap usage creeping up

[Iain Buchanan]

Hi,

over the last week or so I've noticed unusually large swap usage.  I
usually hibernate this laptop and have uptimes up to 12 days so apps can
run for a long time.  I don't usually use any swap space (except for a
few k).

If I swapoff and swapon, the usage falls back to zero but then creeps up
again over a few days.

$ free -m
             total       used       free     shared    buffers     cached
Mem:          3040        859       2181          0         38        415
-/+ buffers/cache:        406       2634
Swap:          494        431         62

nothing unusual there, except for the swap usage itself.  'top' doesn't
show any large apps.  sorted by mem the top 4 are:
  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND            
 8318 iain      20   0  494m 150m  21m S    0  5.0   1:20.67 evolution          
20424 iain      20   0  342m  77m  30m S    0  2.5   0:01.84 firefox            
 8009 root      20   0 83364  37m 6260 S    7  1.2  38:34.31 X                  
 8090 iain      20   0  159m  32m 1600 S    1  1.1   3:48.08 skype              

Hm, I just noticed Mem is in %.  % of what?  % total or % used?  Even if
it was % of total RAM that could be as much as 152Mb for evo and 76Mb
for firefox.  Not that much really.

any ideas?

thanks :)
-- 
Iain Buchanan <iaindb at netspace dot net dot au>

Chuck Norris once skewered a man with the Eiffel tower. 

Re: [gentoo-user] swap usage creeping up

[Adam Carter]

[-- Attachment #1: Type: text/plain, Size: 856 bytes --]

> nothing unusual there, except for the swap usage itself.  'top' doesn't
> show any large apps.  sorted by mem the top 4 are:
>  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
>  8318 iain      20   0  494m 150m  21m S    0  5.0   1:20.67 evolution
> 20424 iain      20   0  342m  77m  30m S    0  2.5   0:01.84 firefox
>  8009 root      20   0 83364  37m 6260 S    7  1.2  38:34.31 X
>  8090 iain      20   0  159m  32m 1600 S    1  1.1   3:48.08 skype
>
> Hm, I just noticed Mem is in %.  % of what?  % total or % used?  Even if
> it was % of total RAM that could be as much as 152Mb for evo and 76Mb
> for firefox.  Not that much really.
>

Divide VIRT by its percentage, then divide RES by its percentage, when the
numbers match you know which one it is.

So it looks like its RES to me by just looking at it. Did you RTFMan page?

[-- Attachment #2: Type: text/html, Size: 1093 bytes --]

Re: [gentoo-user] swap usage creeping up

[Fatih Tümen]

On Tue, Oct 26, 2010 at 8:49 AM, Iain Buchanan <iaindb@netspace.net.au> wrote:
> Hi,
>
> over the last week or so I've noticed unusually large swap usage.  I
> usually hibernate this laptop and have uptimes up to 12 days so apps can
> run for a long time.  I don't usually use any swap space (except for a
> few k).
>
> If I swapoff and swapon, the usage falls back to zero but then creeps up
> again over a few days.
>
> $ free -m
>             total       used       free     shared    buffers     cached
> Mem:          3040        859       2181          0         38        415
> -/+ buffers/cache:        406       2634
> Swap:          494        431         62
>

Looking at above values 494MB does not seem to be enough for
hibernation. Do you add extra swap or close some apps before
hibernation?

If your system trying to fill up your swap while you have more than
2GB of main memory available, only thing I can think of is your
swapiness is set very high. You check and alter is as follows

$ cat /proc/sys/vm/swappiness
and
# echo N > /proc/sys/vm/swappiness

where N is a value between 0 and 100. Higher number means more
swapping. If I had 3GB of ram I would set it to something closer to 0
or even 0 if I am just gonna use it for hibernation.

> nothing unusual there, except for the swap usage itself.  'top' doesn't
> show any large apps.  sorted by mem the top 4 are:
>  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
>  8318 iain      20   0  494m 150m  21m S    0  5.0   1:20.67 evolution
> 20424 iain      20   0  342m  77m  30m S    0  2.5   0:01.84 firefox
>  8009 root      20   0 83364  37m 6260 S    7  1.2  38:34.31 X
>  8090 iain      20   0  159m  32m 1600 S    1  1.1   3:48.08 skype
>
> Hm, I just noticed Mem is in %.  % of what?  % total or % used?  Even if
> it was % of total RAM that could be as much as 152Mb for evo and 76Mb
> for firefox.  Not that much really.
>

% of total main memory excluding swap because its rather difficult to
take it into account.
3040*0.05 = 152 evolution


> any ideas?
>

You can try to view swap usage on top by pressing f then p and enter
and sort by it by F then P and enter. The values wont be very
realistic though. Alternatively you could try is to compare resident
memory usages  before and after swapoff.

Given the mem usage of your apps, total mem usage looks normal.  What
does not seem normal is that swap inclined mem usage. Seriously take a
look at your swapiness value. The default value cannot be right every
particular case.


> thanks :)
> --
> Iain Buchanan <iaindb at netspace dot net dot au>
>
> Chuck Norris once skewered a man with the Eiffel tower.
>
>
>


--
   Fatih

Re: [gentoo-user] swap usage creeping up

[Iain Buchanan]

On Tue, 2010-10-26 at 17:16 +1100, Adam Carter wrote:
> 
> So it looks like its RES to me by just looking at it. Did you RTFMan
> page? 

for top? no.  I should add I wasn't sorting by the RES field, even
though that's in the top listing.
-- 
Iain Buchanan <iaindb at netspace dot net dot au>

Snake: Adios-s-s, dos amigos-s-s!

Re: [gentoo-user] swap usage creeping up

[Iain Buchanan]

Hi,

On Tue, 2010-10-26 at 09:30 +0300, Fatih Tümen wrote:

> Looking at above values 494MB does not seem to be enough for
> hibernation. Do you add extra swap or close some apps before
> hibernation?

Tuxonice filewriter :)

$ ls -alh /suspend_file 
-rw------- 1 root root 1001M May 17 12:02 /suspend_file

> If your system trying to fill up your swap while you have more than
> 2GB of main memory available, only thing I can think of is your
> swapiness is set very high. You check and alter is as follows

has it changed in recent kernels?  I'm looking for the reason for the
change in behaviour... useful though, thanks :)

>  Seriously take a
> look at your swapiness value. The default value cannot be right every
> particular case.

it's 60.  That seems a little high based on what you told me, but I have
no reference value to compare it to from 2-3 weeks ago.

I'll set it lower and watch...

thanks,
-- 
Iain Buchanan <iaindb at netspace dot net dot au>

   Calculon: I was all of history's great acting robots: Acting Unit 0.8, 
   Thespo-mat, David Duchovny!

Re: [gentoo-user] swap usage creeping up

[Dale]

Iain Buchanan wrote:
> Hi,
>
> over the last week or so I've noticed unusually large swap usage.  I
> usually hibernate this laptop and have uptimes up to 12 days so apps can
> run for a long time.  I don't usually use any swap space (except for a
> few k).
>
> If I swapoff and swapon, the usage falls back to zero but then creeps up
> again over a few days.
>
> $ free -m
>               total       used       free     shared    buffers     cached
> Mem:          3040        859       2181          0         38        415
> -/+ buffers/cache:        406       2634
> Swap:          494        431         62
>
> nothing unusual there, except for the swap usage itself.  'top' doesn't
> show any large apps.  sorted by mem the top 4 are:
>    PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
>   8318 iain      20   0  494m 150m  21m S    0  5.0   1:20.67 evolution
> 20424 iain      20   0  342m  77m  30m S    0  2.5   0:01.84 firefox
>   8009 root      20   0 83364  37m 6260 S    7  1.2  38:34.31 X
>   8090 iain      20   0  159m  32m 1600 S    1  1.1   3:48.08 skype
>
> Hm, I just noticed Mem is in %.  % of what?  % total or % used?  Even if
> it was % of total RAM that could be as much as 152Mb for evo and 76Mb
> for firefox.  Not that much really.
>
> any ideas?
>
> thanks :)
>    


I ran into this a while back and noticed that a setting got changed and 
I didn't know about it.   Still no idea what changed it but you can 
check the setting with this:

root@smoker / # cat /proc/sys/vm/swappiness
20
root@smoker / #

The lower the number, the less often it will use swap.  I have swap on 
some slow drives and 2Gbs of ram so I don't want swap used unless it 
will keep me from crashing.  You can use echo to change the setting and 
I actually added this to rc.conf to set it at bootup:

echo 20 > /proc/sys/vm/swappiness

May not be the problem but worth checking into at least.

Dale

:-)  :-)

Re: [gentoo-user] swap usage creeping up

[Fatih Tümen]

On Tue, Oct 26, 2010 at 10:02 AM, Iain Buchanan <iaindb@netspace.net.au> wrote:
> On Tue, 2010-10-26 at 09:30 +0300, Fatih Tümen wrote:
>
>> Looking at above values 494MB does not seem to be enough for
>> hibernation. Do you add extra swap or close some apps before
>> hibernation?
>
> Tuxonice filewriter :)
>
> $ ls -alh /suspend_file
> -rw------- 1 root root 1001M May 17 12:02 /suspend_file

Ah, hadn't thought of that, thanks.

--
   Fatih

Re: [gentoo-user] swap usage creeping up

[Iain Buchanan]

On Tue, 2010-10-26 at 16:32 +0930, Iain Buchanan wrote:

> >  Seriously take a
> > look at your swapiness value. The default value cannot be right every
> > particular case.
> 
> it's 60.  That seems a little high based on what you told me, but I have
> no reference value to compare it to from 2-3 weeks ago.

well, in the last few days I haven't seen any swap usage at all, which
is how the system used to run!

Strange how the swappiness changed so dramatically in recent kernels.

thanks,
-- 
Iain Buchanan <iaindb at netspace dot net dot au>

I can't die until the government finds a safe place to bury my liver.
		-- Phil Harris

Re: [gentoo-user] swap usage creeping up

[Neil Bothwick]

[-- Attachment #1: Type: text/plain, Size: 637 bytes --]

On Thu, 28 Oct 2010 08:17:30 +0930, Iain Buchanan wrote:

> > it's 60.  That seems a little high based on what you told me, but I
> > have no reference value to compare it to from 2-3 weeks ago.  
> 
> well, in the last few days I haven't seen any swap usage at all, which
> is how the system used to run!
> 
> Strange how the swappiness changed so dramatically in recent kernels.

I wondered the same when I checked and saw that my computers were using
60 too. But when I googled about it I found references to a default of 60
from over a year ago.


-- 
Neil Bothwick

Despite the cost of living it remains popular.

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 198 bytes --]

Re: [gentoo-user] swap usage creeping up

[Dale]

Neil Bothwick wrote:
> On Thu, 28 Oct 2010 08:17:30 +0930, Iain Buchanan wrote:
>
>    
>>> it's 60.  That seems a little high based on what you told me, but I
>>> have no reference value to compare it to from 2-3 weeks ago.
>>>        
>> well, in the last few days I haven't seen any swap usage at all, which
>> is how the system used to run!
>>
>> Strange how the swappiness changed so dramatically in recent kernels.
>>      
> I wondered the same when I checked and saw that my computers were using
> 60 too. But when I googled about it I found references to a default of 60
> from over a year ago.
>
>    

That was about the time mine got changed.  I always wondered how that 
got changed.  Since I added it to rc.conf, that should keep it from 
getting changed again.  May want to do the same on yours too.

Dale

:-)  :-)

Re: [gentoo-user] swap usage creeping up

[Adam Carter]

[-- Attachment #1: Type: text/plain, Size: 366 bytes --]

On Thu, Oct 28, 2010 at 10:59 AM, Dale <rdalek1967@gmail.com> wrote:

>
> That was about the time mine got changed.  I always wondered how that got
> changed.  Since I added it to rc.conf, that should keep it from getting
> changed again.  May want to do the same on yours too.
>
>
Usually you put stuff like that in /etc/sysctl.conf. IIRC the key is
vm.swappiness.

[-- Attachment #2: Type: text/html, Size: 717 bytes --]

Re: [gentoo-user] swap usage creeping up

[Dale]

[-- Attachment #1: Type: text/plain, Size: 723 bytes --]

Adam Carter wrote:
>
> On Thu, Oct 28, 2010 at 10:59 AM, Dale <rdalek1967@gmail.com 
> <mailto:rdalek1967@gmail.com>> wrote:
>
>
>     That was about the time mine got changed.  I always wondered how
>     that got changed.  Since I added it to rc.conf, that should keep
>     it from getting changed again.  May want to do the same on yours too.
>
>
> Usually you put stuff like that in /etc/sysctl.conf. IIRC the key is 
> vm.swappiness.


Looking at the man page, I would think you are correct but I don't see a 
example on that setting.  I'll have to google for it I guess.

Putting it in rc.conf does work tho.  I also used to have to adjust my 
fan divisor settings and I did that in rc.conf as well.

Dale

:-)  :-)

[-- Attachment #2: Type: text/html, Size: 1487 bytes --]

Re: [gentoo-user] swap usage creeping up

[Adam Carter]

[-- Attachment #1: Type: text/plain, Size: 632 bytes --]

> Usually you put stuff like that in /etc/sysctl.conf. IIRC the key is
> vm.swappiness.
>
>
>
> Looking at the man page, I would think you are correct but I don't see a
> example on that setting.  I'll have to google for it I guess.
>
> Putting it in rc.conf does work tho.  I also used to have to adjust my fan
> divisor settings and I did that in rc.conf as well.
>
>

IIRC you're using "echo 10 > /proc/sys/vm/swappiness". If it were me if
would use vm.swappiness=10 in sysctl since in this case the control option
is available, then fall back to /etc/conf.d/local.start for "echo 10 >" type
stuff if there was no sysctl option.

[-- Attachment #2: Type: text/html, Size: 1180 bytes --]

Re: [gentoo-user] swap usage creeping up

[Dale]

[-- Attachment #1: Type: text/plain, Size: 1057 bytes --]

Adam Carter wrote:
>
>>     Usually you put stuff like that in /etc/sysctl.conf. IIRC the key
>>     is vm.swappiness.
>
>
>     Looking at the man page, I would think you are correct but I don't
>     see a example on that setting.  I'll have to google for it I guess.
>
>     Putting it in rc.conf does work tho.  I also used to have to
>     adjust my fan divisor settings and I did that in rc.conf as well.
>
>
> IIRC you're using "echo 10 > /proc/sys/vm/swappiness". If it were me 
> if would use vm.swappiness=10 in sysctl since in this case the control 
> option is available, then fall back to /etc/conf.d/local.start for 
> "echo 10 >" type stuff if there was no sysctl option.
>
>
>

I googled and found this:

http://www.brunolinux.com/06-Fine_Tuning_Your_System/Swappiness.html

Then I added "vm.swappiness=20" to the sysctl.conf file.  I'll check to 
make sure it holds that setting when I reboot, whenever that is.  I see 
no reason why it shouldn't tho since that is the proper place to set it.

So you recall correctly.  :-)

Dale

:-)  :-)

[-- Attachment #2: Type: text/html, Size: 2045 bytes --]

[gentoo-user] Re: swap usage creeping up

[James]

Iain Buchanan <iaindb <at> netspace.net.au> writes:

> over the last week or so I've noticed unusually large swap usage.  I
> usually hibernate this laptop and have uptimes up to 12 days so apps can
> run for a long time.  

Hello Iain,

From a hardware guy; If you really need hibernate, use it.
No laptop was designed to stay powered on continuously
despite the features in software and hardware. The system will
collect more dust internally than if powered up and down. Heat
is EVIL on electronics no matter what you do. Power consumption
minimization (at this point in time) is still quite young
and there are all kinds of non published issues with all
sorts of memory and chips. Fans do not have the mtbf rates
any where near what the published times are for processors.

I could go on and on, but you get the point....

If you need hibernate, use it. If you do not, your hardware
will last longer being powered down. Don't just hibernate or 
allow other users to do it, just because they are lazy. Several 
efforts are bearing fruit for fast (parallel) boot these days.....


hth,
James

Re: [gentoo-user] Re: swap usage creeping up

[Iain Buchanan]

On Thu, 2010-10-28 at 16:13 +0000, James wrote:

> Hello Iain,

hey :)

> >From a hardware guy; If you really need hibernate, use it.
> No laptop was designed to stay powered on continuously
> despite the features in software and hardware.
[snip]
> If you need hibernate, use it. If you do not, your hardware
> will last longer being powered down.
[snip]

er, hibernate IS powering down.  S3 powers off everything (Disks, CPU,
fans) but leaves a minimal amount of power to the solid-state
no-moveable-parts RAM.  S4 writes a bunch of stuff to disks and then
powers down just like a normal shut down (S5).  You can even take out
the battery (I even stripped an old laptop, removed the cpu, disks, heat
pipes, fans, and put it all back together on S4 and then resumed).  S4
can leave some bios function and power for WOL and other devices, but
it's not essential.

In fact S5 which every modern ATX computer does STILL leaves power to
USB, WOL, modems & keyboards, if required.

So when I say 12 day uptimes, this is calculated by the kernel since I
last rebooted, not since I last hibernated.  I'm not actually running
the laptop for 12 days continuously.  Although, IMHO, there's no
difference to a laptop or desktop in this regard.

Push it to the limits I say ;)
-- 
Iain Buchanan <iaindb at netspace dot net dot au>

serendipity, n.:
	The process by which human knowledge is advanced.

Re: [gentoo-user] swap usage creeping up

[Iain Buchanan]

OK so vm.swappiness seemed to help a bit but today I notice that swap
usage is up again.  It's firefox:

  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND            
14072 iain      20   0 1369m 897m  15m S    3 29.5 113:14.91 firefox            

I think that's 1.3Gb + 900Mb... sounds like a memory leak to me.

Anyone else run firefox for 113+ hours?  I'm using 3.6.9-r1.

thanks,
-- 
Iain Buchanan <iaindb at netspace dot net dot au>

Politicians speak for their parties, and parties never are, never have
been, and never will be wrong.
		-- Walter Dwight

[gentoo-user] Re: swap usage creeping up

[walt]

On 11/04/2010 11:45 PM, Iain Buchanan wrote:
> OK so vm.swappiness seemed to help a bit but today I notice that swap
> usage is up again.  It's firefox:
>
>    PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
> 14072 iain      20   0 1369m 897m  15m S    3 29.5 113:14.91 firefox
>
> I think that's 1.3Gb + 900Mb... sounds like a memory leak to me.
>
> Anyone else run firefox for 113+ hours?  I'm using 3.6.9-r1.

firefox is up to 3.6.12 now, with several important bug fixes, so I'd
suggest updating it.

Re: [gentoo-user] swap usage creeping up

[Fatih Tümen]

On Fri, Nov 5, 2010 at 08:45, Iain Buchanan <iaindb@netspace.net.au> wrote:
> OK so vm.swappiness seemed to help a bit but today I notice that swap
> usage is up again.  It's firefox:
>
>  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
> 14072 iain      20   0 1369m 897m  15m S    3 29.5 113:14.91 firefox
>
> I think that's 1.3Gb + 900Mb... sounds like a memory leak to me.
>
> Anyone else run firefox for 113+ hours?  I'm using 3.6.9-r1.
>

1.3G is the grant total of Res and Swap.  You need to read man top
before judging not-entirely-accurate values reported by top.

900M is resident on your main memory. '113+ hours' is not a decent
information to draw conclusion from. Running firefox for 113+ hours
with a single tab on a text-only website is not same as running dozens
of tabs with dozens of multimedia/embedded objects.

You say swap usage was up again but dont give data about it. 472M is
what top would report in the above case but it is an unrealictic
values as it is uncompressed size. output of cat /proc/swaps or free
is what one needs to see.

Also make sure that you put the swapiness value which you say worked
for you in /etc/sysctl.conf.

--
   Fatih

Re: [gentoo-user] swap usage creeping up

[Iain Buchanan]

On Tue, 2010-11-09 at 23:24 +0200, Fatih Tümen wrote: 
> On Fri, Nov 5, 2010 at 08:45, Iain Buchanan <iaindb@netspace.net.au> wrote:
> > OK so vm.swappiness seemed to help a bit but today I notice that swap
> > usage is up again.  It's firefox:
> >
> >  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
> > 14072 iain      20   0 1369m 897m  15m S    3 29.5 113:14.91 firefox
> >
> > I think that's 1.3Gb + 900Mb... sounds like a memory leak to me.
> >
> > Anyone else run firefox for 113+ hours?  I'm using 3.6.9-r1.
> >
> 
> 1.3G is the grant total of Res and Swap.  You need to read man top
> before judging not-entirely-accurate values reported by top.

judging? I only said "I think"!

sure, top has it's quirks, but it's ok for comparing against itself.

> 900M is resident on your main memory. '113+ hours' is not a decent
> information to draw conclusion from. Running firefox for 113+ hours
> with a single tab on a text-only website is not same as running dozens
> of tabs with dozens of multimedia/embedded objects.

sure, but running it for 10 or 100 or 1000 hours should produce roughly
the same characteristics for the same browsing behaviour if all other
things are equal.  A few months ago this didn't cause any issues at all,
now I'm seeing high swap usage.  I usually never use my 3G of physical
RAM.

Again today I see it is using about 900Mb in total, which seems quite
large.  vm.swappiness is set to 0.  I've upgraded firefox to 3.6.12.

I had to reboot, but I'll check the usual statistics next time I see it.

-- 
Iain Buchanan <iaindb@netspace.net.au>

Re: [gentoo-user] swap usage creeping up

[Fatih Tümen]

On Mon, Nov 15, 2010 at 07:09, Iain Buchanan <iaindb@netspace.net.au> wrote:
> On Tue, 2010-11-09 at 23:24 +0200, Fatih Tümen wrote:
>> On Fri, Nov 5, 2010 at 08:45, Iain Buchanan <iaindb@netspace.net.au> wrote:
>> > OK so vm.swappiness seemed to help a bit but today I notice that swap
>> > usage is up again.  It's firefox:
>> >
>> >  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
>> > 14072 iain      20   0 1369m 897m  15m S    3 29.5 113:14.91 firefox
>> >
>> > I think that's 1.3Gb + 900Mb... sounds like a memory leak to me.
>> >
>> > Anyone else run firefox for 113+ hours?  I'm using 3.6.9-r1.
>> >
>>
>> 1.3G is the grant total of Res and Swap.  You need to read man top
>> before judging not-entirely-accurate values reported by top.
>
> judging? I only said "I think"!
>
> sure, top has it's quirks, but it's ok for comparing against itself.
>
>> 900M is resident on your main memory. '113+ hours' is not a decent
>> information to draw conclusion from. Running firefox for 113+ hours
>> with a single tab on a text-only website is not same as running dozens
>> of tabs with dozens of multimedia/embedded objects.
>
> sure, but running it for 10 or 100 or 1000 hours should produce roughly
> the same characteristics for the same browsing behaviour if all other
> things are equal.  A few months ago this didn't cause any issues at all,
> now I'm seeing high swap usage.  I usually never use my 3G of physical
> RAM.
>

Can you recall what significant change have you made to the system?
For emerged packages you can try smth like genlop --list --date 1
month ago and then check against the versions upgraded from.

> Again today I see it is using about 900Mb in total, which seems quite
> large.  vm.swappiness is set to 0.  I've upgraded firefox to 3.6.12.
>
> I had to reboot, but I'll check the usual statistics next time I see it.
>

You say swappiness is set to 0 but dont give any swap usage info. If
there is any swap usage while swapiness is 0 then it would be weird
and we could blame it on the kernel.

I just googled mem usage firefox as I am running out of ideas. It seem
like you are not the only one complaining about this. Take a look at
these top results. There are some tweaking advice, see it they work
for you.
http://kb.mozillazine.org/Memory_Leak
http://support.mozilla.com/en-US/kb/high+memory+usage

Chromium, which I have been happily using for almost a year now, has a
task manager which shows mem usage of every extension and tab. If
firefox has switched to multiprocessing, which was a feature plan some
time ago, similar tool should likely be available for firefox as well.

--
   Fatih

Re: [gentoo-user] swap usage creeping up

[Iain Buchanan]

On Mon, 2010-11-15 at 10:41 +0200, Fatih Tümen wrote:
> On Mon, Nov 15, 2010 at 07:09, Iain Buchanan <iaindb@netspace.net.au> wrote:

> > sure, but running it for 10 or 100 or 1000 hours should produce roughly
> > the same characteristics for the same browsing behaviour if all other
> > things are equal.  A few months ago this didn't cause any issues at all,
> > now I'm seeing high swap usage.  I usually never use my 3G of physical
> > RAM.
> >
> 
> Can you recall what significant change have you made to the system?
> For emerged packages you can try smth like genlop --list --date 1
> month ago and then check against the versions upgraded from.

sure, only EVERYthing has been updated... including firefox and the
kernel!

> > Again today I see it is using about 900Mb in total, which seems quite
> > large.  vm.swappiness is set to 0.  I've upgraded firefox to 3.6.12.
> >
> > I had to reboot, but I'll check the usual statistics next time I see it.
> >
> 
> You say swappiness is set to 0 but dont give any swap usage info.

that's cause I had to reboot and swap was back to 0.

>  If
> there is any swap usage while swapiness is 0 then it would be weird
> and we could blame it on the kernel.

_any_ swap usage?  right now I'm using 110Mb of swap with 1.8Gb free
physical RAM and vm.swapiness is 0!

$ free -m
             total       used       free     shared    buffers     cached
Mem:          3040       1206       1834          0         61        246
-/+ buffers/cache:        898       2142
Swap:          494        110        383


$ cat /proc/sys/vm/swappiness
0

  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND            
 3192 iain      20   0  554m 204m  27m S    9  6.7  26:31.94 firefox            


> I just googled mem usage firefox as I am running out of ideas.

but thanks for the suggestions anyway :)  I'll keep googling!

-- 
Iain Buchanan <iaindb at netspace dot net dot au>

Allen's Axiom:
	When all else fails, read the instructions.

Re: [gentoo-user] swap usage creeping up

[Fatih Tümen]

Okay I am getting suspicious of tuxonice. Setting swappiness to zero
does not mean kernel wont use any swap but it should not be prefering
swap over ram when 2G of ram is out there either.

Just out of curiosity, can you find out which app(s) being swapped ?

I would give a try to gentoo-sources and see if the issue can be reproduced.

On 15/11/2010, Iain Buchanan <iaindb@netspace.net.au> wrote:
> On Mon, 2010-11-15 at 10:41 +0200, Fatih Tümen wrote:
>> On Mon, Nov 15, 2010 at 07:09, Iain Buchanan <iaindb@netspace.net.au>
>> wrote:
>
>> > sure, but running it for 10 or 100 or 1000 hours should produce roughly
>> > the same characteristics for the same browsing behaviour if all other
>> > things are equal.  A few months ago this didn't cause any issues at all,
>> > now I'm seeing high swap usage.  I usually never use my 3G of physical
>> > RAM.
>> >
>>
>> Can you recall what significant change have you made to the system?
>> For emerged packages you can try smth like genlop --list --date 1
>> month ago and then check against the versions upgraded from.
>
> sure, only EVERYthing has been updated... including firefox and the
> kernel!
>
>> > Again today I see it is using about 900Mb in total, which seems quite
>> > large.  vm.swappiness is set to 0.  I've upgraded firefox to 3.6.12.
>> >
>> > I had to reboot, but I'll check the usual statistics next time I see it.
>> >
>>
>> You say swappiness is set to 0 but dont give any swap usage info.
>
> that's cause I had to reboot and swap was back to 0.
>
>>  If
>> there is any swap usage while swapiness is 0 then it would be weird
>> and we could blame it on the kernel.
>
> _any_ swap usage?  right now I'm using 110Mb of swap with 1.8Gb free
> physical RAM and vm.swapiness is 0!
>
> $ free -m
>              total       used       free     shared    buffers     cached
> Mem:          3040       1206       1834          0         61        246
> -/+ buffers/cache:        898       2142
> Swap:          494        110        383
>
>
> $ cat /proc/sys/vm/swappiness
> 0
>
>   PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
>
>  3192 iain      20   0  554m 204m  27m S    9  6.7  26:31.94 firefox
>
>
>
>> I just googled mem usage firefox as I am running out of ideas.
>
> but thanks for the suggestions anyway :)  I'll keep googling!
>
> --
> Iain Buchanan <iaindb at netspace dot net dot au>
>
> Allen's Axiom:
> 	When all else fails, read the instructions.
>
>
>

-- 
Sent from my mobile device

--
  Fatih

Re: [gentoo-user] swap usage creeping up

[Dale]

Fatih Tümen wrote:
> Okay I am getting suspicious of tuxonice. Setting swappiness to zero
> does not mean kernel wont use any swap but it should not be prefering
> swap over ram when 2G of ram is out there either.
>
> Just out of curiosity, can you find out which app(s) being swapped ?
>
> I would give a try to gentoo-sources and see if the issue can be reproduced.
>
>    

I agree.  If swappiness is set to 0, it should not use swap unless it is 
to prevent the system from crashing.  I set mine to 30 and I have 2Gbs 
of ram.  The only time it uses any swap at all is when I am compiling 
OOo or maybe, just maybe, gcc.  Other than that, it is using pretty much 
all the ram because I have a couple hundred picture files open or 
something.  It is rare that I use swap even with it set to 30.  I can't 
see much of any reason it should when set at 0 except to prevent crashing.

There seems to be something fishy on the OP's system.  I'm not sure what 
but it is not working as it should.  I use gentoo-sources here.  2.6.35 
at the moment.

Dale

:-)  :-)

Re: [gentoo-user] swap usage creeping up

[Iain Buchanan]

On Mon, 2010-11-15 at 17:43 -0600, Dale wrote:
> Fatih Tümen wrote:
> > Okay I am getting suspicious of tuxonice.

hm, maybe it was tuxonice, maybe it was 2.6.35, maybe it was the moon?

I've just upgraded to 2.6.36 tuxonice and hence had to unmask
nvidia-drivers 260.19.06.  Changing windows and virtual desktops is now
back to it's snappy old self...  Let's hope I see some change in swap
usage too.

thanks,
-- 
Iain Buchanan <iaindb at netspace dot net dot au>

If it's too good to be true, it's probably a rigged demo.