[gentoo-user] Howzat!

[gentoo-user] Howzat!

[Peter Humphrey]

Hello list,

How's this for sheer persistence and grit?

$ genlop -c

 Currently merging 321 out of 368

 * www-client/chromium-10.0.648.204

       current merge time: 11 hours, 41 minutes and 9 seconds.
       ETA: any time now.

This is my Atom N270 LAN server box.

-- 
Rgds
Peter

Re: [gentoo-user] Howzat!

[Dale]

Peter Humphrey wrote:
> Hello list,
>
> How's this for sheer persistence and grit?
>
> $ genlop -c
>
>   Currently merging 321 out of 368
>
>   * www-client/chromium-10.0.648.204
>
>         current merge time: 11 hours, 41 minutes and 9 seconds.
>         ETA: any time now.
>
> This is my Atom N270 LAN server box.
>
>    

I got a very old Compaq rig with quad 200Mhz CPUs and 128Mbs of ram.  I 
have always wondered how long it would take to compile OOo on that 
thing.  12 hours to compile a browser does take patience.  I hope you 
don't have a power failure right at the end.  o_O

How long does it take to open it when it gets done?  Seconds?  Minutes?

Dale

:-)  :-)

Re: [gentoo-user] Howzat!

[Joshua Murphy]

On Sun, Apr 17, 2011 at 9:44 PM, Dale <rdalek1967@gmail.com> wrote:
> Peter Humphrey wrote:
>>
>> Hello list,
>>
>> How's this for sheer persistence and grit?
>>
>> $ genlop -c
>>
>>  Currently merging 321 out of 368
>>
>>  * www-client/chromium-10.0.648.204
>>
>>        current merge time: 11 hours, 41 minutes and 9 seconds.
>>        ETA: any time now.
>>
>> This is my Atom N270 LAN server box.
>>
>>
>
> I got a very old Compaq rig with quad 200Mhz CPUs and 128Mbs of ram.  I have
> always wondered how long it would take to compile OOo on that thing.  12
> hours to compile a browser does take patience.  I hope you don't have a
> power failure right at the end.  o_O
>
> How long does it take to open it when it gets done?  Seconds?  Minutes?
>
> Dale
>
> :-)  :-)
>
>

Assuming a reasonable 1GB ram on the box (pretty well standard to low
with an Atom), and considering what my netbook does (the same single
core 1.6GHz with HT turned on for responsiveness in my case), about
2-3 seconds... but then I'm on a little SSD too. I should admit my
netbook's running Debian at the moment, though. Didn't want to abuse
the SSD too much with writes, and it's tedious to install things
through an intermediary system all the time. The fullsize laptop, when
it gets its rebuild over the next week (it's been a windows 2k3 server
development system lately)

-- 
Poison [BLX]
Joshua M. Murphy

Re: [gentoo-user] Howzat!

[Florian Philipp]

[-- Attachment #1: Type: text/plain, Size: 1918 bytes --]

Am 18.04.2011 06:53, schrieb Joshua Murphy:
> On Sun, Apr 17, 2011 at 9:44 PM, Dale <rdalek1967@gmail.com> wrote:
>> Peter Humphrey wrote:
>>>
>>> Hello list,
>>>
>>> How's this for sheer persistence and grit?
>>>
>>> $ genlop -c
>>>
>>>  Currently merging 321 out of 368
>>>
>>>  * www-client/chromium-10.0.648.204
>>>
>>>        current merge time: 11 hours, 41 minutes and 9 seconds.
>>>        ETA: any time now.
>>>
>>> This is my Atom N270 LAN server box.
>>>
>>>
>>
>> I got a very old Compaq rig with quad 200Mhz CPUs and 128Mbs of ram.  I have
>> always wondered how long it would take to compile OOo on that thing.  12
>> hours to compile a browser does take patience.  I hope you don't have a
>> power failure right at the end.  o_O
>>
>> How long does it take to open it when it gets done?  Seconds?  Minutes?
>>
>> Dale
>>
>> :-)  :-)
>>
>>
> 
> Assuming a reasonable 1GB ram on the box (pretty well standard to low
> with an Atom), and considering what my netbook does (the same single
> core 1.6GHz with HT turned on for responsiveness in my case), about
> 2-3 seconds... but then I'm on a little SSD too. I should admit my
> netbook's running Debian at the moment, though. Didn't want to abuse
> the SSD too much with writes, and it's tedious to install things
> through an intermediary system all the time. The fullsize laptop, when
> it gets its rebuild over the next week (it's been a windows 2k3 server
> development system lately)
> 

My strategy for getting Gentoo on a netbook with an SSD is to use NFS
for PORTAGE_TMPDIR. Works nicely and makes less work than building
everything remote. The only problem is that the setuid bit seems to get
lost. That's not too much of an issue, though. There are only a handful
of setuid binaries on a system and you can compare the list of them with
a normal desktop machine.

Regards,
Florian Philipp


[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 262 bytes --]

Re: [gentoo-user] Howzat!

[Neil Bothwick]

[-- Attachment #1: Type: text/plain, Size: 916 bytes --]

On Mon, 18 Apr 2011 09:52:56 +0200, Florian Philipp wrote:

>> it's tedious to install things
> > through an intermediary system all the time. The fullsize laptop, when
> > it gets its rebuild over the next week (it's been a windows 2k3 server
> > development system lately)

> My strategy for getting Gentoo on a netbook with an SSD is to use NFS
> for PORTAGE_TMPDIR. Works nicely and makes less work than building
> everything remote.

Doesn't using NFS slow compilation right down. I have a script on
the build host that enters the chroot and runs emerge -uD --changed-use
world, right after cron does emerge --sync, so the packages are
automatically available. Ass --usepkg to EMERGE_DEFAULT_OPTS on the
netbook and everything is transparent and no work at all (apart from a
couple of packages that won't build in the chroot).


-- 
Neil Bothwick

Beware of cover disks bearing upgrades.

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 198 bytes --]

Re: [gentoo-user] Howzat!

[Florian Philipp]

[-- Attachment #1: Type: text/plain, Size: 1698 bytes --]

Am 18.04.2011 10:12, schrieb Neil Bothwick:
> On Mon, 18 Apr 2011 09:52:56 +0200, Florian Philipp wrote:
> 
>>> it's tedious to install things
>>> through an intermediary system all the time. The fullsize laptop, when
>>> it gets its rebuild over the next week (it's been a windows 2k3 server
>>> development system lately)
> 
>> My strategy for getting Gentoo on a netbook with an SSD is to use NFS
>> for PORTAGE_TMPDIR. Works nicely and makes less work than building
>> everything remote.
> 
> Doesn't using NFS slow compilation right down. I have a script on
> the build host that enters the chroot and runs emerge -uD --changed-use
> world, right after cron does emerge --sync, so the packages are
> automatically available. Ass --usepkg to EMERGE_DEFAULT_OPTS on the
> netbook and everything is transparent and no work at all (apart from a
> couple of packages that won't build in the chroot).
> 
> 

I haven't noticed any slowdown. I use a 100 MBit/s connection. That's
nearly 12 MiB/s. The SSD has a write-speed of maybe 4-8 MiB/s. Actual
throughput (monitored with iftop) was usually lower that 40 Mbit/s.
Maybe latency was a bit higher and NFSv4 could have helped with that but
I think it was negligible compared to the compiling performance of the
Atom processor.

Sure, a build host would have been better but it also meant more work. I
also thought about using ATAoE, iSCSI or something alike to mount the
SSD from a more powerful computer (using a live-system to avoid obvious
problems when mounting the FS twice). Again - too much fuss. I usually
just do security updates and then a full update every six months or so.

Regards,
Florian Philipp


[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 262 bytes --]

Re: [gentoo-user] Howzat!

[Kfir Lavi]

[-- Attachment #1: Type: text/plain, Size: 1843 bytes --]

On Mon, Apr 18, 2011 at 7:53 AM, Joshua Murphy <poisonbl@gmail.com> wrote:

> On Sun, Apr 17, 2011 at 9:44 PM, Dale <rdalek1967@gmail.com> wrote:
> > Peter Humphrey wrote:
> >>
> >> Hello list,
> >>
> >> How's this for sheer persistence and grit?
> >>
> >> $ genlop -c
> >>
> >>  Currently merging 321 out of 368
> >>
> >>  * www-client/chromium-10.0.648.204
> >>
> >>        current merge time: 11 hours, 41 minutes and 9 seconds.
> >>        ETA: any time now.
> >>
> >> This is my Atom N270 LAN server box.
> >>
> >>
>
I remember compiling LFS on P100. It took a week to compile X ;) at the end
I had Xinerama working ;-P


>  >
> > I got a very old Compaq rig with quad 200Mhz CPUs and 128Mbs of ram.  I
> have
> > always wondered how long it would take to compile OOo on that thing.  12
> > hours to compile a browser does take patience.  I hope you don't have a
> > power failure right at the end.  o_O
> >
> > How long does it take to open it when it gets done?  Seconds?  Minutes?
> >
> > Dale
> >
> > :-)  :-)
> >
> >
>
> Assuming a reasonable 1GB ram on the box (pretty well standard to low
> with an Atom), and considering what my netbook does (the same single
> core 1.6GHz with HT turned on for responsiveness in my case), about
> 2-3 seconds... but then I'm on a little SSD too. I should admit my
> netbook's running Debian at the moment, though. Didn't want to abuse
> the SSD too much with writes, and it's tedious to install things
> through an intermediary system all the time. The fullsize laptop, when
> it gets its rebuild over the next week (it's been a windows 2k3 server
> development system lately)
>
> I do a lot of compiling on my laptop using Catalyst for embedded.
I upgraded my RAM to 8GB (2x4GB = 90$ ebay).
I mount /var/tmp as tmpfs.
Thats how I keep my SSD ;)

Kfir

> --
> Poison [BLX]
> Joshua M. Murphy
>
>

[-- Attachment #2: Type: text/html, Size: 2973 bytes --]

Re: [gentoo-user] Howzat!

[Dale]

[-- Attachment #1: Type: text/plain, Size: 485 bytes --]

Kfir Lavi wrote:
>
> I do a lot of compiling on my laptop using Catalyst for embedded.
> I upgraded my RAM to 8GB (2x4GB = 90$ ebay).
> I mount /var/tmp as tmpfs.
> Thats how I keep my SSD ;)
>
> Kfir
>
>     --
>     Poison [BLX]
>     Joshua M. Murphy
>
>

I got 16Gbs in my rig and I mounted portages work directory on tmpfs, it 
was actually slower.  That is likely a good idea to keep from wearing 
out the SSD but it doesn't seem to make anything compile faster.

Dale

:-)  :-)

[-- Attachment #2: Type: text/html, Size: 1188 bytes --]

Re: [gentoo-user] Howzat!

[Joost Roeleveld]

On Tuesday 19 April 2011 17:54:02 Dale wrote:
> Kfir Lavi wrote:
> > I do a lot of compiling on my laptop using Catalyst for embedded.
> > I upgraded my RAM to 8GB (2x4GB = 90$ ebay).
> > I mount /var/tmp as tmpfs.
> > Thats how I keep my SSD ;)
> > 
> > Kfir
> > 
> >     --
> >     Poison [BLX]
> >     Joshua M. Murphy
> 
> I got 16Gbs in my rig and I mounted portages work directory on tmpfs, it
> was actually slower.  That is likely a good idea to keep from wearing
> out the SSD but it doesn't seem to make anything compile faster.

Strange, it actually got faster on mine when doing that.
Did you mount with "noatime"? :)

--
Joost

Re: [gentoo-user] Howzat!

[Dale]

Joost Roeleveld wrote:
> On Tuesday 19 April 2011 17:54:02 Dale wrote:
>    
>> Kfir Lavi wrote:
>>      
>>> I do a lot of compiling on my laptop using Catalyst for embedded.
>>> I upgraded my RAM to 8GB (2x4GB = 90$ ebay).
>>> I mount /var/tmp as tmpfs.
>>> Thats how I keep my SSD ;)
>>>
>>> Kfir
>>>
>>>      --
>>>      Poison [BLX]
>>>      Joshua M. Murphy
>>>        
>> I got 16Gbs in my rig and I mounted portages work directory on tmpfs, it
>> was actually slower.  That is likely a good idea to keep from wearing
>> out the SSD but it doesn't seem to make anything compile faster.
>>      
> Strange, it actually got faster on mine when doing that.
> Did you mount with "noatime"? :)
>
> --
> Joost
>
>    

Yep.  It actually took a few seconds longer compiling in memory.  I 
thought that was weird to tho.  It doesn't make much sense to me.

Dale

:-)  :-)

Re: [gentoo-user] Howzat!

[Joost Roeleveld]

On Wednesday 20 April 2011 03:42:13 Dale wrote:
> Joost Roeleveld wrote:
> > On Tuesday 19 April 2011 17:54:02 Dale wrote:
> >> Kfir Lavi wrote:
> >>> I do a lot of compiling on my laptop using Catalyst for embedded.
> >>> I upgraded my RAM to 8GB (2x4GB = 90$ ebay).
> >>> I mount /var/tmp as tmpfs.
> >>> Thats how I keep my SSD ;)
> >>> 
> >>> Kfir
> >>> 
> >>>      --
> >>>      Poison [BLX]
> >>>      Joshua M. Murphy
> >> 
> >> I got 16Gbs in my rig and I mounted portages work directory on tmpfs,
> >> it
> >> was actually slower.  That is likely a good idea to keep from wearing
> >> out the SSD but it doesn't seem to make anything compile faster.
> > 
> > Strange, it actually got faster on mine when doing that.
> > Did you mount with "noatime"? :)
> > 
> > --
> > Joost
> 
> Yep.  It actually took a few seconds longer compiling in memory.  I
> thought that was weird to tho.  It doesn't make much sense to me.
> 
> Dale
> 
> :-)  :-)

Hmm...
Will be doing some timing-tests then....
Openoffice is a good one for that ;)

--
Joost

Re: [gentoo-user] Howzat!

[Pandu Poluan]

Google Talk:    pepoluan
Y! messenger: pepoluan
MSN / Live:      pepoluan@hotmail.com (do not send email here)
Skype:            pepoluan
More on me:  My LinkedIn Account  My Facebook Account


On Wed, Apr 20, 2011 at 16:25, Joost Roeleveld <joost@antarean.org> wrote:
>
> On Wednesday 20 April 2011 03:42:13 Dale wrote:
> > Joost Roeleveld wrote:
> > > On Tuesday 19 April 2011 17:54:02 Dale wrote:
> > >> Kfir Lavi wrote:
> > >>> I do a lot of compiling on my laptop using Catalyst for embedded.
> > >>> I upgraded my RAM to 8GB (2x4GB = 90$ ebay).
> > >>> I mount /var/tmp as tmpfs.
> > >>> Thats how I keep my SSD ;)
> > >>>
> > >>> Kfir
> > >>>
> > >>>      --
> > >>>      Poison [BLX]
> > >>>      Joshua M. Murphy
> > >>
> > >> I got 16Gbs in my rig and I mounted portages work directory on tmpfs,
> > >> it
> > >> was actually slower.  That is likely a good idea to keep from wearing
> > >> out the SSD but it doesn't seem to make anything compile faster.
> > >
> > > Strange, it actually got faster on mine when doing that.
> > > Did you mount with "noatime"? :)
> > >
> > > --
> > > Joost
> >
> > Yep.  It actually took a few seconds longer compiling in memory.  I
> > thought that was weird to tho.  It doesn't make much sense to me.
> >
> > Dale
> >
> > :-)  :-)
>
> Hmm...
> Will be doing some timing-tests then....
> Openoffice is a good one for that ;)
>

Not LibreOffice? :-)

Rgds,
--
Pandu E Poluan
~ IT Optimizer ~
Visit my Blog: http://pepoluan.posterous.com

Re: [gentoo-user] Howzat!

[Joost Roeleveld]

On Wednesday 20 April 2011 16:49:26 Pandu Poluan wrote:
> Google Talk:    pepoluan
> Y! messenger: pepoluan
> MSN / Live:      pepoluan@hotmail.com (do not send email here)
> Skype:            pepoluan
> More on me:  My LinkedIn Account  My Facebook Account

Wouldn't this fit better at the bottom as a signature?
And the links don't work....

> On Wed, Apr 20, 2011 at 16:25, Joost Roeleveld <joost@antarean.org> wrote:
> > On Wednesday 20 April 2011 03:42:13 Dale wrote:
> > > Joost Roeleveld wrote:
> > > > On Tuesday 19 April 2011 17:54:02 Dale wrote:
> > > >> Kfir Lavi wrote:
> > > >>> I do a lot of compiling on my laptop using Catalyst for
> > > >>> embedded.
> > > >>> I upgraded my RAM to 8GB (2x4GB = 90$ ebay).
> > > >>> I mount /var/tmp as tmpfs.
> > > >>> Thats how I keep my SSD ;)
> > > >>> 
> > > >>> Kfir
> > > >>> 
> > > >>>      --
> > > >>>      Poison [BLX]
> > > >>>      Joshua M. Murphy
> > > >> 
> > > >> I got 16Gbs in my rig and I mounted portages work directory on
> > > >> tmpfs, it
> > > >> was actually slower.  That is likely a good idea to keep from
> > > >> wearing out the SSD but it doesn't seem to make anything
> > > >> compile faster.
> > > > 
> > > > Strange, it actually got faster on mine when doing that.
> > > > Did you mount with "noatime"? :)
> > > > 
> > > > --
> > > > Joost
> > > 
> > > Yep.  It actually took a few seconds longer compiling in memory.  I
> > > thought that was weird to tho.  It doesn't make much sense to me.
> > > 
> > > Dale
> > > 
> > > :-)  :-)
> > 
> > Hmm...
> > Will be doing some timing-tests then....
> > Openoffice is a good one for that ;)
> 
> Not LibreOffice? :-)

Not switched yet on the test-system and already got the sources downloaded...
To test honestly, I need a long build to be able to see a real difference

--
Joost

Re: [gentoo-user] Howzat!

[Pandu Poluan]

On Wed, Apr 20, 2011 at 17:24, Joost Roeleveld <joost@antarean.org> wrote:
> On Wednesday 20 April 2011 16:49:26 Pandu Poluan wrote:
>> Google Talk:    pepoluan
>> Y! messenger: pepoluan
>> MSN / Live:      pepoluan@hotmail.com (do not send email here)
>> Skype:            pepoluan
>> More on me:  My LinkedIn Account  My Facebook Account
>
> Wouldn't this fit better at the bottom as a signature?

I had a stupid moment >.<

My full sig is like below, and it's originally in HTML, so the links
would've worked. Whenever I post to Gentoo-User, I change to
plaintext, crop the sig to only the top 3 lines (excluding the "--"),
and delete the rest.

Yesterday I clicked "Send" a moment too soon...

I've finally figured out why Gmail insisted on putting my sig above
the quote, and have now configured it to put the sig under the quote.
In the future, you won't see lines 4 ~ 8 of my sig (barring any more
stupid moments, of course...)

Rgds,
-- 
Pandu E Poluan
~ IT Optimizer ~
Visit my Blog: http://pepoluan.posterous.com
Google Talk:    pepoluan
Y! messenger: pepoluan
MSN / Live:      pepoluan@hotmail.com (do not send email here)
Skype:            pepoluan
More on me:  My LinkedIn Account  My Facebook Account

Re: [gentoo-user] Howzat!

[Paul Hartman]

On Thu, Apr 21, 2011 at 12:41 AM, Pandu Poluan <pandu@poluan.info> wrote:
> My full sig is like below, and it's originally in HTML, so the links
> would've worked. Whenever I post to Gentoo-User, I change to
> plaintext, crop the sig to only the top 3 lines (excluding the "--"),
> and delete the rest.

Signature divider should be "-- " not "--", newline dash dash space newline.

:)

Re: [gentoo-user] Howzat!

[Joost Roeleveld]

On Wednesday 20 April 2011 11:25:27 Joost Roeleveld wrote:
> On Wednesday 20 April 2011 03:42:13 Dale wrote:
> > Joost Roeleveld wrote:
> > > On Tuesday 19 April 2011 17:54:02 Dale wrote:
> > >> Kfir Lavi wrote:
> > >>> I do a lot of compiling on my laptop using Catalyst for
> > >>> embedded.
> > >>> I upgraded my RAM to 8GB (2x4GB = 90$ ebay).
> > >>> I mount /var/tmp as tmpfs.
> > >>> Thats how I keep my SSD ;)
> > >>> 
> > >>> Kfir
> > >>> 
> > >>>      --
> > >>>      Poison [BLX]
> > >>>      Joshua M. Murphy
> > >> 
> > >> I got 16Gbs in my rig and I mounted portages work directory on
> > >> tmpfs,
> > >> it
> > >> was actually slower.  That is likely a good idea to keep from
> > >> wearing
> > >> out the SSD but it doesn't seem to make anything compile faster.
> > > 
> > > Strange, it actually got faster on mine when doing that.
> > > Did you mount with "noatime"? :)
> > > 
> > > --
> > > Joost
> > 
> > Yep.  It actually took a few seconds longer compiling in memory.  I
> > thought that was weird to tho.  It doesn't make much sense to me.
> > 
> > Dale
> > 
> > :-)  :-)
> 
> Hmm...
> Will be doing some timing-tests then....
> Openoffice is a good one for that ;)

Ok, just done the tests. using tmpfs for /var/tmp/portage is quicker, but not 
by much.

Without TMPFS:
# time emerge -v openoffice
real 32m44.742s
user 20m18.320s
sys 5m38.000s

With TMPFS:
# mount -onoatime,size=7G -ttmpfs none /var/tmp/portage
# time emerge -v openoffice
real 31m30.835s
user 20m3.510s
sys 5m38.030s

Specification of this machine:
12GB RAM
Quad Core Xeon W3565 @ 3.2Ghz with HT enabled

There are 2 drives in stripe-mode (software RAID-0) which does speed up the 
I/O a lot.

--
Joost

Re: [gentoo-user] Howzat!

[Alan McKinnon]

Apparently, though unproven, at 14:37 on Wednesday 20 April 2011, Joost 
Roeleveld did opine thusly:

> On Wednesday 20 April 2011 11:25:27 Joost Roeleveld wrote:
> > On Wednesday 20 April 2011 03:42:13 Dale wrote:
> > > Joost Roeleveld wrote:
> > > > On Tuesday 19 April 2011 17:54:02 Dale wrote:
> > > >> Kfir Lavi wrote:
> > > >>> I do a lot of compiling on my laptop using Catalyst for
> > > >>> embedded.
> > > >>> I upgraded my RAM to 8GB (2x4GB = 90$ ebay).
> > > >>> I mount /var/tmp as tmpfs.
> > > >>> Thats how I keep my SSD ;)
> > > >>> 
> > > >>> Kfir
> > > >>> 
> > > >>>      --
> > > >>>      Poison [BLX]
> > > >>>      Joshua M. Murphy
> > > >> 
> > > >> I got 16Gbs in my rig and I mounted portages work directory on
> > > >> tmpfs,
> > > >> it
> > > >> was actually slower.  That is likely a good idea to keep from
> > > >> wearing
> > > >> out the SSD but it doesn't seem to make anything compile faster.
> > > > 
> > > > Strange, it actually got faster on mine when doing that.
> > > > Did you mount with "noatime"? :)
> > > > 
> > > > --
> > > > Joost
> > > 
> > > Yep.  It actually took a few seconds longer compiling in memory.  I
> > > thought that was weird to tho.  It doesn't make much sense to me.
> > > 
> > > Dale
> > > 
> > > :-)  :-)
> > 
> > Hmm...
> > Will be doing some timing-tests then....
> > Openoffice is a good one for that ;)
> 
> Ok, just done the tests. using tmpfs for /var/tmp/portage is quicker, but
> not by much.
> 
> Without TMPFS:
> # time emerge -v openoffice
> real 32m44.742s
> user 20m18.320s
> sys 5m38.000s
> 
> With TMPFS:
> # mount -onoatime,size=7G -ttmpfs none /var/tmp/portage
> # time emerge -v openoffice
> real 31m30.835s
> user 20m3.510s
> sys 5m38.030s
> 
> Specification of this machine:
> 12GB RAM
> Quad Core Xeon W3565 @ 3.2Ghz with HT enabled
> 
> There are 2 drives in stripe-mode (software RAID-0) which does speed up the
> I/O a lot.


I'd say the entirety of /var/tmp/portage for your OOo build fits into your ram 
disk cache so very little actual disk IO is happening.

I also noticed before switching to libreoffice-bin that the ooo build was 
largely cpu-bound anyway (disk light flashed seldom)


-- 
alan dot mckinnon at gmail dot com

Re: [gentoo-user] Howzat!

[Joost Roeleveld]

On Wednesday 20 April 2011 15:16:40 Alan McKinnon wrote:
> Apparently, though unproven, at 14:37 on Wednesday 20 April 2011, Joost
> 
> Roeleveld did opine thusly:
> > On Wednesday 20 April 2011 11:25:27 Joost Roeleveld wrote:
> > > On Wednesday 20 April 2011 03:42:13 Dale wrote:
> > > > Joost Roeleveld wrote:
> > > > > On Tuesday 19 April 2011 17:54:02 Dale wrote:
> > > > >> Kfir Lavi wrote:
> > > > >>> I do a lot of compiling on my laptop using Catalyst for
> > > > >>> embedded.
> > > > >>> I upgraded my RAM to 8GB (2x4GB = 90$ ebay).
> > > > >>> I mount /var/tmp as tmpfs.
> > > > >>> Thats how I keep my SSD ;)
> > > > >>> 
> > > > >>> Kfir
> > > > >>> 
> > > > >>>      --
> > > > >>>      Poison [BLX]
> > > > >>>      Joshua M. Murphy
> > > > >> 
> > > > >> I got 16Gbs in my rig and I mounted portages work
> > > > >> directory on
> > > > >> tmpfs,
> > > > >> it
> > > > >> was actually slower.  That is likely a good idea to keep
> > > > >> from
> > > > >> wearing
> > > > >> out the SSD but it doesn't seem to make anything compile
> > > > >> faster.
> > > > > 
> > > > > Strange, it actually got faster on mine when doing that.
> > > > > Did you mount with "noatime"? :)
> > > > > 
> > > > > --
> > > > > Joost
> > > > 
> > > > Yep.  It actually took a few seconds longer compiling in memory.
> > > >  I
> > > > thought that was weird to tho.  It doesn't make much sense to
> > > > me.
> > > > 
> > > > Dale
> > > > 
> > > > :-)  :-)
> > > 
> > > Hmm...
> > > Will be doing some timing-tests then....
> > > Openoffice is a good one for that ;)
> > 
> > Ok, just done the tests. using tmpfs for /var/tmp/portage is quicker,
> > but
> > not by much.
> > 
> > Without TMPFS:
> > # time emerge -v openoffice
> > real 32m44.742s
> > user 20m18.320s
> > sys 5m38.000s
> > 
> > With TMPFS:
> > # mount -onoatime,size=7G -ttmpfs none /var/tmp/portage
> > # time emerge -v openoffice
> > real 31m30.835s
> > user 20m3.510s
> > sys 5m38.030s
> > 
> > Specification of this machine:
> > 12GB RAM
> > Quad Core Xeon W3565 @ 3.2Ghz with HT enabled
> > 
> > There are 2 drives in stripe-mode (software RAID-0) which does speed up
> > the I/O a lot.
> 
> I'd say the entirety of /var/tmp/portage for your OOo build fits into your
> ram disk cache so very little actual disk IO is happening.
> 
> I also noticed before switching to libreoffice-bin that the ooo build was
> largely cpu-bound anyway (disk light flashed seldom)

Alan,

I would love to do a better test then this.
Reason I took Openoffice is because it's known to be a large build (requires a 
lot of diskspace) and takes a long time.

If you know which other ebuilds might make for a better test, I will be happy 
to redo the test with those.

--
Joost

Re: [gentoo-user] Howzat!

[Alan McKinnon]

Apparently, though unproven, at 15:41 on Wednesday 20 April 2011, Joost 
Roeleveld did opine thusly:


> Alan,
> 
> I would love to do a better test then this.
> Reason I took Openoffice is because it's known to be a large build
> (requires a lot of diskspace) and takes a long time.
> 
> If you know which other ebuilds might make for a better test, I will be
> happy to redo the test with those.

Completely off the top of my head, I can't think of anything that extensively 
uses disk space while compiling. There is the configure step, and that hits 
the disk pretty hard, mostly reads. Building all of KDE would fit the bill for 
disk IO methinks.

However, you will also hit that infernal disk cache issue and render the test 
useless (it's all in RAM anyway after the first read!). So you would have to 
disable that.

I don't know how to disable disk caching :-(
Maybe you can't, the kernel is clearly designed to use the feature if it can 
at all. Maybe there's a knob in /proc you can twiddle.

Any kernel knob experts around?



-- 
alan dot mckinnon at gmail dot com

Re: [gentoo-user] Howzat!

[Mick]

[-- Attachment #1: Type: Text/Plain, Size: 1425 bytes --]

On Wednesday 20 April 2011 21:06:09 Alan McKinnon wrote:
> Apparently, though unproven, at 15:41 on Wednesday 20 April 2011, Joost
> 
> Roeleveld did opine thusly:
> > Alan,
> > 
> > I would love to do a better test then this.
> > Reason I took Openoffice is because it's known to be a large build
> > (requires a lot of diskspace) and takes a long time.
> > 
> > If you know which other ebuilds might make for a better test, I will be
> > happy to redo the test with those.
> 
> Completely off the top of my head, I can't think of anything that
> extensively uses disk space while compiling. There is the configure step,
> and that hits the disk pretty hard, mostly reads. Building all of KDE
> would fit the bill for disk IO methinks.
> 
> However, you will also hit that infernal disk cache issue and render the
> test useless (it's all in RAM anyway after the first read!). So you would
> have to disable that.
> 
> I don't know how to disable disk caching :-(
> Maybe you can't, the kernel is clearly designed to use the feature if it
> can at all. Maybe there's a knob in /proc you can twiddle.
> 
> Any kernel knob experts around?

No expert here of course, but as long as we are talking about disk buffers 
hdparm used to be able to enable/disable read aheads (A1/A0).  Not sure if 
sdparm does the same for SATA drives, or indeed if it contains any such 
option.
-- 
Regards,
Mick

[-- Attachment #2: This is a digitally signed message part. --]
[-- Type: application/pgp-signature, Size: 198 bytes --]

Re: [gentoo-user] Howzat!

[Peter Humphrey]

On Monday 18 April 2011 02:44:19 Dale wrote:

> How long does it take to open it when it gets done?  Seconds?  Minutes?

I was going to check, but now I can't starrtx on that box.

Because of the http-replicator problem I mentioned in another thread I decided 
to throw the book at it and ran "emerge -e world" - natively, not using the 
build host. It took something like three 24-hour days, and not only has it not 
fixed the problem, it seems to have introduced another one. I'm beginning to 
wonder about the disk, which has already had to be replaced under guarantee. Oh, 
and I forgot to say, Joshua, that this box has 2GB RAM.

I think I'm going to cop out and try Ubuntu server or something.

Has anyone here managed to get http-replicator running on a non-Gentoo box? It 
would be good to keep a distfiles repository somewhere on the LAN, and the box in 
question is supposed to be the LAN server, after all.

-- 
Rgds
Peter

Re: [gentoo-user] Howzat!

[Neil Bothwick]

[-- Attachment #1: Type: text/plain, Size: 502 bytes --]

On Mon, 18 Apr 2011 12:22:51 +0100, Peter Humphrey wrote:

> Has anyone here managed to get http-replicator running on a non-Gentoo
> box? It would be good to keep a distfiles repository somewhere on the
> LAN, and the box in question is supposed to be the LAN server, after
> all.

Why do you need http-replicator for that. Use an NFS share and set
DISTDIR to its mount point on each Gentoo box. It's far less complicated.


-- 
Neil Bothwick

If I agreed with you, we'd both be wrong.

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 198 bytes --]

Re: [gentoo-user] Howzat!

[Peter Humphrey]

On Monday 18 April 2011 13:44:45 Neil Bothwick wrote:
> On Mon, 18 Apr 2011 12:22:51 +0100, Peter Humphrey wrote:
> > Has anyone here managed to get http-replicator running on a non-Gentoo
> > box? It would be good to keep a distfiles repository somewhere on the
> > LAN, and the box in question is supposed to be the LAN server, after
> > all.
> 
> Why do you need http-replicator for that. Use an NFS share and set
> DISTDIR to its mount point on each Gentoo box. It's far less complicated.

Perhaps I'm being dense today, but I don't follow you. I was assuming the Atom 
box would hold the distfiles and the Gentoo boxes obtain them from it, one way or 
another. How are you assuming I'll fetch the files from Out There? I've tried 
relying on a Squid proxy, but often it doesn't keep the files I want - even after 
I've raised the file size limit to something like 80MB.

-- 
Rgds
Peter

Re: [gentoo-user] Howzat!

[Florian Philipp]

[-- Attachment #1: Type: text/plain, Size: 1626 bytes --]

Am 18.04.2011 16:35, schrieb Peter Humphrey:
> On Monday 18 April 2011 13:44:45 Neil Bothwick wrote:
>> On Mon, 18 Apr 2011 12:22:51 +0100, Peter Humphrey wrote:
>>> Has anyone here managed to get http-replicator running on a non-Gentoo
>>> box? It would be good to keep a distfiles repository somewhere on the
>>> LAN, and the box in question is supposed to be the LAN server, after
>>> all.
>>
>> Why do you need http-replicator for that. Use an NFS share and set
>> DISTDIR to its mount point on each Gentoo box. It's far less complicated.
> 
> Perhaps I'm being dense today, but I don't follow you. I was assuming the Atom 
> box would hold the distfiles and the Gentoo boxes obtain them from it, one way or 
> another. How are you assuming I'll fetch the files from Out There? I've tried 
> relying on a Squid proxy, but often it doesn't keep the files I want - even after 
> I've raised the file size limit to something like 80MB.
> 

In the setup Neil proposes, every client mounts an NFS share from your
server and uses that as its DISTDIR (where it stores the downloaded
files). For downloading files, the clients access the normal public
Gentoo mirrors but because all clients share the same directory, files
that some client has already downloaded are also available for every
other client. Therefore they will not be downloaded twice.

The only possible problem with this approach is that two clients might
attempt to download the same file at the same time. Just make sure to
start your updates at different times to avoid this.

Hope this makes it a bit clearer,
Florian Philipp


[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 262 bytes --]

Re: [gentoo-user] Howzat!

[Peter Humphrey]

On Monday 18 April 2011 15:51:32 Florian Philipp wrote:

> In the setup Neil proposes, every client mounts an NFS share from your
> server and uses that as its DISTDIR (where it stores the downloaded
> files). For downloading files, the clients access the normal public
> Gentoo mirrors but because all clients share the same directory, files
> that some client has already downloaded are also available for every
> other client. Therefore they will not be downloaded twice.
> 
> The only possible problem with this approach is that two clients might
> attempt to download the same file at the same time. Just make sure to
> start your updates at different times to avoid this.

Yes, that's how I understood it, but I was looking ahead to a time when the 
server might not be running Gentoo, in which case I wanted a mechanism to obtain 
the distfiles to put on the server.

-- 
Rgds
Peter

Re: [gentoo-user] Howzat!

[Peter Humphrey]

On Monday 18 April 2011 16:48:08 Peter Humphrey wrote:
> On Monday 18 April 2011 15:51:32 Florian Philipp wrote:
> > In the setup Neil proposes, every client mounts an NFS share from your
> > server and uses that as its DISTDIR (where it stores the downloaded
> > files). For downloading files, the clients access the normal public
> > Gentoo mirrors but because all clients share the same directory, files
> > that some client has already downloaded are also available for every
> > other client. Therefore they will not be downloaded twice.
> > 
> > The only possible problem with this approach is that two clients might
> > attempt to download the same file at the same time. Just make sure to
> > start your updates at different times to avoid this.
> 
> Yes, that's how I understood it, but I was looking ahead to a time when the
> server might not be running Gentoo, in which case I wanted a mechanism to
> obtain the distfiles to put on the server.

Never mind. The penny's finally dropped. Thanks to both.

-- 
Rgds
Peter

Re: [gentoo-user] Howzat!

[Neil Bothwick]

[-- Attachment #1: Type: text/plain, Size: 1116 bytes --]

On Mon, 18 Apr 2011 16:51:32 +0200, Florian Philipp wrote:

> In the setup Neil proposes, every client mounts an NFS share from your
> server and uses that as its DISTDIR (where it stores the downloaded
> files). For downloading files, the clients access the normal public
> Gentoo mirrors but because all clients share the same directory, files
> that some client has already downloaded are also available for every
> other client. Therefore they will not be downloaded twice.

Exactly.

> The only possible problem with this approach is that two clients might
> attempt to download the same file at the same time. Just make sure to
> start your updates at different times to avoid this.

I believe this is no longer an issue as portage now uses file locks over
NFS. I don't know if it does the same with CIFS shares, I've never tried
it.

Incidentally, my cron script that runs emerge --sync follows it with
emerge-uDNf world, so the files are already in $DISTDIR when I want to
update.


-- 
Neil Bothwick

"I am a Cub Ranger. We dib dib dib for the One. We dob dob dob for the
One."

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 198 bytes --]

Re: [gentoo-user] Howzat!

[Thanasis]

on 04/19/2011 12:56 AM Neil Bothwick wrote the following:
>
> Incidentally, my cron script that runs emerge --sync follows it with
> emerge-uDNf world, so the files are already in $DISTDIR when I want to
> update.
>
>
Can you post the script?

Re: [gentoo-user] Howzat!

[Joost Roeleveld]

On Tuesday 19 April 2011 08:34:06 Thanasis wrote:
> on 04/19/2011 12:56 AM Neil Bothwick wrote the following:
> > Incidentally, my cron script that runs emerge --sync follows it with
> > emerge-uDNf world, so the files are already in $DISTDIR when I want to
> > update.
> 
> Can you post the script?

My guess is that the script would be something like the following:
=====
#!/bin/sh
#
emerge --sync
emerge -uDNf world
=====

--
Joost

Re: [gentoo-user] Howzat!

[Neil Bothwick]

[-- Attachment #1: Type: text/plain, Size: 683 bytes --]

On Tue, 19 Apr 2011 08:57:07 +0200, Joost Roeleveld wrote:

> > > Incidentally, my cron script that runs emerge --sync follows it with
> > > emerge-uDNf world, so the files are already in $DISTDIR when I want
> > > to update.  
> > 
> > Can you post the script?  
> 
> My guess is that the script would be something like the following:
> =====
> #!/bin/sh
> #
> emerge --sync
> emerge -uDNf world
> =====

That's the gist of it, although it also emails the output from emerge
-pvDN world, so I can see what needs to be done. It runs a few other
bits, like glsa-check.


-- 
Neil Bothwick

Windows Error #05: Nonexisent error. This cannot really be happening

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 198 bytes --]

Re: [gentoo-user] Howzat!

[Thanasis]

on 04/19/2011 11:04 AM Neil Bothwick wrote the following:
> On Tue, 19 Apr 2011 08:57:07 +0200, Joost Roeleveld wrote:
>
>>>> Incidentally, my cron script that runs emerge --sync follows it with
>>>> emerge-uDNf world, so the files are already in $DISTDIR when I want
>>>> to update.  
>>> Can you post the script?  
>> My guess is that the script would be something like the following:
>> =====
>> #!/bin/sh
>> #
>> emerge --sync
>> emerge -uDNf world
>> =====
> That's the gist of it, although it also emails the output from emerge
> -pvDN world, so I can see what needs to be done. It runs a few other
> bits, like glsa-check.
>
>
Neil, do you mind posting it (after changing any private bits to generic)?

Re: [gentoo-user] Howzat!

[Neil Bothwick]

[-- Attachment #1.1: Type: text/plain, Size: 1884 bytes --]

On Tue, 19 Apr 2011 15:07:46 +0300, Thanasis wrote:

> > That's the gist of it, although it also emails the output from emerge
> > -pvDN world, so I can see what needs to be done. It runs a few other
> > bits, like glsa-check.
> >
> >  
> Neil, do you mind posting it (after changing any private bits to
> generic)?
> 
Here it is, as an attachment too to avoid screwing up the lines


#!/bin/bash

export PORTAGE_ECLASS_WARNING_ENABLE="0"
WORLD_MERGE="emerge --update --deep --reinstall changed-use --with-bdeps y --verbose @system @world"

[[ -d /etc/portage/presync.d ]] && for s in /etc/portage/presync.d/*[!~]; do
	$s || exit
	done

SYNCED="false"
if [[ ! -f /etc/portage/noautosync ]] && ! mount | grep -q ' /usr/portage type nfs '; then
	SYNCED=""
	for i in {0..12}; do
		echo "$(date): syncing portage"
		emerge --sync && SYNCED="true" && break
		sleep 5m
		done
	fi

if [[ "${SYNCED}" ]]; then
	if [[ "${SYNCED}" == "true" ]]; then
		echo "Portage synced" 1>&2
	else
		echo "Portage not synced" 1>&2
		fi
	TEMPFILE=$(mktemp)
	${WORLD_MERGE} --changelog --pretend >|${TEMPFILE}
	Mail -s "$(hostname): Updated packages" neil <${TEMPFILE}
	rm -f ${TEMPFILE}
else
	echo "Failure syncing portage" >&2
	fi

GLSAs=$(glsa-check --test all 2>/dev/null)
if [[ -n "${GLSAs}" ]]; then
	for GLSA in ${GLSAs}; do
		glsa-check --dump ${GLSA} | grep -B88 Unaffected
		echo -e "\n"
		done | Mail -s "GLSA warnings for $(hostname)" neil
	fi

if [[ -x "$(which eix-update 2>/dev/null)" ]]; then
	eix-update --quiet
	[[ -f /etc/portage/no-eix-remote ]] || LOCAL_LAYMAN=/mnt/portage/layman eix-remote -q update
	fi

for i in /etc/portage/postupdate.d/*[!~]; do
	[[ $i == ${i/\~} ]] && [[ -x $i ]] && $i
	done

exit 0



-- 
Neil Bothwick

Biology is the only science in which multiplication means the same thing
as division.

[-- Attachment #1.2: emerge-update --]
[-- Type: application/octet-stream, Size: 1319 bytes --]

#!/bin/bash

export PORTAGE_ECLASS_WARNING_ENABLE="0"
WORLD_MERGE="emerge --update --deep --reinstall changed-use --with-bdeps y --verbose @system @world"

[[ -d /etc/portage/presync.d ]] && for s in /etc/portage/presync.d/*[!~]; do
	$s || exit
	done

SYNCED="false"
if [[ ! -f /etc/portage/noautosync ]] && ! mount | grep -q ' /usr/portage type nfs '; then
	SYNCED=""
	for i in {0..12}; do
		echo "$(date): syncing portage"
		emerge --sync && SYNCED="true" && break
		sleep 5m
		done
	fi

if [[ "${SYNCED}" ]]; then
	if [[ "${SYNCED}" == "true" ]]; then
		echo "Portage synced" 1>&2
	else
		echo "Portage not synced" 1>&2
		fi
	TEMPFILE=$(mktemp)
	${WORLD_MERGE} --changelog --pretend >|${TEMPFILE}
	Mail -s "$(hostname): Updated packages" neil <${TEMPFILE}
	rm -f ${TEMPFILE}
else
	echo "Failure syncing portage" >&2
	fi

GLSAs=$(glsa-check --test all 2>/dev/null)
if [[ -n "${GLSAs}" ]]; then
	for GLSA in ${GLSAs}; do
		glsa-check --dump ${GLSA} | grep -B88 Unaffected
		echo -e "\n"
		done | Mail -s "GLSA warnings for $(hostname)" neil
	fi

if [[ -x "$(which eix-update 2>/dev/null)" ]]; then
	eix-update --quiet
	[[ -f /etc/portage/no-eix-remote ]] || LOCAL_LAYMAN=/mnt/portage/layman eix-remote -q update
	fi

for i in /etc/portage/postupdate.d/*[!~]; do
	[[ $i == ${i/\~} ]] && [[ -x $i ]] && $i
	done

exit 0

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 198 bytes --]

Re: [gentoo-user] Howzat!

[Thanasis]

Thanks! Can you add some comments, like what the directories presync.d
and postupdate.d are supposed to be ... as I don't have those.

I have postsync.d and don't know what is it about ... It contains a file
named q-reinitialize :

# cat /etc/portage/postsync.d/q-reinitialize
#!/bin/sh
[ -x /usr/bin/q ] && /usr/bin/q -r ${PORTAGE_QUIET:+-q}
:
#

Re: [gentoo-user] Howzat!

[Neil Bothwick]

[-- Attachment #1: Type: text/plain, Size: 954 bytes --]

On Thu, 21 Apr 2011 00:23:01 +0300, Thanasis wrote:

> Thanks! Can you add some comments, like what the directories presync.d
> and postupdate.d are supposed to be ... as I don't have those.
> 
> I have postsync.d and don't know what is it about ... It contains a file
> named q-reinitialize :

Scripts/programs in postsync.d are executed by portage after a sync. The
other two are ones I added, before portage had postsync support, to run
anything I wanted before and after a sync. The only thing  used them for
now is to turn rsyncd off and on on my server, to prevent other machines
syncing from it while its portage tree is being updated.

BTW - I read the list, no need to send me an extra copy of the mail
directly.


-- 
Neil Bothwick

Hello, this is an extension to the famous signature virus, called spymail.
Could you please copy me into your signature and send back what you were
doing last night between 10pm and 3am?

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 198 bytes --]

Re: [gentoo-user] Howzat!

[Thanasis]

on 04/21/2011 01:01 AM Neil Bothwick wrote the following:
> On Thu, 21 Apr 2011 00:23:01 +0300, Thanasis wrote:
>
>> Thanks! Can you add some comments, like what the directories presync.d
>> and postupdate.d are supposed to be ... as I don't have those.
>>
>> I have postsync.d and don't know what is it about ... It contains a file
>> named q-reinitialize :
>
> Scripts/programs in postsync.d are executed by portage after a sync. The
> other two are ones I added, before portage had postsync support, to run
> anything I wanted before and after a sync. The only thing  used them for
> now is to turn rsyncd off and on on my server, to prevent other machines
> syncing from it while its portage tree is being updated.
>
> BTW - I read the list, no need to send me an extra copy of the mail
> directly.
So, I understand that normally (in my case) there is no need for these
presync.d and postupdate.d directories, right?
The script could be stripped from these like so:
###########################################################################

#!/bin/bash

export PORTAGE_ECLASS_WARNING_ENABLE="0"
WORLD_MERGE="emerge --update --deep --reinstall changed-use --with-bdeps
y --verbose @system @world"

SYNCED=""
for i in {0..12}; do
    echo "$(date): syncing portage"
    emerge --sync && SYNCED="true" && break
    sleep 5m
done

if [[ "${SYNCED}" ]]; then
    if [[ "${SYNCED}" == "true" ]]; then
        echo "Portage synced" 1>&2
    else
        echo "Portage not synced" 1>&2
    fi
    TEMPFILE=$(mktemp)
    ${WORLD_MERGE} --changelog --pretend >|${TEMPFILE}
    Mail -s "$(hostname): Updated packages" neil <${TEMPFILE}
    rm -f ${TEMPFILE}
else
    echo "Failure syncing portage" >&2
fi

GLSAs=$(glsa-check --test all 2>/dev/null)
if [[ -n "${GLSAs}" ]]; then
    for GLSA in ${GLSAs}; do
        glsa-check --dump ${GLSA} | grep -B88 Unaffected
        echo -e "\n"
    done | Mail -s "GLSA warnings for $(hostname)" neil
fi

if [[ -x "$(which eix-update 2>/dev/null)" ]]; then
    eix-update --quiet
    [[ -f /etc/portage/no-eix-remote ]] ||
LOCAL_LAYMAN=/mnt/portage/layman eix-remote -q update
fi

exit 0
###########################################################################

Is that correct?

Re: [gentoo-user] Howzat!

[Neil Bothwick]

[-- Attachment #1: Type: text/plain, Size: 567 bytes --]

On Thu, 21 Apr 2011 10:44:27 +0300, Thanasis wrote:

> So, I understand that normally (in my case) there is no need for these
> presync.d and postupdate.d directories, right?
> The script could be stripped from these like so:

Correct.

Actually, I've just noticed an inconsistency in the script, it checks for
the existence of presync.d before executing any scripts in it, but does
not do the same for postupdate.d.


-- 
Neil Bothwick

The law of Probability Dispersal decrees that whatever it is that hits
the fan will not be evenly distributed.

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 198 bytes --]

Re: [gentoo-user] Howzat!

[Thanasis]

on 04/21/2011 11:03 AM Neil Bothwick wrote the following:
> On Thu, 21 Apr 2011 10:44:27 +0300, Thanasis wrote:
>
>> So, I understand that normally (in my case) there is no need for these
>> presync.d and postupdate.d directories, right?
>> The script could be stripped from these like so:
> Correct.
>
> Actually, I've just noticed an inconsistency in the script, it checks for
> the existence of presync.d before executing any scripts in it, but does
> not do the same for postupdate.d.
Thanks.

Re: [gentoo-user] Howzat!

[Thanasis]

on 04/21/2011 11:03 AM Neil Bothwick wrote the following:
> On Thu, 21 Apr 2011 10:44:27 +0300, Thanasis wrote:
>
>> So, I understand that normally (in my case) there is no need for these
>> presync.d and postupdate.d directories, right?
>> The script could be stripped from these like so:
>
> Correct.
When i run it, I get a mail with an attachment named attachment.bin
which is actually a text file. How can I make it appear inline (in the
message body)?

Re: [gentoo-user] Howzat!

[Neil Bothwick]

[-- Attachment #1: Type: text/plain, Size: 606 bytes --]

On Thu, 21 Apr 2011 13:57:40 +0300, Thanasis wrote:

> When i run it, I get a mail with an attachment named attachment.bin
> which is actually a text file. How can I make it appear inline (in the
> message body)?

I'm guessing you have a different variant of Mail to me, because I get
the text inline. Check the man page for your Mail/mail/nail program to
find the correct syntax.

% qfile -v Mail
mail-client/mailx-8.1.2.20050715-r3 (/bin/Mail)

is what I use


-- 
Neil Bothwick

The trouble with doing something right the first time is that nobody
appreciates how difficult it was.

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 198 bytes --]

Re: [gentoo-user] Howzat!

[Thanasis]

on 04/21/2011 04:26 PM Neil Bothwick wrote the following:
> On Thu, 21 Apr 2011 13:57:40 +0300, Thanasis wrote:
>
>> When i run it, I get a mail with an attachment named attachment.bin
>> which is actually a text file. How can I make it appear inline (in the
>> message body)?
> I'm guessing you have a different variant of Mail to me, because I get
> the text inline. Check the man page for your Mail/mail/nail program to
> find the correct syntax.
>
> % qfile -v Mail
> mail-client/mailx-8.1.2.20050715-r3 (/bin/Mail)
>
> is what I use
>
>
# qfile -v Mail
mail-client/nail-12.4 (/usr/bin/Mail)

Re: [gentoo-user] Howzat!

[Neil Bothwick]

[-- Attachment #1: Type: text/plain, Size: 452 bytes --]

On Thu, 21 Apr 2011 17:45:14 +0300, Thanasis wrote:

> > % qfile -v Mail
> > mail-client/mailx-8.1.2.20050715-r3 (/bin/Mail)
> >
> > is what I use
> >
> >  
> # qfile -v Mail
> mail-client/nail-12.4 (/usr/bin/Mail)

There you go then, it's man page time :)

Although I thought nail's code had been merged into mailx and nail
deprecated some time ago.


-- 
Neil Bothwick

Better to understand a little than to misunderstand a lot.

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 198 bytes --]

Re: [gentoo-user] Howzat!

[Thanasis]

on 04/22/2011 01:09 AM Neil Bothwick wrote the following:
> On Thu, 21 Apr 2011 17:45:14 +0300, Thanasis wrote:
>
>>> % qfile -v Mail
>>> mail-client/mailx-8.1.2.20050715-r3 (/bin/Mail)
>>>
>>> is what I use
>>>
>>>  
>> # qfile -v Mail
>> mail-client/nail-12.4 (/usr/bin/Mail)
>
> There you go then, it's man page time :)
http://linux.die.net/man/1/nail
Do you see anything relevant in the man page?
>
> Although I thought nail's code had been merged into mailx and nail
> deprecated some time ago.
FWIW, here are the files of nail package:

# equery f nail
[ Searching for packages matching nail... ]
* Contents of mail-client/nail-12.4:
/bin
/bin/mail -> /usr/bin/mailx
/etc
/etc/nail.rc
/usr
/usr/bin
/usr/bin/Mail -> /usr/bin/mailx
/usr/bin/mail -> /usr/bin/mailx
/usr/bin/mailx
/usr/share
/usr/share/doc
/usr/share/doc/nail-12.4
/usr/share/doc/nail-12.4/AUTHORS.bz2
/usr/share/doc/nail-12.4/README.bz2
/usr/share/man
/usr/share/man/man1
/usr/share/man/man1/mailx.1.bz2

Re: [gentoo-user] Howzat!

[Neil Bothwick]

[-- Attachment #1: Type: text/plain, Size: 324 bytes --]

On Fri, 22 Apr 2011 08:05:41 +0300, Thanasis wrote:

> > There you go then, it's man page time :)  
> http://linux.die.net/man/1/nail
> Do you see anything relevant in the man page?

No, but then I don't need to look at it :)


-- 
Neil Bothwick

Some cause happiness wherever they go. Others whenever they go.

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 198 bytes --]

Re: [gentoo-user] Howzat!

[Thanasis]

on 04/22/2011 10:14 AM Neil Bothwick wrote the following:
> On Fri, 22 Apr 2011 08:05:41 +0300, Thanasis wrote:
>
>>> There you go then, it's man page time :)  
>> http://linux.die.net/man/1/nail
>> Do you see anything relevant in the man page?
> No, but then I don't need to look at it :)
>
Yea, I don't think it's caused by nail.

Re: [gentoo-user] Howzat!

[Neil Bothwick]

[-- Attachment #1: Type: text/plain, Size: 622 bytes --]

On Fri, 22 Apr 2011 11:12:39 +0300, Thanasis wrote:

> >>> There you go then, it's man page time :)    
> >> http://linux.die.net/man/1/nail
> >> Do you see anything relevant in the man page?  
> > No, but then I don't need to look at it :)
> >  
> Yea, I don't think it's caused by nail.

Why not? It's the obvious choice. Have you tried using nail's Mail from
the command line to see if it works as you expect?


-- 
Neil Bothwick

- How many surrealists does it take to change a light bulb?
- Two: one to hold the giraffe, the other to fill the bathtub with
  lots of brightly colored machine tools.

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 198 bytes --]

Re: [gentoo-user] Howzat!

[Thanasis]

on 04/22/2011 04:00 PM Neil Bothwick wrote the following:
> On Fri, 22 Apr 2011 11:12:39 +0300, Thanasis wrote:
>
>>>>> There you go then, it's man page time :)    
>>>> http://linux.die.net/man/1/nail
>>>> Do you see anything relevant in the man page?  
>>> No, but then I don't need to look at it :)
>>>  
>> Yea, I don't think it's caused by nail.
>
> Why not? It's the obvious choice. Have you tried using nail's Mail from
> the command line to see if it works as you expect?
>
>
I have been using nail because it has the option to set the smtp server
to use (as an environment variable. If the smtp variable is set, a SMTP
connection to the server specified by the value of this variable is used
) and also set the [-r from-addr] option.
Can I do that with mail-client/mailx ?

Re: [gentoo-user] Howzat!

[Neil Bothwick]

[-- Attachment #1: Type: text/plain, Size: 793 bytes --]

On Fri, 22 Apr 2011 18:26:09 +0300, Thanasis wrote:

> > Why not? It's the obvious choice. Have you tried using nail's Mail
> > from the command line to see if it works as you expect?

> I have been using nail because it has the option to set the smtp server
> to use (as an environment variable. If the smtp variable is set, a SMTP
> connection to the server specified by the value of this variable is used
> ) and also set the [-r from-addr] option.
> Can I do that with mail-client/mailx ?

Not from a quick glance at the man page. But you don't need to change
your mail program, just change the invocation in the script to match your
program.


-- 
Neil Bothwick

"I'm not crying victim, but I am stating that a lot of spammers
are genuine scumbags." -Sanford Wallace

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 198 bytes --]

Re: [gentoo-user] Howzat!

[Mark Knecht]

On Wed, Apr 20, 2011 at 6:33 AM, Neil Bothwick <neil@digimed.co.uk> wrote:
<SNIP>
> Here it is, as an attachment too to avoid screwing up the lines
>
>
> #!/bin/bash
>
> export PORTAGE_ECLASS_WARNING_ENABLE="0"
> WORLD_MERGE="emerge --update --deep --reinstall changed-use --with-bdeps y --verbose @system @world"
>

Hi Neil,

I like the script. Thanks for posting it.

 I guess I've lost track. Is @system not a part of @world or is that
done for some other reason? The emerge man page says 'world
encompasses both the selected and system sets.'

Thanks,
Mark

Re: [gentoo-user] Howzat!

[Neil Bothwick]

[-- Attachment #1: Type: text/plain, Size: 574 bytes --]

On Thu, 21 Apr 2011 06:41:08 -0700, Mark Knecht wrote:

> > WORLD_MERGE="emerge --update --deep --reinstall changed-use
> > --with-bdeps y --verbose @system @world" 

>  I guess I've lost track. Is @system not a part of @world or is that
> done for some other reason? The emerge man page says 'world
> encompasses both the selected and system sets.'

It is, but at the time I added that to the script, it wasn't the case.
The script needs updating, it hasn't been touched for over two years.


-- 
Neil Bothwick

Would a fly without wings be called a walk?

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 198 bytes --]

Re: [gentoo-user] Howzat!

[Mark Knecht]

On Thu, Apr 21, 2011 at 3:42 PM, Neil Bothwick <neil@digimed.co.uk> wrote:
> On Thu, 21 Apr 2011 06:41:08 -0700, Mark Knecht wrote:
>
>> > WORLD_MERGE="emerge --update --deep --reinstall changed-use
>> > --with-bdeps y --verbose @system @world"
>
>>  I guess I've lost track. Is @system not a part of @world or is that
>> done for some other reason? The emerge man page says 'world
>> encompasses both the selected and system sets.'
>
> It is, but at the time I added that to the script, it wasn't the case.
> The script needs updating, it hasn't been touched for over two years.
>
>
> --
> Neil Bothwick

Easily explained. Thanks!
-Mark

Re: [gentoo-user] Howzat!

[Joost Roeleveld]

On Tuesday 19 April 2011 09:04:18 Neil Bothwick wrote:
> On Tue, 19 Apr 2011 08:57:07 +0200, Joost Roeleveld wrote:
> > > > Incidentally, my cron script that runs emerge --sync follows it
> > > > with
> > > > emerge-uDNf world, so the files are already in $DISTDIR when I
> > > > want
> > > > to update.
> > > 
> > > Can you post the script?
> > 
> > My guess is that the script would be something like the following:
> > =====
> > #!/bin/sh
> > #
> > emerge --sync
> > emerge -uDNf world
> > =====
> 
> That's the gist of it, although it also emails the output from emerge
> -pvDN world, so I can see what needs to be done. It runs a few other
> bits, like glsa-check.

Like the following?
=====
#!/bin/sh
#
/bin/mkdir /tmp/ABBAABBA_portage_sync

/usr/bin/layman -S

/usr/bin/eix-sync

/usr/bin/glsa-check -d $(/usr/bin/glsa-check -t all) > 
/tmp/ABBAABBA_portage_sync/portage_sync_glsa.log

/bin/mail -e -s "Portage Sync [GLSA-log]" memyselfandi@example.org < 
/tmp/ABBAABBA_portage_sync/portage_sync_glsa.log

/bin/rm /tmp/ABBAABBA_portage_sync/portage_sync_glsa.log

/usr/bin/emerge -pvauD --newuse world > 
/tmp/ABBAABBA_portage_sync/portage_sync_emerge.log

/bin/mail -e -s "Portage Sync [EMERGE-list]" memyselfandi@example.org < 
/tmp/ABBAABBA_portage_sync/portage_sync_emerge.log

/bin/rm /tmp/ABBAABBA_portage_sync/portage_sync_emerge.log

/bin/rmdir /tmp/ABBAABBA_portage_sync
=====
In the above script, I put an empty line between each command for readability.

This is what I run on my system.

--
Joost

Re: [gentoo-user] Howzat!

[Thanasis]

on 04/19/2011 03:40 PM Joost Roeleveld wrote the following:
> On Tuesday 19 April 2011 09:04:18 Neil Bothwick wrote:
>> On Tue, 19 Apr 2011 08:57:07 +0200, Joost Roeleveld wrote:
>>>>> Incidentally, my cron script that runs emerge --sync follows it
>>>>> with
>>>>> emerge-uDNf world, so the files are already in $DISTDIR when I
>>>>> want
>>>>> to update.
>>>> Can you post the script?
>>> My guess is that the script would be something like the following:
>>> =====
>>> #!/bin/sh
>>> #
>>> emerge --sync
>>> emerge -uDNf world
>>> =====
>> That's the gist of it, although it also emails the output from emerge
>> -pvDN world, so I can see what needs to be done. It runs a few other
>> bits, like glsa-check.
> Like the following?
> =====
> #!/bin/sh
> #
> /bin/mkdir /tmp/ABBAABBA_portage_sync
>
> /usr/bin/layman -S
>
> /usr/bin/eix-sync
>
> /usr/bin/glsa-check -d $(/usr/bin/glsa-check -t all) > 
> /tmp/ABBAABBA_portage_sync/portage_sync_glsa.log
>
> /bin/mail -e -s "Portage Sync [GLSA-log]" memyselfandi@example.org < 
> /tmp/ABBAABBA_portage_sync/portage_sync_glsa.log
>
> /bin/rm /tmp/ABBAABBA_portage_sync/portage_sync_glsa.log
>
> /usr/bin/emerge -pvauD --newuse world > 
> /tmp/ABBAABBA_portage_sync/portage_sync_emerge.log
>
> /bin/mail -e -s "Portage Sync [EMERGE-list]" memyselfandi@example.org < 
> /tmp/ABBAABBA_portage_sync/portage_sync_emerge.log
>
> /bin/rm /tmp/ABBAABBA_portage_sync/portage_sync_emerge.log
>
> /bin/rmdir /tmp/ABBAABBA_portage_sync
> =====
> In the above script, I put an empty line between each command for readability.
>
> This is what I run on my system.
>
> --
> Joost
Joost, Thanks!
:)