[gentoo-dev] Re: [gentoo-dev-announce] Removing profiles/use.local.desc file from CVS on 2011-02-11

[gentoo-dev] Re: [gentoo-dev-announce] Removing profiles/use.local.desc file from CVS on 2011-02-11

[Luca Longinotti]

On Fri, 04 Feb 2011 13:50:20 -0600
Jeremy Olexa <darkside@gentoo.org> wrote:

>  Hello,
> 
>  The CVS->RSYNC service has moved hosts and now we generate the 
>  use.local.desc file via egencache.

Hi, could any of this cause a (kinda) full resync from the mirrors?
Because an emerge --sync I'm doing now is syncing up _all_ files in the
tree and taking ages on my laptop, on the other hand the emerge --sync
I did yesterday at around 1400 CET just synced the changed files, as
usual... I also tried multiple mirrors, thinking maybe one of them was
the problem, but they all happily continued syncing everything.
At the end of the sync, Portage also processed all the update-files,
which too is strange. All the modification times of the files seem to
have been updated... The date on my system is set correctly, so I can't
really explain why this would suddenly happen, as between yesterday and
today I didn't update Portage or rsync.
-- 
Best regards, Luca Longinotti aka chtekk.

LongiTEKK Networks Admin: chtekk@longitekk.com
TILUG Member: chtekk@tilug.ch

[gentoo-dev] Re: [gentoo-dev-announce] Removing profiles/use.local.desc file from CVS on 2011-02-11

[Ryan Hill]

[-- Attachment #1: Type: text/plain, Size: 1382 bytes --]

On Sat, 5 Feb 2011 18:04:03 +0100
Luca Longinotti <chtekk@longitekk.com> wrote:

> On Fri, 04 Feb 2011 13:50:20 -0600
> Jeremy Olexa <darkside@gentoo.org> wrote:
> 
> >  Hello,
> > 
> >  The CVS->RSYNC service has moved hosts and now we generate the 
> >  use.local.desc file via egencache.
> 
> Hi, could any of this cause a (kinda) full resync from the mirrors?
> Because an emerge --sync I'm doing now is syncing up _all_ files in the
> tree and taking ages on my laptop, on the other hand the emerge --sync
> I did yesterday at around 1400 CET just synced the changed files, as
> usual... I also tried multiple mirrors, thinking maybe one of them was
> the problem, but they all happily continued syncing everything.
> At the end of the sync, Portage also processed all the update-files,
> which too is strange. All the modification times of the files seem to
> have been updated... The date on my system is set correctly, so I can't
> really explain why this would suddenly happen, as between yesterday and
> today I didn't update Portage or rsync.

I've had this happen twice in a row, last night and today.


-- 
fonts, gcc-porting,                  it makes no sense how it makes no sense
toolchain, wxwidgets                           but i'll take it free anytime
@ gentoo.org                EFFD 380E 047A 4B51 D2BD C64F 8AA8 8346 F9A4 0662

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 198 bytes --]

Re: [gentoo-dev] Re: [gentoo-dev-announce] Removing profiles/use.local.desc file from CVS on 2011-02-11

[Zac Medico]

On 02/05/2011 02:31 PM, Ryan Hill wrote:
> On Sat, 5 Feb 2011 18:04:03 +0100
> Luca Longinotti <chtekk@longitekk.com> wrote:
> 
>> On Fri, 04 Feb 2011 13:50:20 -0600
>> Jeremy Olexa <darkside@gentoo.org> wrote:
>>
>>>  Hello,
>>>
>>>  The CVS->RSYNC service has moved hosts and now we generate the 
>>>  use.local.desc file via egencache.
>>
>> Hi, could any of this cause a (kinda) full resync from the mirrors?
>> Because an emerge --sync I'm doing now is syncing up _all_ files in the
>> tree and taking ages on my laptop, on the other hand the emerge --sync
>> I did yesterday at around 1400 CET just synced the changed files, as
>> usual... I also tried multiple mirrors, thinking maybe one of them was
>> the problem, but they all happily continued syncing everything.
>> At the end of the sync, Portage also processed all the update-files,
>> which too is strange. All the modification times of the files seem to
>> have been updated... The date on my system is set correctly, so I can't
>> really explain why this would suddenly happen, as between yesterday and
>> today I didn't update Portage or rsync.
> 
> I've had this happen twice in a row, last night and today.

The sizes of the snapshot deltas [1] also seem to show an unusually big
change:

 snapshot-20110201-20110202.patch.bz2        02-Feb-2011 19:57  163K
 snapshot-20110202-20110203.patch.bz2        03-Feb-2011 19:57  113K
 snapshot-20110203-20110204.patch.bz2        04-Feb-2011 19:53  1.3M

I guess that something about the master rsync mirror has changed. It
used to be osprey.gentoo.org, but the size of the
snapshot-20110203-20110204.patch.bz2 file on osprey is only 107213 bytes.

[1] http://distfiles.gentoo.org/snapshots/deltas/
-- 
Thanks,
Zac

Re: [gentoo-dev] Re: [gentoo-dev-announce] Removing profiles/use.local.desc file from CVS on 2011-02-11

[Jeremy Olexa]

On 02/05/2011 08:34 PM, Zac Medico wrote:
> On 02/05/2011 02:31 PM, Ryan Hill wrote:
>> On Sat, 5 Feb 2011 18:04:03 +0100
>> Luca Longinotti<chtekk@longitekk.com>  wrote:

>>> Hi, could any of this cause a (kinda) full resync from the mirrors?
>>> Because an emerge --sync I'm doing now is syncing up _all_ files in the
>>> tree and taking ages on my laptop, on the other hand the emerge --sync
>>> I did yesterday at around 1400 CET just synced the changed files, as
>>> usual... I also tried multiple mirrors, thinking maybe one of them was
>>> the problem, but they all happily continued syncing everything.
>>> At the end of the sync, Portage also processed all the update-files,
>>> which too is strange. All the modification times of the files seem to
>>> have been updated... The date on my system is set correctly, so I can't
>>> really explain why this would suddenly happen, as between yesterday and
>>> today I didn't update Portage or rsync.
>>
>> I've had this happen twice in a row, last night and today.
>
> The sizes of the snapshot deltas [1] also seem to show an unusually big
> change:
>
>   snapshot-20110201-20110202.patch.bz2        02-Feb-2011 19:57  163K
>   snapshot-20110202-20110203.patch.bz2        03-Feb-2011 19:57  113K
>   snapshot-20110203-20110204.patch.bz2        04-Feb-2011 19:53  1.3M
>
> I guess that something about the master rsync mirror has changed. It
> used to be osprey.gentoo.org, but the size of the
> snapshot-20110203-20110204.patch.bz2 file on osprey is only 107213 bytes.

I can imagine that the first delta has a large changeset because of the 
process involved. However, it looks normal now, again. It is just part 
of the upgrade path of changing the service to a new host [that does 
things ever so slightly different].

120K	snapshot-20110202-20110203.patch.bz2
1.4M	snapshot-20110203-20110204.patch.bz2
260K	snapshot-20110204-20110205.patch.bz2
124K	snapshot-20110205-20110206.patch.bz2

As for the "re-syncing all files thing" - I can't reproduce that, though 
I've seen multiple reports. Did it settle down now? (I assume so)

-Jeremy

Re: [gentoo-dev] Re: [gentoo-dev-announce] Removing profiles/use.local.desc file from CVS on 2011-02-11

[Gilles Dartiguelongue]

Le dimanche 06 février 2011 à 23:52 -0600, Jeremy Olexa a écrit :
> As for the "re-syncing all files thing" - I can't reproduce that, though 
> I've seen multiple reports. Did it settle down now? (I assume so)
> 
> -Jeremy
> 

synced my laptop this morning around 11AM UTC and was hit by this
mysterious "resyncs whole tree" problem.

-- 
Gilles Dartiguelongue <eva@gentoo.org>
Gentoo

Re: [gentoo-dev] Re: [gentoo-dev-announce] Removing profiles/use.local.desc file from CVS on 2011-02-11

[Luca Longinotti]

On Mon, 07 Feb 2011 13:47:55 +0100
Gilles Dartiguelongue <eva@gentoo.org> wrote:

> Le dimanche 06 février 2011 à 23:52 -0600, Jeremy Olexa a écrit :
> > As for the "re-syncing all files thing" - I can't reproduce that,
> > though I've seen multiple reports. Did it settle down now? (I
> > assume so)
> > 
> > -Jeremy
> > 
> 
> synced my laptop this morning around 11AM UTC and was hit by this
> mysterious "resyncs whole tree" problem.
> 

I'm still seeing this too on the _first_ sync on a system after the 4th
of February. Subsequent syncs exhibit normal behavior and speed.
It's basically a one-time-per-system thing, at least that's what I see.
-- 
Best regards, Luca Longinotti aka chtekk.

LongiTEKK Networks Admin: chtekk@longitekk.com
TILUG Member: chtekk@tilug.ch

[gentoo-dev] Re: [gentoo-dev-announce] Removing profiles/use.local.desc file from CVS on 2011-02-11

[Ryan Hill]

[-- Attachment #1: Type: text/plain, Size: 1129 bytes --]

On Mon, 7 Feb 2011 16:09:30 +0100
Luca Longinotti <chtekk@longitekk.com> wrote:

> On Mon, 07 Feb 2011 13:47:55 +0100
> Gilles Dartiguelongue <eva@gentoo.org> wrote:
> 
> > Le dimanche 06 février 2011 à 23:52 -0600, Jeremy Olexa a écrit :
> > > As for the "re-syncing all files thing" - I can't reproduce that,
> > > though I've seen multiple reports. Did it settle down now? (I
> > > assume so)
> > > 
> > > -Jeremy
> > > 
> > 
> > synced my laptop this morning around 11AM UTC and was hit by this
> > mysterious "resyncs whole tree" problem.
> > 
> 
> I'm still seeing this too on the _first_ sync on a system after the 4th
> of February. Subsequent syncs exhibit normal behavior and speed.
> It's basically a one-time-per-system thing, at least that's what I see.

Every sync I've done on my laptop so far has done a full sync. Last one was
two minutes ago.


-- 
fonts, gcc-porting,                  it makes no sense how it makes no sense
toolchain, wxwidgets                           but i'll take it free anytime
@ gentoo.org                EFFD 380E 047A 4B51 D2BD C64F 8AA8 8346 F9A4 0662

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 198 bytes --]

[gentoo-dev] Re: [gentoo-dev-announce] Removing profiles/use.local.desc file from CVS on 2011-02-11

[Jeremy Olexa]

On 02/04/2011 01:50 PM, Jeremy Olexa wrote:
> Hello,
>
> The CVS->RSYNC service has moved hosts and now we generate the
> use.local.desc file via egencache. As such, there is no need for this
> file to be in CVS anymore and will be removed on 2011-02-11. This email
> is meant as a heads up as I am not sure about everyone's individual
> setups or what repercussions there might be.
>
> -Jeremy
>

This file is now removed from CVS.

+  12 Feb 2011; Robin H. Johnson <robbat2@gentoo.org> -use.local.desc:
+  use.local.desc is now generated purely in the rsync tier and is no longer
+  required in CVS. If you were looking to change it, you should be using
+  metadata.xml instead.

If you've been following the thread, you've seen people complain that 
emerge --sync is re-syncing a bunch of files. I've confirmed with 
multiple people that the syncing is normal again, it was just a one time 
hit. I am sorry for that happening, but we now have greater reliability 
in the CVS->RSYNC service. :)

Thanks,
Jeremy