[gentoo-user] Emerge --sync fails on excluded stuff

[gentoo-user] Emerge --sync fails on excluded stuff

[Walter Dnes]

[-- Attachment #1: Type: text/plain, Size: 1062 bytes --]

  I have a 10 year old Core2 as an emergency backup machine.  Let's just
say it's not as fast as modern machines.  To speed up "emerge --sync". I
put a bunch of unneeded stuff in an "rsync_excludes" file (attached).
Now "emerge --sync" has started failing, because it obviously can't
verify the missing directories/files.  Here's the error message...

 * Manifest timestamp: 2018-10-22 13:08:41 UTC
 * Valid OpenPGP signature found:
 * - primary key: DCD05B71EAB94199527F44ACDB6B8C1F96D8BF6D
 * - subkey: E1D6ABB63BFCFB4BA02FDF1CEC590EEAC9189250
 * - timestamp: 2018-10-22 13:08:41 UTC
 * Verifying /usr/portage/.tmp-unverified-download-quarantine ...!!! Manifest verification failed:
Manifest mismatch for app-dicts/Manifest.gz
  __exists__: expected: True, have: False


  app_dicts is the first entry in my "rsync_excludes", and I assume that
all the other entries would be problematic too.  How do I turn off this
bleeping "helpful" verification feature?

-- 
Walter Dnes <waltdnes@waltdnes.org>
I don't run "desktop environments"; I run useful applications

[-- Attachment #2: rsync_excludes.gz --]
[-- Type: application/octet-stream, Size: 476 bytes --]

Re: [gentoo-user] Emerge --sync fails on excluded stuff

[Kai Peter]

On 2018-10-22 16:26, Walter Dnes wrote:
> I have a 10 year old Core2 as an emergency backup machine.  Let's just
> say it's not as fast as modern machines.  To speed up "emerge --sync". 
> I
> put a bunch of unneeded stuff in an "rsync_excludes" file (attached).
> Now "emerge --sync" has started failing, because it obviously can't
> verify the missing directories/files.  Here's the error message...
> 
>  * Manifest timestamp: 2018-10-22 13:08:41 UTC
>  * Valid OpenPGP signature found:
>  * - primary key: DCD05B71EAB94199527F44ACDB6B8C1F96D8BF6D
>  * - subkey: E1D6ABB63BFCFB4BA02FDF1CEC590EEAC9189250
>  * - timestamp: 2018-10-22 13:08:41 UTC
>  * Verifying /usr/portage/.tmp-unverified-download-quarantine ...!!!
> Manifest verification failed:
> Manifest mismatch for app-dicts/Manifest.gz
>   __exists__: expected: True, have: False
> 
> 
>   app_dicts is the first entry in my "rsync_excludes", and I assume 
> that
> all the other entries would be problematic too.  How do I turn off this
> bleeping "helpful" verification feature?

It fails at the first exclude entry always - I wrote this already. The 
whole manifest verification is buggy like hell - not well deliberated. 
Even if you sync from a local mirror it loads the key from the default 
key server. My suggestion is to disable it if you don't stay with the 
default.

-- 
Sent with eQmail-1.11 beta - a fork of djb's famous qmail

[gentoo-user] [SOLVED] Emerge --sync fails on excluded stuff

[Walter Dnes]

On Mon, Oct 22, 2018 at 06:11:24PM +0200, Kai Peter wrote

  After some Google searching, I re-emerged portage with "-rsync-verify"
flag in package.use and it works OK now.

-- 
Walter Dnes <waltdnes@waltdnes.org>
I don't run "desktop environments"; I run useful applications

Re: [gentoo-user] [SOLVED] Emerge --sync fails on excluded stuff

[Neil Bothwick]

[-- Attachment #1: Type: text/plain, Size: 433 bytes --]

On Mon, 22 Oct 2018 13:36:55 -0400, Walter Dnes wrote:

>   After some Google searching, I re-emerged portage with "-rsync-verify"
> flag in package.use and it works OK now.

You can also add "sync-rsync-verify-metamanifest = no" to the gentoo
entry in /etc/portage/repos.conf - I use this when syncing from a local
mirror.


-- 
Neil Bothwick

If man ruled the world:
Daisy Duke shorts would never go out of fashion.

[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 833 bytes --]

Re: [gentoo-user] [SOLVED] Emerge --sync fails on excluded stuff

[Walter Dnes]

On Mon, Oct 22, 2018 at 11:21:02PM +0100, Neil Bothwick wrote

> You can also add "sync-rsync-verify-metamanifest = no" to the gentoo
> entry in /etc/portage/repos.conf - I use this when syncing from a local
> mirror.

  That looks easier, but... /etc/portage/repos.conf is a directory on my
system.

-- 
Walter Dnes <waltdnes@waltdnes.org>
I don't run "desktop environments"; I run useful applications

Re: [gentoo-user] [SOLVED] Emerge --sync fails on excluded stuff

[Dale]

Walter Dnes wrote:
> On Mon, Oct 22, 2018 at 11:21:02PM +0100, Neil Bothwick wrote
>
>> You can also add "sync-rsync-verify-metamanifest = no" to the gentoo
>> entry in /etc/portage/repos.conf - I use this when syncing from a local
>> mirror.
>   That looks easier, but... /etc/portage/repos.conf is a directory on my
> system.
>


Mine is to.  I think doing it like this would work.  I changed mine
after the last post BUT I have not tried to sync yet.  I'm pretty sure
it will work tho. 



root@fireball / # cat /etc/portage/repos.conf/gentoo.conf
[DEFAULT]
main-repo = gentoo

[gentoo]
location = /var/cache/portage/tree
sync-type = rsync
sync-uri = rsync://rsync26.us.gentoo.org/gentoo-portage
sync-rsync-verify-metamanifest = no
root@fireball / #



Dale

:-)  :-) 

Re: [gentoo-user] [SOLVED] Emerge --sync fails on excluded stuff

[Neil Bothwick]

[-- Attachment #1: Type: text/plain, Size: 628 bytes --]

On Mon, 22 Oct 2018 23:05:17 -0400, Walter Dnes wrote:

> > You can also add "sync-rsync-verify-metamanifest = no" to the gentoo
> > entry in /etc/portage/repos.conf - I use this when syncing from a
> > local mirror.  
> 
>   That looks easier, but... /etc/portage/repos.conf is a directory on my
> system.

That's right, and in there is an entry for the gentoo repo, edit it.

Most files in /etc/portage can be directories, although some utilities
get confused if make.conf is, portage just considers the contents as a
single file.


-- 
Neil Bothwick

Computer apathy error: don't bother striking any key.

[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 833 bytes --]

Re: [gentoo-user] [SOLVED] Emerge --sync fails on excluded stuff

[Mick]

[-- Attachment #1: Type: text/plain, Size: 877 bytes --]

On Tuesday, 23 October 2018 08:21:36 BST Neil Bothwick wrote:
> On Mon, 22 Oct 2018 23:05:17 -0400, Walter Dnes wrote:
> > > You can also add "sync-rsync-verify-metamanifest = no" to the gentoo
> > > entry in /etc/portage/repos.conf - I use this when syncing from a
> > > local mirror.
> > > 
> >   That looks easier, but... /etc/portage/repos.conf is a directory on my
> > 
> > system.
> 
> That's right, and in there is an entry for the gentoo repo, edit it.
> 
> Most files in /etc/portage can be directories, although some utilities
> get confused if make.conf is, portage just considers the contents as a
> single file.

I'm also using a local mirror to avoid loading the public gentoo mirrors with 
multiple requests from my machines and have not yet had a problem with portage 
verification in the client machines ...  :-/

What am I doing wrong?  :-)

-- 
Regards,
Mick

[-- Attachment #2: This is a digitally signed message part. --]
[-- Type: application/pgp-signature, Size: 833 bytes --]

Re: [gentoo-user] [SOLVED] Emerge --sync fails on excluded stuff

[Neil Bothwick]

[-- Attachment #1: Type: text/plain, Size: 1326 bytes --]

On Tue, 23 Oct 2018 16:13:35 +0100, Mick wrote:

> > > > You can also add "sync-rsync-verify-metamanifest = no" to the
> > > > gentoo entry in /etc/portage/repos.conf - I use this when syncing
> > > > from a local mirror.
> > > >   
> > >   That looks easier, but... /etc/portage/repos.conf is a directory
> > > on my
> > > 
> > > system.  
> > 
> > That's right, and in there is an entry for the gentoo repo, edit it.
> > 
> > Most files in /etc/portage can be directories, although some utilities
> > get confused if make.conf is, portage just considers the contents as a
> > single file.  
> 
> I'm also using a local mirror to avoid loading the public gentoo
> mirrors with multiple requests from my machines and have not yet had a
> problem with portage verification in the client machines ...  :-/
> 
> What am I doing wrong?  :-)

Nothing, at least not in this respect ;-)

The verification doesn't cause a problem with a local mirror, it is just
unnecessary. The computer hosting the mirror verifies each sync, doing
so again is a waste of time. If someone were to gain root access to the
mirror host, a corrupted portage tree would be the least of my
worries :-O 


-- 
Neil Bothwick

I stayed up all night playing poker with tarot cards. I got a full
house and four people died.

[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 833 bytes --]

Re: [gentoo-user] [SOLVED] Emerge --sync fails on excluded stuff

[Walter Dnes]

On Tue, Oct 23, 2018 at 08:21:36AM +0100, Neil Bothwick wrote
> On Mon, 22 Oct 2018 23:05:17 -0400, Walter Dnes wrote:
> 
> >   That looks easier, but... /etc/portage/repos.conf is a directory on my
> > system.
> 
> That's right, and in there is an entry for the gentoo repo, edit it.
> 
> Most files in /etc/portage can be directories, although some utilities
> get confused if make.conf is, portage just considers the contents as a
> single file.

  There are 2 files in my /etc/portage/repos.conf/ Namely localrepo.conf
and layman.conf.  Now what?  Sorry, I'm not trolling.  It's painful
when you RTFM, and TFM is out to lunch.

-- 
Walter Dnes <waltdnes@waltdnes.org>
I don't run "desktop environments"; I run useful applications

Re: [gentoo-user] [SOLVED] Emerge --sync fails on excluded stuff

[Neil Bothwick]

[-- Attachment #1: Type: text/plain, Size: 835 bytes --]

On Tue, 23 Oct 2018 17:14:17 -0400, Walter Dnes wrote:

> > Most files in /etc/portage can be directories, although some utilities
> > get confused if make.conf is, portage just considers the contents as a
> > single file.  
> 
>   There are 2 files in my /etc/portage/repos.conf/ Namely localrepo.conf
> and layman.conf.  Now what?  Sorry, I'm not trolling.  It's painful
> when you RTFM, and TFM is out to lunch.

I have this in gentoo.conf:

[DEFAULT]
main-repo = gentoo

[gentoo]
priority = 20
location = /var/portage
sync-type = rsync
sync-uri = rsync://my.local.mirror/portage
auto-sync = yes
sync-rsync-verify-metamanifest = no

I can't recall where this file came from but it doesn't appear to have
been installed by an ebuild.


-- 
Neil Bothwick

It is easier to fix Unix than to live with NT.

[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 833 bytes --]

Re: [gentoo-user] [SOLVED] Emerge --sync fails on excluded stuff

[Mick]

[-- Attachment #1: Type: text/plain, Size: 1124 bytes --]

On Tuesday, 23 October 2018 22:30:32 BST Neil Bothwick wrote:
> On Tue, 23 Oct 2018 17:14:17 -0400, Walter Dnes wrote:
> > > Most files in /etc/portage can be directories, although some utilities
> > > get confused if make.conf is, portage just considers the contents as a
> > > single file.
> > > 
> >   There are 2 files in my /etc/portage/repos.conf/ Namely localrepo.conf
> > 
> > and layman.conf.  Now what?  Sorry, I'm not trolling.  It's painful
> > when you RTFM, and TFM is out to lunch.
> 
> I have this in gentoo.conf:
> 
> [DEFAULT]
> main-repo = gentoo
> 
> [gentoo]
> priority = 20
> location = /var/portage
> sync-type = rsync
> sync-uri = rsync://my.local.mirror/portage
> auto-sync = yes
> sync-rsync-verify-metamanifest = no
> 
> I can't recall where this file came from but it doesn't appear to have
> been installed by an ebuild.

I have gentoo.conf (similar to the above), layman.conf and local.conf.  I'm 
sure I created the last two myself, while instructions for creating the 
gentoo.conf were probably published in a news item pertaining to a portage 
upgrade a few years ago now.

-- 
Regards,
Mick

[-- Attachment #2: This is a digitally signed message part. --]
[-- Type: application/pgp-signature, Size: 833 bytes --]

Re: [gentoo-user] [SOLVED] Emerge --sync fails on excluded stuff

[Walter Dnes]

On Tue, Oct 23, 2018 at 10:30:32PM +0100, Neil Bothwick wrote

> I have this in gentoo.conf:
> 
> [DEFAULT]
> main-repo = gentoo
> 
> [gentoo]
> priority = 20
> location = /var/portage
> sync-type = rsync
> sync-uri = rsync://my.local.mirror/portage
> auto-sync = yes
> sync-rsync-verify-metamanifest = no
> 
> I can't recall where this file came from but it doesn't appear to have
> been installed by an ebuild.

  After some more Google searching...
https://wiki.gentoo.org/wiki//etc/portage/repos.conf/gentoo.conf
(YES! There is a double-slash after "wiki")

> The example below shows the default set up of the main Gentoo
> repository. However, there is no need for having this file unless
> its content deviates from the file found at
> /usr/share/portage/config/repos.conf.

  As near as I can tell, portage processes every file in the repos.conf
directory.  It looks like I could simplify things by combining everything
into one file, and eliminating the separate files.  Is that correct?  E.g.
create file /etc/portage/repos.conf/repos.conf


[DEFAULT]
main-repo = gentoo

[gentoo]
priority = 20
location = /var/portage
sync-type = rsync
sync-uri = rsync://rsync.gentoo.org/gentoo-portage
auto-sync = yes
sync-rsync-verify-metamanifest = no

[localrepo]
location = /usr/local/portage
masters = gentoo
auto-sync = no
sync-rsync-verify-metamanifest = no

[palemoon]
priority = 50
location = /var/lib/layman/palemoon
layman-type = git
auto-sync = no
sync-rsync-verify-metamanifest = no


-- 
Walter Dnes <waltdnes@waltdnes.org>
I don't run "desktop environments"; I run useful applications

Re: [gentoo-user] [SOLVED] Emerge --sync fails on excluded stuff

[Neil Bothwick]

[-- Attachment #1: Type: text/plain, Size: 789 bytes --]

On Tue, 23 Oct 2018 21:49:08 -0400, Walter Dnes wrote:

>   As near as I can tell, portage processes every file in the repos.conf
> directory.  It looks like I could simplify things by combining
> everything into one file, and eliminating the separate files.  Is that
> correct?  E.g. create file /etc/portage/repos.conf/repos.conf

From the portage man page:

"Files in this directory including make.conf, repos.conf, and any file
 with a name that begins with "package." can be more than just a flat file"

So yes, you can. Personally, I prefer separate files for each
configuration set, but you can use monolithic files if you consider
that simpler.


-- 
Neil Bothwick

"There are some ideas so idiotic that only an intellectual could believe
them" George Orwell

[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 833 bytes --]

Re: [gentoo-user] [SOLVED] Emerge --sync fails on excluded stuff

[Peter Humphrey]

On Tuesday, 23 October 2018 22:30:32 BST Neil Bothwick wrote:

> I have this in gentoo.conf:
> 
> [DEFAULT]
> main-repo = gentoo
> 
> [gentoo]
> priority = 20
> location = /var/portage
> sync-type = rsync
> sync-uri = rsync://my.local.mirror/portage
> auto-sync = yes
> sync-rsync-verify-metamanifest = no
> 
> I can't recall where this file came from but it doesn't appear to have
> been installed by an ebuild.

It's in the Gentoo handbook. When you install Gentoo you're supposed to create 
the file with the content they give; I really don't know why it's done that 
way, rather than including the file in the stage files.

-- 
Regards,
Peter.