[gentoo-user] I've hosed portage

[gentoo-user] I've hosed portage

[John J. Foster]

[-- Attachment #1: Type: text/plain, Size: 1002 bytes --]

I unmasked portage-2.2_pre4 to see if it would help with the extreme
slowness of portage updating of its cache during a sync. I had also
previously emerged cdb to try to help with that also. Anyway, I'm not
really sure what state my portage is in right now, except that now every
emerge command returns

festus@gentoovm ~ $ emerge --info
Traceback (most recent call last):
  File "/usr/bin/emerge", line 31, in ?
    import emergehelp, xpak, commands, errno, re, socket, string, time, types
  File "/usr/lib/portage/pym/emergehelp.py", line 7, in ?
    from portage_const import PRIVATE_PATH,PRELINK_BINARY,HASHING_BLOCKSIZE
  File "/usr/lib/portage/pym/portage_const.py", line 7, in ?
    from portage_const import PRIVATE_PATH,PRELINK_BINARY,HASHING_BLOCKSIZE
ImportError: cannot import name PRIVATE_PATH

I already tried
http://www.gentoo.org/proj/en/portage/doc/manually-fixing-portage.xml
but it didn't help. Me thinks I should have done a quickpkg!

Any help greatly appreciated.

Thanks,
festus

[-- Attachment #2: Type: application/pgp-signature, Size: 189 bytes --]

Re: [gentoo-user] I've hosed portage

[Chris Brennan]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

*if* you move /usr/portage to something like reisterfs, you will get
better performacem even on slower machines. my PIII/800 can update the
cache in ~ 3 minutes now .... ext3 just doesn't cut it in a busy tree
like portage ... the filesystem just isn't quick enough .... there are
some other things you can do like using xfs/jfs for
/usr/portage/distfiles and what not, but that' just a start. First thing
is first, fix portage, then if you like, contact me off list and I can
help you tweak emerge so it runs a little quicker and still be safe :D

John J. Foster wrote:
| I unmasked portage-2.2_pre4 to see if it would help with the extreme
| slowness of portage updating of its cache during a sync. I had also
| previously emerged cdb to try to help with that also. Anyway, I'm not
| really sure what state my portage is in right now, except that now every
| emerge command returns
|
| festus@gentoovm ~ $ emerge --info
| Traceback (most recent call last):
|   File "/usr/bin/emerge", line 31, in ?
|     import emergehelp, xpak, commands, errno, re, socket, string,
time, types
|   File "/usr/lib/portage/pym/emergehelp.py", line 7, in ?
|     from portage_const import
PRIVATE_PATH,PRELINK_BINARY,HASHING_BLOCKSIZE
|   File "/usr/lib/portage/pym/portage_const.py", line 7, in ?
|     from portage_const import
PRIVATE_PATH,PRELINK_BINARY,HASHING_BLOCKSIZE
| ImportError: cannot import name PRIVATE_PATH
|
| I already tried
| http://www.gentoo.org/proj/en/portage/doc/manually-fixing-portage.xml
| but it didn't help. Me thinks I should have done a quickpkg!
|
| Any help greatly appreciated.
|
| Thanks,
| festus
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.7 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFH3dGY8hUIAnGfls4RApvUAJ9pK3wWqS5LpwvRtCOfzrItpxxtDgCgjdJm
mgZu5SRDPda51qAuZtX58RE=
=8DRz
-----END PGP SIGNATURE-----
-- 
gentoo-user@lists.gentoo.org mailing list

Re: [gentoo-user] I've hosed portage

[Strong Cypher]

for better perf i use ext2 with some tweak
mkfs.ext2 -I2048 -m0 /dev/myPartition
I use sqlite in backend and eix for searching update
the speed is now really excellent
every thing could be found on wiki
good luck

On 3/17/08, Chris Brennan <xaero@xaerolimit.net> wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> *if* you move /usr/portage to something like reisterfs, you will get
> better performacem even on slower machines. my PIII/800 can update the
> cache in ~ 3 minutes now .... ext3 just doesn't cut it in a busy tree
> like portage ... the filesystem just isn't quick enough .... there are
> some other things you can do like using xfs/jfs for
> /usr/portage/distfiles and what not, but that' just a start. First thing
> is first, fix portage, then if you like, contact me off list and I can
> help you tweak emerge so it runs a little quicker and still be safe :D
>
> John J. Foster wrote:
> | I unmasked portage-2.2_pre4 to see if it would help with the extreme
> | slowness of portage updating of its cache during a sync. I had also
> | previously emerged cdb to try to help with that also. Anyway, I'm not
> | really sure what state my portage is in right now, except that now every
> | emerge command returns
> |
> | festus@gentoovm ~ $ emerge --info
> | Traceback (most recent call last):
> |   File "/usr/bin/emerge", line 31, in ?
> |     import emergehelp, xpak, commands, errno, re, socket, string,
> time, types
> |   File "/usr/lib/portage/pym/emergehelp.py", line 7, in ?
> |     from portage_const import
> PRIVATE_PATH,PRELINK_BINARY,HASHING_BLOCKSIZE
> |   File "/usr/lib/portage/pym/portage_const.py", line 7, in ?
> |     from portage_const import
> PRIVATE_PATH,PRELINK_BINARY,HASHING_BLOCKSIZE
> | ImportError: cannot import name PRIVATE_PATH
> |
> | I already tried
> | http://www.gentoo.org/proj/en/portage/doc/manually-fixing-portage.xml
> | but it didn't help. Me thinks I should have done a quickpkg!
> |
> | Any help greatly appreciated.
> |
> | Thanks,
> | festus
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v2.0.7 (GNU/Linux)
> Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org
>
> iD8DBQFH3dGY8hUIAnGfls4RApvUAJ9pK3wWqS5LpwvRtCOfzrItpxxtDgCgjdJm
> mgZu5SRDPda51qAuZtX58RE=
> =8DRz
> -----END PGP SIGNATURE-----
> --
> gentoo-user@lists.gentoo.org mailing list
>
>
-- 
gentoo-user@lists.gentoo.org mailing list

Re: [gentoo-user] I've hosed portage

[Dale]

Chris Brennan wrote:
> SNIP   First thing
> is first, fix portage, then if you like, contact me off list and I can
> help you tweak emerge so it runs a little quicker and still be safe :D
>

No !!!!.  Please share with us all how to make it faster.  Is it 
classified top secret or something?   ;-)

Dale

:-)  :-) 

< read a little humor in that by the way >
-- 
gentoo-user@lists.gentoo.org mailing list

Re: [gentoo-user] I've hosed portage

[Emil Beinroth]

[-- Attachment #1: Type: text/plain, Size: 1378 bytes --]

Hi,

another thing that might help is not generating the cache at all. It
appears that we can get away with what is in /usr/portage/metadata/cache.

I've put -metadata-transfer into FEATURES to tell portage to skip the
"Generating cache" stuff, and added the following to my
/etc/portage/modules:

    portdbapi.auxdbmodule = cache.metadata_overlay.database

I don't guarantee anything, but I've been using this approach for a
while (a year or so) and never had any problems.

I also am using squashfs+aufs for my portage tree, which - apart from
speeding things up here - has the nice little effect that /usr/portage
now only takes up about 50MB in a .sqfs image.
You will need to get aufs from the sunrise overlay, but if you are not
comfortable doing so you can use squashfs+unionfs as explained in this
gentoo-wiki article [1]

If you intend to use aufs, Martin Väth (who is also the current
maintainer of eix) has written a nifty little init-script for handling
those images (see "initscripts.tar.gz" on [2]).

HTH, Emil

[1] http://gentoo-wiki.com/HOWTO_VERY_small_Portage_Tree_with_SquashFS_and_UnionFS
[2] http://www.mathematik.uni-wuerzburg.de/~vaeth/gentoo/index.html

-- 
Emil Beinroth
83059 Kolbermoor | Germany
 
Rich bachelors should be heavily taxed. It is not fair that some men should be
happier than others. -- Oscar Wilde

[-- Attachment #2: Type: application/pgp-signature, Size: 189 bytes --]

Re: [gentoo-user] I've hosed portage

[John J. Foster]

[-- Attachment #1: Type: text/plain, Size: 154 bytes --]

Chris, Strong and Emil - most excellent suggestions, and I'd love to try
them out as soon as someone helps me get portage working again!

Thanks,
festus


[-- Attachment #2: Type: application/pgp-signature, Size: 189 bytes --]

Re: [gentoo-user] I've hosed portage

[John J. Foster]

[-- Attachment #1: Type: text/plain, Size: 1341 bytes --]

Please !!!

This was installed in an empty VM and it would be real slow to recompile
all of Gentoo. There has to be a way to fix it.

Pointers and links greatly appreciated.

TIA,
festus

On Sun, Mar 16, 2008 at 07:22:41PM -0600, John J. Foster wrote:
> I unmasked portage-2.2_pre4 to see if it would help with the extreme
> slowness of portage updating of its cache during a sync. I had also
> previously emerged cdb to try to help with that also. Anyway, I'm not
> really sure what state my portage is in right now, except that now every
> emerge command returns
> 
> festus@gentoovm ~ $ emerge --info
> Traceback (most recent call last):
>   File "/usr/bin/emerge", line 31, in ?
>     import emergehelp, xpak, commands, errno, re, socket, string, time, types
>   File "/usr/lib/portage/pym/emergehelp.py", line 7, in ?
>     from portage_const import PRIVATE_PATH,PRELINK_BINARY,HASHING_BLOCKSIZE
>   File "/usr/lib/portage/pym/portage_const.py", line 7, in ?
>     from portage_const import PRIVATE_PATH,PRELINK_BINARY,HASHING_BLOCKSIZE
> ImportError: cannot import name PRIVATE_PATH
> 
> I already tried
> http://www.gentoo.org/proj/en/portage/doc/manually-fixing-portage.xml
> but it didn't help. Me thinks I should have done a quickpkg!
> 
> Any help greatly appreciated.
> 
> Thanks,
> festus



[-- Attachment #2: Type: application/pgp-signature, Size: 189 bytes --]

Re: [gentoo-user] I've hosed portage

[Neil Bothwick]

[-- Attachment #1: Type: text/plain, Size: 704 bytes --]

On Mon, 17 Mar 2008 20:31:29 -0600, John J. Foster wrote:

> This was installed in an empty VM and it would be real slow to recompile
> all of Gentoo. There has to be a way to fix it.

You could unpack a stage 3 tarball to a temporary location then copy the
portage files over. If you have portage-utils or equery installed and
working, you could use qlist or equery to generate a list of files to
copy.

Alternatively, as you are using VMs, begin a basic stage 3 install in a
new VM, as far as being able to quickpkg portage, then unpack the tarball
in the root of the broken VM.


-- 
Neil Bothwick

What's the difference between ignorance and apathy?
I don't know and I don't care

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 189 bytes --]

Re: [gentoo-user] I've hosed portage

[John J. Foster]

[-- Attachment #1: Type: text/plain, Size: 1193 bytes --]

On Tue, Mar 18, 2008 at 08:29:57AM +0000, Neil Bothwick wrote:
> On Mon, 17 Mar 2008 20:31:29 -0600, John J. Foster wrote:
> 
> > This was installed in an empty VM and it would be real slow to recompile
> > all of Gentoo. There has to be a way to fix it.
> 
> You could unpack a stage 3 tarball to a temporary location then copy the
> portage files over. If you have portage-utils or equery installed and
> working, you could use qlist or equery to generate a list of files to
> copy.
> 
> Alternatively, as you are using VMs, begin a basic stage 3 install in a
> new VM, as far as being able to quickpkg portage, then unpack the tarball
> in the root of the broken VM.
> 
Thanks so much Neil, option #1 worked just fine, followed by a
emerge -auvDN world
emerge --depclean
revdep-rebuild

I think what I did wrong in following the instuctions for repairing portage 
as described at

http://www.gentoo.org/proj/en/portage/doc/manually-fixing-portage.xml

was that I blindly just copied and pasted, thereby bringing in a way old
version. I'm not sure, though (probably more because of too much Patron).
But it didn't work.

Thanks so much for your help!

festus

[-- Attachment #2: Type: application/pgp-signature, Size: 189 bytes --]

Re: [gentoo-user] I've hosed portage

[Neil Bothwick]

[-- Attachment #1: Type: text/plain, Size: 620 bytes --]

On Wed, 19 Mar 2008 19:51:05 -0600, John J. Foster wrote:

> > You could unpack a stage 3 tarball to a temporary location then copy
> > the portage files over. If you have portage-utils or equery installed
> > and working, you could use qlist or equery to generate a list of
> > files to copy.

> Thanks so much Neil, option #1 worked just fine, followed by a
> emerge -auvDN world
> emerge --depclean
> revdep-rebuild

You should also re-emerge postage, so the package database is in sync
with the files you have on your disk.


-- 
Neil Bothwick

Success is making it to the top of the food chain!

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 189 bytes --]

Re: [gentoo-user] I've hosed portage

[John J. Foster]

[-- Attachment #1: Type: text/plain, Size: 715 bytes --]

On Thu, Mar 20, 2008 at 10:05:54AM +0000, Neil Bothwick wrote:
> On Wed, 19 Mar 2008 19:51:05 -0600, John J. Foster wrote:
> 
> > > You could unpack a stage 3 tarball to a temporary location then copy
> > > the portage files over. If you have portage-utils or equery installed
> > > and working, you could use qlist or equery to generate a list of
> > > files to copy.
> 
> > Thanks so much Neil, option #1 worked just fine, followed by a
> > emerge -auvDN world
> > emerge --depclean
> > revdep-rebuild
> 
> You should also re-emerge postage, so the package database is in sync
> with the files you have on your disk.
> 

Done, thanks

festus
-- 
"I just want to break even."
Richard Manuel

[-- Attachment #2: Type: application/pgp-signature, Size: 189 bytes --]