From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by finch.gentoo.org (Postfix) with ESMTPS id B0CB2158041 for ; Mon, 25 Mar 2024 09:24:08 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 0201DE2A17; Mon, 25 Mar 2024 09:24:03 +0000 (UTC) Received: from purple.birch.relay.mailchannels.net (purple.birch.relay.mailchannels.net [23.83.209.150]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id 5491DE29FF for ; Mon, 25 Mar 2024 09:24:01 +0000 (UTC) X-Sender-Id: thundermail|x-authsender|confabulate@kintzios.com Received: from relay.mailchannels.net (localhost [127.0.0.1]) by relay.mailchannels.net (Postfix) with ESMTP id 1920A94167F for ; Mon, 25 Mar 2024 09:24:01 +0000 (UTC) ARC-Seal: i=1; s=arc-2022; d=mailchannels.net; t=1711358640; a=rsa-sha256; cv=none; b=4uTSJy2IS9IPT5TQMGiZmBlTLlLISrM4CTaqAb6BRsbjscfMMbpXE18+UInnAkNpRQAMCw zs7LvPZAw+lzlbXtHzQXnGu31K+cofdyawDMjMBJBWvO1x2O1g7SYnO0iiTu+OuSc386fU 8Ooqc8/3/Fqm+inkzrod7iOWqzbf61490ypcy245VWLuuJAIm6uGyru3sqUiUdVUh5yQpW bpMm2B8C1Df1gIKmyJF4Ai13WvOiufSGbMxf65XmcvGdBLUWwOzUpBWczWUkdHd10lwxDH u0FVQ9EBoLMn+upeqt5g56/wED8gdC7zI4VasjSZPe9YqGzlSdNi9DParFercw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=mailchannels.net; s=arc-2022; t=1711358640; h=from:from:reply-to:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:mime-version:mime-version: content-type:content-type:in-reply-to:in-reply-to: references:references; bh=MbXHwUjGozFcJ6GdhohPd1ZxsZsftXhJqWPOS6FMKHI=; b=0fIBoEb+XZ2AvPErCMMWV8Fukel/JdDYR6Xd3HkBIiJeD+TgSjLbVob6rYxuZ6sf1YhZRv 0vfyMpWT9zZWVhG9ffsb1Z6zxtJdnTKMkiLSgMATMEYYMeEFq2q6AW/V9tdYhiri6QLi6/ xpEFE/VQFkNTc11uIWeuq1Gh7I94zeiHizxjy5tP4mxy8Mr9kIYW6ip1kVi/sAJpCSf4aC GREr12VAaOuPiSlSquKX35fzptbMSY3FdSiRSILmHuSdcAdfSZgoq6rfhmcEhwH509Lxvm D8N6kRZ7fpqxUKMv88k95u+fIEj1ZO1/rQxjHxjtgP5N6EnTQlIvs8jPSBo+OQ== ARC-Authentication-Results: i=1; rspamd-6c65898bb7-dfjhd; auth=pass smtp.auth=thundermail smtp.mailfrom=confabulate@kintzios.com X-Sender-Id: thundermail|x-authsender|confabulate@kintzios.com X-MC-Relay: Neutral X-MailChannels-SenderId: thundermail|x-authsender|confabulate@kintzios.com X-MailChannels-Auth-Id: thundermail X-Continue-Keen: 14394b233f7aeb14_1711358640700_2988972325 X-MC-Loop-Signature: 1711358640700:2937412088 X-MC-Ingress-Time: 1711358640699 Received: from mailclean11.thundermail.uk (mailclean11.thundermail.uk [149.255.60.66]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384) by 100.126.173.126 (trex/6.9.2); Mon, 25 Mar 2024 09:24:00 +0000 Received: from cloud238.thundercloud.uk (cloud238.thundercloud.uk [149.255.62.116]) by mailclean11.thundermail.uk (Postfix) with ESMTPS id 650954021E for ; Mon, 25 Mar 2024 09:23:55 +0000 (GMT) Authentication-Results: cloud238.thundercloud.uk; spf=pass (sender IP is 217.169.3.230) smtp.mailfrom=confabulate@kintzios.com smtp.helo=rogueboard.localnet Received-SPF: pass (cloud238.thundercloud.uk: connection is authenticated) From: Michael To: gentoo-user@lists.gentoo.org Subject: Re: [gentoo-user] Question about emerge sync and where it all goes. Date: Mon, 25 Mar 2024 09:23:40 +0000 Message-ID: <5927132.MhkbZ0Pkbq@rogueboard> In-Reply-To: References: Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-user@lists.gentoo.org Reply-to: gentoo-user@lists.gentoo.org X-Auto-Response-Suppress: DR, RN, NRN, OOF, AutoReply MIME-Version: 1.0 Content-Type: multipart/signed; boundary="nextPart1790000.VLH7GnMWUR"; micalg="pgp-sha256"; protocol="application/pgp-signature" X-PPP-Message-ID: <171135863424.1636066.18415671916290390359@cloud238.thundercloud.uk> X-PPP-Vhost: kintzios.com X-Rspamd-Queue-Id: 650954021E X-Rspamd-Server: mailclean11 X-Spamd-Result: default: False [-1.61 / 999.00]; SIGNED_PGP(-2.00)[]; MID_RHS_NOT_FQDN(0.50)[]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; ONCE_RECEIVED(0.10)[]; MX_GOOD(-0.01)[]; R_SPF_ALLOW(0.00)[+mx]; FUZZY_BLOCKED(0.00)[rspamd.com]; RCVD_VIA_SMTP_AUTH(0.00)[]; ASN(0.00)[asn:34931, ipnet:149.255.60.0/22, country:GB]; MISSING_XM_UA(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_COUNT_ONE(0.00)[1]; R_DKIM_NA(0.00)[]; RCVD_TLS_ALL(0.00)[]; NEURAL_HAM(-0.00)[-0.960]; REPLYTO_ADDR_EQ_FROM(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; DMARC_POLICY_ALLOW(0.00)[kintzios.com,none]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[gentoo-user@lists.gentoo.org]; HAS_REPLYTO(0.00)[confabulate@kintzios.com] X-Rspamd-Action: no action X-Archives-Salt: e1d5ebf1-18be-4e9e-83f0-bc4f18d89ca2 X-Archives-Hash: 26171e10a7781b821613eb06f7618981 --nextPart1790000.VLH7GnMWUR Content-Transfer-Encoding: 7Bit Content-Type: text/plain; charset="UTF-8"; protected-headers="v1" From: Michael To: gentoo-user@lists.gentoo.org Reply-To: confabulate@kintzios.com Date: Mon, 25 Mar 2024 09:23:40 +0000 Message-ID: <5927132.MhkbZ0Pkbq@rogueboard> In-Reply-To: References: MIME-Version: 1.0 On Monday, 25 March 2024 02:58:21 GMT Dale wrote: > Howdy, > > I've mentioned before that I build my packages in a chroot. I have a OS > copy on a separate drive. I do this because of the long compile times > of some packages. On occasion tho, I catch the tree in a bad place. > Some conflict or other happens and I need to sync again to get fixes > etc. Given my process tho, I don't want to sync the chroot without also > syncing my main system because the two will not be in sync and I'll lose > my update since it deletes files as well including any updates I did > emerge successfully. I need the two to be identical. So, I'd like to > sync my main system and then copy the new data over to the chroot > without copying the rest of the OS. What you do is duplicating effort and storage space with questionable benefit, besides warming up your room. I think it would be more efficient if you used the same /var/cache/distfiles and /var/db/repos/ filesystems on both installations. This way you'd sync once and then download any source files once only. However, an even more optimised solution would be to compile packages once in your chrooted fs with the '--buildpkg y' option and then emerge these as binary packages from /var/cache/binpkgs/ in your production OS. An overnight emerge in the chrooted OS will take only a few minutes on the production system. > I did this with the following command earlier. > > rsync -av --progress --delete /var/cache/portage/tree/* > /backup/gentoo-build/var/cache/portage/tree/ Your syntax for the source tree will fail to copy a couple files immediately under /var/cache/portage/tree/ which start with "." It would be better if you used: /var/cache/portage/tree /backup/gentoo-build/var/cache/portage/tree > As you can see, my tree location is not the default. It is located at > /var/cache/portage/tree/. It's the same on the chroot obviously. Would > the above command copy all the needed files/directories over that it > needs after a emerge sync or is there more to it? The reason I think it > needs more, when I tried to do the usual emerge -aukDN world on my main > system, it wanted to emerge more packages than the chroot did. I > suspect there is more to it than just the tree directory. > > Anyone have the details on this? Anyone know what other > files/directories need to be copied over as well? > > Thanks. > > Dale > > :-) :-) Did you diff /var/lib/portage/world between the two systems to see what differences may be there? I can think of a hypothetical case where the chrooted fs may have already emerged build time dependencies, e.g. if some emerge failed and then you fixed/restarted it a number of times, but the production system would not yet have such build time dependencies installed. --nextPart1790000.VLH7GnMWUR Content-Type: application/pgp-signature; name="signature.asc" Content-Description: This is a digitally signed message part. Content-Transfer-Encoding: 7Bit -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEEXqhvaVh2ERicA8Ceseqq9sKVZxkFAmYBQpwACgkQseqq9sKV ZxkcYA/9GeA3Ho7NzC+Dh9R80I5R0GBiXECtj711Jfk+BNvjrCZFhLulFn2+gi9Z XDZw7ZUVWJKIRnfqSLDwe0VjCliVbGsLiTCTVfzvNu+bnLc/u1fCb/B3k45FoRzW cQCGxEhldkf5hwZGWGhNB/Af2PrQro3qMtl1LZQYTEbwfuLA24GdQodakA4/CXld bU/RIsWfwamSwmim/I05G0ijCMtXZYxnvhNGCstcwIzeKcv57ZeHIK8n03sHNyZO alzvfKf0SGfdNz5lYeiDZmrowOgxBPYyxfdT2SEz1x90lWifzqZMHD+5Yr19tx0W M+aRSsN+qr0JS4MEayOws/qIQTG68+fZoVTxNbb2LLjOzy0OFJehS4O1JkfoygiV NaH017nl1Ci3ex9omlTBYXbS6xnzEg5Cs8PuHf4yUtNbyqgp1jvMAY5rVHtJyDEv /uJUH7B0Hj3CfwbRtR7gQGCnj58FvqQXrAt4Ues7yRJPfLdvKU54itIQxXfrSuid p8B5Pa52DKokbw5pxBglTFWwcwF15/UtQcgq4zh/k03pFpiG0NibWeTN+bvyH3/h MKegpgAzTupgYCYvKTf1K2f3i0sAc0gRBYK/7gMHG9TvrFNxRUxmwTEj69ooY60U eyzOLIZ9UxORe3Wb1nmFgCnrL8mCVyA+qazkYUmjBSh5KaYojyQ= =sCgG -----END PGP SIGNATURE----- --nextPart1790000.VLH7GnMWUR--