From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by finch.gentoo.org (Postfix) with ESMTPS id 280CE138334 for ; Sun, 18 Nov 2018 22:41:18 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id DECE9E0AA7; Sun, 18 Nov 2018 22:41:12 +0000 (UTC) Received: from smtp.gentoo.org (smtp.gentoo.org [140.211.166.183]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id 73C33E0AA1 for ; Sun, 18 Nov 2018 22:41:11 +0000 (UTC) Received: from [192.168.0.32] (ip68-4-233-67.oc.oc.cox.net [68.4.233.67]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) (Authenticated sender: zmedico) by smtp.gentoo.org (Postfix) with ESMTPSA id A3E3D335C39; Sun, 18 Nov 2018 22:41:09 +0000 (UTC) Subject: Re: [gentoo-dev] [pre-GLEP] Gentoo binary package container format [gentoo@jonesmz.com] To: gentoo-dev@lists.gentoo.org, Rich Freeman References: <8wbjQMoEQy/EntGTUihxxc@IqujqQJNQp+Tbney0Ttn8> From: Zac Medico Openpgp: preference=signencrypt Autocrypt: addr=zmedico@gentoo.org; prefer-encrypt=mutual; keydata= xsFNBFs7tmwBEADTzG+IcYtRfTfKryU7sUH7LlV1M+TdaCMfIkY4x6RyHXkaaqYuQ+U9HKn0 +m5FcZsZ1Ojik+We3Tz0F6kDbam6EWzBxmsLb/IHeUEsvsuLzuBQjiD9zzqGocZiPWr+uWJs AdbueS72R7FPXJPDUEPrJ9GdhGFyYARveY9cmdisOwcDOiSFfBjk3/89t4gROn4KUhezVuO9 VS14gVSns1561CJjlB47HkSBu4+FuzrfVygg4xitWAH119Ehw0vJcgkTw4Bqhk01Iw9us80m dFyU8JbJ0CVYe30gYKFFbnXoiT6xLLogKOkv0goPFxaXcMwWM9ei3SjAGVqgN6i8VnO7kquV LwkTe6ntEK0iY+l4qTKuyIOQLpCbWNI0eVwlx5b/pY2pt5TEGWAPMCZGjlidMx0aDcVX4oji 2/xegFAcxALrfOX3kj2FZ9kNAqLZu26AfqtslIqlBEAb5sZwPr351msBIdbaWX2UNw21I478 7eQ7UfohwXQHlXdhc/wop3VDkDzLBnvlK4ozSJI/9T5F/+9yEZvc6DKUWdEfD12o2El5hHan gCUQWDBKqZb1wcekK8KY2tmH8BBQi7k52IWYLJYfJdir/XpGm5SsDpf3zvDcIFXqFHAG7w7b fhriM+6oBOeIO9ew1Xj3swbRhDwdzRUhu7Uqayq1vdvKqGkgcQARAQABzSJaYWNoYXJ5IE1l ZGljbyA8em1lZGljb0BnbWFpbC5jb20+wsGUBBMBCAA+AhsDBQsJCAcDBRUKCQgLBRYDAgEA Ah4BAheAFiEER1is2Nqa/UampgQK1hDPNyHnis0FAltml4cFCQTNZxoACgkQ1hDPNyHnis07 aA//QH4lchXg2Kt5ZbBlF3UGn8l2lXvjZKnHkSoz1WK5lWJynQN+dFV6ve+mqG8wX7SqEb+3 iMVh1YoCNx3WSoIb/74/0X+Xtarz1thja8/qS+GyCF1O42aOXYLTuXTmIowjBVIR8v1cZVdY L1KNpyfcq9UyL/xyLpBAP6eqB2+rNiNQHuO8xXgoQGr5kpz08yyD+gnpsGG7hdMzOi7FA7kk 5JN6rvVKVoKE3VHuECj30u/sd5bixndrGOEr2Ps7b1E9D5h0Ge9HTtAdU/qaUZpAChkRPwGK aNme3UGag9161JKdBsm7e3/a6GTbqvtJYxSK6B7LvI/VOQmFUlhEcFrDVQzJk0l+X5kn3z2u UG80wWTM4p7WCVWiAUPmVGF27ml12J3p8HBXf02VvaNCJtzOCDEbbr+Ynf+JriMUTRy5mzD0 Vfqt4oWqg7I4q6Ds4TqwmEVxBDdONI2AmhQ+BALGzu3aFyu8fyp7J/KWc+UgK/CGvmJUtrGY sUNudPVPDJ33xlxj1Y940OECA+fsBPxS0k18ZoJLivLxwgrS/EkVOcUKNFMezMUHK6WnDlHD 8UrhvmnF5YewMH1EXelNgZvlWF8z8C2fRx8biGLXaaMQEnmGZkQTN8NJdBhZ1cuD0UORF8Bp LKkz1EEWp1Tox4ibn47s6jM4qRb1xTG+c0T4Fl7OwU0EWzu2bAEQAJ9lv8R485soLy25UWUg xBpNHOburlMdvBC9t0p3D/fVx1glplnsEWCdIGrYIFgM/Fyb5PG++OA1NqbyRkZ0SkKbf+8/ Vh0lKiJhuKwm5tXsmIA6gCYa1oM5Vfm2Gm/bwcvXvCorZ3mOCoxMsV5PeHJqujlyMYBCWFM0 7J/BWR0UwUuM6EbOrtqSLhRn2J5L8h52jJm85uV/v13k9XXEjSZ/bDnKgdx9lG/ufAj1czOe qWAL39FA/s75Z8KXamX2DJ3SFze6pRaXSR73Ee9XGUR05Ef9/47N7JtiP2vzQaQLox6qIbyr O5Y7Qhlnka/PCSrQqBEB5+v1n/i+bI6JWEmu+TWAunpUR0Hnh9Q7cwb89ydiJqxEk5TBFBDX 6rbnDmL2ihlGTQtDqg2dZt5WP4/CfSbMvT8aOR0+xhyXHM4tKVEDCSKx6lWXrYvab5fBexmP 0NLe8gcRtt8KYprIG4YJdASkkyYScaoUuc7O/b1w662bcGcZdxYCDlomOJXk8oSav/iD38Qn yWmEac0JFDYO9TM7W2UemZP4m8MHACCjmt+rnCON6JLnvyQCA+iK04HOn/PlgzkVdf6yER2L n+tq0Stv3KxR+vdnjlhXfIzoweAKkSDz7mTp8zp7Li1GfFcBh0nhfNpLIwv1+ycSD1pVoI+J GX5+4tK4XVAl/svDABEBAAHCwXwEGAEIACYCGwwWIQRHWKzY2pr9RqamBArWEM83IeeKzQUC Wzu2twUJAeEzywAKCRDWEM83IeeKzRZ3D/0RFItQdaMZb6hEk8LzRGxJk772Bt2joBPwY/Qv dLUzrR38Lg+n2VPuwa83fVDaHj+LUAbPa+y+MDhFTC5Yj8zYXrrRmapu4sDgFtL+CMD5at9k HxMMSjLuTQg76BrQnoQ2DFI6TTDVlL4thWszyvsLvdlyQBTZqScY4e98h1Ghylvjrj8kD6OQ /wQ1xcDQ1VPXtN7orc7Gk3d8Gwc/vD3NthpXcTHey5eEvHT/7HGMs9N/ChsTLeRO/lCq6ao+ HtOVe9z/0q7gbCAAVSxwsblmGwNQshaxGvS3K6bQhgjeWlCczKRmIMKiKrscRNPAl5k+kmQ+ VVztDLLR6pwrKiKp3+22vm0/BEVaTg5iarNkWJlnqwbtnDrxRcoe6EJXUyBco+pLczxDpX6c Yv5nAsTUaS+rBo+Cfu7Mml874fOhaffLGM2+HmmWxlsz+SoJMzIHIHQtA9l2OQ7fQa9Xp1TB qZuViSnK2lnlyZshEhPOzE+Q65bBeQujPrLrrgl8f9N7fFVDaupmS4MIWvDLmc6qT3bDs5hY arIM5Ivi3IJ1yxdWgXkddwdAtO/lbMJDYwBBRbrN+XKKtjKBN8nd2zmaTn8nnZQoSEgc/Mkd zbpRt++jfxe4TQUmNvvGhnMKhJOkJVnYfR/Zwk4EsRU31udt6U2WanSbqY8Ad8Ot+xVH+w== Message-ID: <12d9221c-40a1-4271-b77f-85f61eeb424d@gentoo.org> Date: Sun, 18 Nov 2018 14:40:59 -0800 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.3.0 Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-dev@lists.gentoo.org Reply-to: gentoo-dev@lists.gentoo.org MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="cweVPsKnjOlvL2cJ5IJoRT6gNHuFFh0Tv" X-Archives-Salt: c3c2c679-8f56-4358-95ee-abf5b1b98c15 X-Archives-Hash: 9eb5fe5acd8cd557e1161b676960a9c0 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --cweVPsKnjOlvL2cJ5IJoRT6gNHuFFh0Tv Content-Type: multipart/mixed; boundary="tTnqYWDdCb2qfVdQZO8aIZgQOdnH07kZL"; protected-headers="v1" From: Zac Medico To: gentoo-dev@lists.gentoo.org, Rich Freeman Message-ID: <12d9221c-40a1-4271-b77f-85f61eeb424d@gentoo.org> Subject: Re: [gentoo-dev] [pre-GLEP] Gentoo binary package container format [gentoo@jonesmz.com] References: <8wbjQMoEQy/EntGTUihxxc@IqujqQJNQp+Tbney0Ttn8> In-Reply-To: --tTnqYWDdCb2qfVdQZO8aIZgQOdnH07kZL Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable On 11/18/18 1:55 PM, Rich Freeman wrote: > On Sun, Nov 18, 2018 at 4:10 PM Roy Bamford w= rote: >> >> Replying off list because I am not on the whitelist. >=20 > That seems odd. >=20 >> 1) append a uuid to each filename. Generated when the bin package file= is generated. >> 2) encode the hostname of the machine that generated the file >> 3) encode the use flags in the filename. >=20 > So, I brought up this same issue in the earlier discussion and it was > considered out of scope, and I think this is fair. The GLEP does not > specify filename, and IMO the standard for what goes INSIDE the file > will work just fine with any future enhancements that address exactly > this use case. >=20 > Besides your case of building for a cluster, another use case is > having a central binary repo that portage could check and utilize when > a user's preferences happen to match what is pre-built. >=20 > I suggest we start a different thread for any additional discussion of > this use case. I was thinking and it probably wouldn't be super-hard > to actually start building something like this. But, I don't want to > derail this GLEP as I don't see any reason designing something like > this needs to hold up the binary package format. Both the existing > and proposed binary package formats will encode any metadata needed by > the package manager inside the file, and the only extension we need is > to encode identifying info in the filename. >=20 > My idea is to basically have portage generate a tag with all the info > needed to identify the "right" package, take a hash of it, and then > stick that in the filename. Then when portage is looking for a binary > package to use at install time it generates the same tag using the > same algorithm and looks for a matching hash. If a hit is found then > it reads the complete metadata in the file and applies all the sanity > checks it already does. Generating of binary packages with the hash > cold be made optional, and portage could also be configured to first > look for the matching hash, then fall back to the existing naming > convention, so that it would be compatible with existing generic > names. So, users would get a choice as to whether they want to build > up a library of these packages, or just have each build overwrite the > last. >=20 > Then the next step would be to allow these files to be fetched from a > binary repo optionally, and then finally we'd need tools to create the > repo. But, this step isn't needed for your use case. With the proper > optional switches you could utilize as much of this scheme as you > like. >=20 > Also, you could optionally choose how much you want portage to encode > in the tag and look for. Are you very fussy and only want a binary > package with matching CFLAGS/USE/whatever? Or is just matching > USE/arch/etc enough? Some of the existing portage options could > potentially be re-used here. We've already had this handled for a couple years now, via FEATURES=3Dbinpkg-multi-instance. --=20 Thanks, Zac --tTnqYWDdCb2qfVdQZO8aIZgQOdnH07kZL-- --cweVPsKnjOlvL2cJ5IJoRT6gNHuFFh0Tv Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQKTBAEBCgB9FiEE8OgXaltWzqgSupCu0HX7jBBKPSAFAlvx6nxfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldEYw RTgxNzZBNUI1NkNFQTgxMkJBOTBBRUQwNzVGQjhDMTA0QTNEMjAACgkQ0HX7jBBK PSDWVQ//eAfxmFXgNrcZcBEdfvf3ltmf/+qh71v8xaSoeSy9w072khOVk5W8VkBz tkcRV3H6y0YCvJBIU80KxSYFKdhcZxMP0p9RbPuLSc4ryQgYXQU2ELzoALVo5xSs NIx05wCUAa+gXxIcq8iPFsYU3ADQ5xhhoBVsChvIKeJclwz8qZi01pMs2ZP/KN0q frtHeFP0UqskKDnnj1PZ1fLGpInuUAUryQGe+gAPk+efY1hLnHdJfy+wZZDlicgv SYP+PlkbF8nQW4O5e/uUbxwUbi7JwaPQRr7v13nx2EJCv/RkoAjDE0livtLXZuOd rv0gz7gv9cRbJBkbyQJl5osAPQ43kU504/q9fohq0Rayu4o/dKPxXc026CUVHLkq 53GmDdH2mFfpbyfaLyWuNmFBSHuo0/iSVHjUVRtH71iOQOwBiJvQjx7GQHQPj68Q t0livJH/834UyzGJKodyktEVOS0c0SMYo9FpU2dfxC3EWA4AcbY2pApVXZYa3Clw wEsT2kDQ0EReKZsT4jH4k9WWXM8PlmPSO7cdZ+whSdVQnrNdKLOmhghVvIXD3rwH RlzeHJt76kzT8QS87b75ivp4UYVFlIxWDUlmKdI5wxMAN1Qlfmo3yPD2Zu5M0ApI 7UcK84DRK7uc8UmZdRSnuOQb7/AbyGYoQd42Gh9abvrAtHESKvk= =V3le -----END PGP SIGNATURE----- --cweVPsKnjOlvL2cJ5IJoRT6gNHuFFh0Tv--