From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by finch.gentoo.org (Postfix) with ESMTPS id AAA9B138334 for ; Mon, 19 Nov 2018 10:46:12 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 7E81FE08AA; Mon, 19 Nov 2018 10:46:06 +0000 (UTC) Received: from mout.kundenserver.de (mout.kundenserver.de [212.227.126.135]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id E85D7E0729 for ; Mon, 19 Nov 2018 10:46:05 +0000 (UTC) Received: from [192.168.6.147] ([212.159.46.162]) by mrelayeu.kundenserver.de (mreue011 [212.227.15.163]) with ESMTPSA (Nemesis) id 1Mt7Ll-1faJT30MA5-00tQNy for ; Mon, 19 Nov 2018 11:46:04 +0100 Subject: Re: [gentoo-dev] [pre-GLEP] Gentoo binary package container format [gentoo@jonesmz.com] To: gentoo-dev@lists.gentoo.org References: <8wbjQMoEQy/EntGTUihxxc@IqujqQJNQp+Tbney0Ttn8> <12d9221c-40a1-4271-b77f-85f61eeb424d@gentoo.org> From: "M. J. Everitt" Openpgp: id=BA266E0525CFAB101523351B4C30334F93C22371 Autocrypt: addr=m.j.everitt@iee.org; prefer-encrypt=mutual; keydata= xsFNBFngC8gBEAC8/nQZrVrr8v0kaD4OLw8UftKfPQFEMGY/rnFA81M9IvdyPP8/8u/+9AGc DEN3i/LRvW0KUBdKIngcUY/p1M/sJqBspMOBaoOLp6K53/2uxcGXw62TulQJU+7a37Jukv2r HNSyZzM6II0myConmJa8ja1HfsiVoqDrqNigBF+Sts1kqG4xg8YeyOl1Tk+LZwC+ukzzutE9 pbpIL2snu5I6a6RNi9DtbB9FZKzkbXx8TlpMXrcorNryOLQHPRw6tir5Z8kpetiJgoEpKGBX botDOWLVW+s9XnwPzAFmL03gH+3reY+LfrQWQTDphfZIp75caZQUicQHpc1NUr+8bLr3n79A FCPY3CfWriGn17aqaaXDFfeYPJIlH8UmOXI41JqR47C5eYFbocA8A4k7cGVAdKJFWLy51165 dt7qZyvUQc/olzrZOrvoiWXA8ELg7pqxxObM4kl0502IHz9kb6Lt712HvfjH5yAP8zTYpetn sCPR9aVVSQsRgluNrQFlKpVmUXbeBLjw05UBEunS6prDwXOyZdn7t03LSOlK2nBGM+gtxg8l /0Nb1saYMGGN8qtO4RLFRiRBc20kNz01cC89PKRIXYlW9dRZNH1zebIUCAg+S4hSmmV4uvaZ XRADb2G+ZZ2jj9cNTTnI+X1/a19S8XjBZ4z+9+Hty4nhoB6fawARAQABzSNNLiBKLiBFdmVy aXR0IDxtLmouZXZlcml0dEBpZWUub3JnPsLBgAQTAQgAKgIbAwUJA8JnAAULCQgHAwUVCgkI CwUWAgMBAAIeAQIXgAUCWeAgogIZAQAKCRBj58Z59NQx3awfD/4wMWDKcu0/s2KQhz5JUBfi v+PdY7xxJj77gPhHximyjWW8O1pu3H280HsL2751AuUyQ2JNWYUtbr8FIvk8dLBnjLmXQwu/ JhkPyAoW/3UcpSCjGkwZ0B/amHs9/dC99Y9Fk1lYDqm1FEmSmqnXHFg7tgdKpMF5eV7B0moS ISL0IKSOCMPHE1u/0bSwUVXbzuqWOLbWRcqH819aVsZG+unrQf87R0RKG5rI7OEkdtCDO+8D KlOPqo1i+Un9YvzdktNymHJtoHGljIWLoo5QMciHH5JX+y7bGH1mHfmnsqFsHiPQFkun3/xV qk9hI0qvl1q5ykX/UVZMmXaMVwWcpiLz4pHnN92v9BxyAESKJkj9fh9CoR958nmoLzhmVzdf pXHBlI4E5uYaKeCPbGNHZX0WoHaStf0f/AkuLSQj3g53VDWvDBt+qfnzBkGwYSGhM6tOQX5T Cz0WP8cZa6ghyzTy+z4jwT8/O9umurExdRl2D0VNdT4RPoCFs/jlFXFbnlGPC2FjvWfMEF8j 9FiPq19NPPRd8WiQYgRYehFFoDqNOzIu3LbshV2CPdVN5fsRD1lwOGlrmiPWQrWlfKoUK98G M5MfAcSJVkixsfoajZlH5lk48kBQsMnLxut2pmRiahtsEV0af+FHLs1ZuYngk0kJh5q+UyZi 4exXsLvHC/rPbs7BTQRZ4AvIARAA2MeaJF9ma6ngqTogwle2dHfAzilYpWSgt7Gej9APzidO mVfyoXIBsd3UMNQErFkRZNk/U0vyy0x9Azs3z0gqOo5E98veiN3VOf8g9vhTfxfHcVTz6JwX 9ggzO//iRPvUH3NKfEvpLNn8gkOvN9cTyh0k9Vrj28vBpD3HWWHJlU5wVrpFUpE4RFXDOpMD aAQAPkArzxXmc6CtnQfupkpZPe+mplDoEjFmw1F6fLp/09a+K0m97xZU0eG/tYWqItRpTHnY 8d92wFHNx1RdYyII8y2kCDNwp+E6oEX/DP5WspKGzgf/f9zci61v192wpXiqzoE9D+quFo9v z6Ywn8NCfqOUs+dnwZ9xtQXOHBU5lZi0avkg3HYQ1lArSkUHzlO4k5AslEu5AXqEOKe9Mo4q nYX/HK3xQEPwEJji2T8SR9IDPfAIYjSK6iMw7LT4ugCwVemNHmDSuWdZDjtbVMRdNtsWu0ar i04FQ+8cBovQHQyrVVYVduuazlBioX7dN8go17eue2C3hTr8xJhB4dX7/bfVAay1LeCWyaGr 15nfkAH4wXp11sSU482GwRnEEL5TeYDgHHtd+FyiYm3Wd5T5NKgPM5XpzIhm4MvLmWMhmC4O nLc5gZj2aQ7IWi2W5FlxSSu0VrC0q6hoNB0rCsz1GBKDBrLX+03hZrMRC0TeZZ8AEQEAAcLB ZQQYAQgADwUCWeALyAIbDAUJA8JnAAAKCRBj58Z59NQx3cwiEACpDgKf6ZlEx27TWzoV73v/ FV0Zy2vz+pqIIw2BKb1PbuEJnluZnWQ/u9nVCRoIQKDU5IHS+DoR76iTOUTiVmE+9ZltAHYi 9QRAHlwWdFkZqkoTNvrHw7pA0oOhgqC3k1n3FpAbT8GFZeIKRqgWCacTMBepMJRlz46nQ/CX 4Eh2HwrJrbgJJaMpNqoh+hJee7ev/TXV+OFLc310tJSZhSPXo9NkWGHu631RjOJl4Xf0vE4t Zy4aNE94NjMUOILjmaTp78HBUbsgqZrdl/wu2HbNNF5IKWwnyYRAeF9l73JuQwXLMrVQxbqP P9XiQqgKT4CF3xxdiXCS3Hq5s3OQLouFg03LGHyMAMtsP+8PepndmL/i79s/Mp0WYcJK6XAm Mi+Xknfi5Lay1oAjYu8UvGOWo5nOq62saN/bXG8/m+qqiueMOTDGXHZfklBglW5p6VYJd2eY W1teykJa7oGAOsiePl+z4UllNTBQVzhRPfmc/O3Yg6JJbISqHw84IWDINVUAN6wldIay83Tr gc1aAXDepgf6aNDbbWiQ+BBBJkAOGYTG9pnAaNMUKM65dkN7WufV2fwJHn900f2vzKyFYkKF bIiuODXBTfJG1yvMUQIgnDBYUBuBdDXB3NhOG8nHOJSQXTdI+Ma9ZMkxmVCxV9RXFPYBO8ji nurTf8FtGwnuig== Message-ID: <59f168d7-1e9e-df05-7619-452dd534172c@iee.org> Date: Mon, 19 Nov 2018 10:45:57 +0000 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.5.2 Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-dev@lists.gentoo.org Reply-to: gentoo-dev@lists.gentoo.org MIME-Version: 1.0 In-Reply-To: <12d9221c-40a1-4271-b77f-85f61eeb424d@gentoo.org> Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="I3XMmduIAMJcKDMvBH57D77TymxOkW0ti" X-Provags-ID: V03:K1:htsJVKh88kcVGqaSQaYT4+JaBZ5vSwsE2rbScZQZAZOUMlXs1kh psRGOJZ75D4/AQ323PAgHXJRRkG6bDPtnXJ50ckICvmRiiNiIwy54o38+G1JY1kOZQ0vLXw Md7icEu5OKxv32y1kJwJQfJspWC2rpCk+4G5Y5W6BGx+0XvIAEQbXima5OH/pa8trmyVmU2 RDHHH0hinwkdcikffi0xQ== X-Spam-Flag: NO X-UI-Out-Filterresults: notjunk:1;V01:K0:AM99h+t1sFE=:XkqVFuYQ/woySk39Co5+9g THAAHEMkmzGdjesu5RbgmEGJoo6y+VoZdYfZt7jFncjZvzIPmrKWnzRJAQq09nfJTewhfpZ38 Ifm2KXAIVj2E1kYlviG4A+J7mlpNXG/KSjOpHQDMz6/cBeRoRyLpsWsoePFDJOJ6EiKE/xyUl Ro+xviG82RY4ayjBoqJZTKgUZD+qmQO97zbDitM/9soq+Zb8QG9vsHl/G6nPxuA7YDBRNCR/u j6fUQZr+cZZA2cddQCWnXLJGk2g2jHSk1fnRGz/Y+0X548+mISQD1PSjMSofN8miD2lkOsJj5 M7nmPCb957QgnSGKGLhX3dsUHB7rtMSWjpwzpT5phAfhDhmc4SrmKlDsD/ojBO/dQXv4zuPjA A8Zngr4PHZei77RAhl3Z+PnJxGp5twpflDHKNrQw/ZQnuod7rrcQJipZ+QhOWZTB1sS8lf3bS iLlHG9s8cg6OT5cw16OnpCvXJhHW9Fj3ISytCiwLo4Z1SNVnrQcBAPzIRmCWYACatXOEcMVdK cBSzMRnXP0DZcuuWWuYUJnb5qF3azMrRLVYioxKIaEcnsOykGY7gclDls81jPBOh0yu1h9CN1 IHPIMEF77h0xsCsuMOIRo732gag8CajZ/G6Iusk1t3eX9U6/QUlpFgkD9IWs4MWrICAsKsRnE X+RSm8GRLxBrulATfk/q4N1PfEjNRICjBMmk2c4NJoDTBGl8y4KN4s/K4ZcQCJXz0V/inILIS JU2epGbSxVO51W0n4soDcOLw0lC+lumqKjI8zhmJDAiIMYJqqWpHeKSqgPyNaI87lyO8zjuWE lkmZJoDNlXqVI2FeXSAy7+3hHlMOw== X-Archives-Salt: 81fcc943-3abb-499d-b7e2-f9c23cbde7bd X-Archives-Hash: 0c64cd7dc2beefd02b338ee007530032 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --I3XMmduIAMJcKDMvBH57D77TymxOkW0ti Content-Type: multipart/mixed; boundary="1Sm9wvnHEXdBYWTvdbzuUxdJMgYSqcwvZ"; protected-headers="v1" From: "M. J. Everitt" To: gentoo-dev@lists.gentoo.org Message-ID: <59f168d7-1e9e-df05-7619-452dd534172c@iee.org> Subject: Re: [gentoo-dev] [pre-GLEP] Gentoo binary package container format [gentoo@jonesmz.com] References: <8wbjQMoEQy/EntGTUihxxc@IqujqQJNQp+Tbney0Ttn8> <12d9221c-40a1-4271-b77f-85f61eeb424d@gentoo.org> In-Reply-To: <12d9221c-40a1-4271-b77f-85f61eeb424d@gentoo.org> --1Sm9wvnHEXdBYWTvdbzuUxdJMgYSqcwvZ Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Content-Language: en-GB On 18/11/18 22:40, Zac Medico wrote: > On 11/18/18 1:55 PM, Rich Freeman wrote: >> On Sun, Nov 18, 2018 at 4:10 PM Roy Bamford = wrote: >>> Replying off list because I am not on the whitelist. >> That seems odd. >> >>> 1) append a uuid to each filename. Generated when the bin package fil= e is generated. >>> 2) encode the hostname of the machine that generated the file >>> 3) encode the use flags in the filename. >> So, I brought up this same issue in the earlier discussion and it was >> considered out of scope, and I think this is fair. The GLEP does not >> specify filename, and IMO the standard for what goes INSIDE the file >> will work just fine with any future enhancements that address exactly >> this use case. >> >> Besides your case of building for a cluster, another use case is >> having a central binary repo that portage could check and utilize when= >> a user's preferences happen to match what is pre-built. >> >> I suggest we start a different thread for any additional discussion of= >> this use case. I was thinking and it probably wouldn't be super-hard >> to actually start building something like this. But, I don't want to >> derail this GLEP as I don't see any reason designing something like >> this needs to hold up the binary package format. Both the existing >> and proposed binary package formats will encode any metadata needed by= >> the package manager inside the file, and the only extension we need is= >> to encode identifying info in the filename. >> >> My idea is to basically have portage generate a tag with all the info >> needed to identify the "right" package, take a hash of it, and then >> stick that in the filename. Then when portage is looking for a binary= >> package to use at install time it generates the same tag using the >> same algorithm and looks for a matching hash. If a hit is found then >> it reads the complete metadata in the file and applies all the sanity >> checks it already does. Generating of binary packages with the hash >> cold be made optional, and portage could also be configured to first >> look for the matching hash, then fall back to the existing naming >> convention, so that it would be compatible with existing generic >> names. So, users would get a choice as to whether they want to build >> up a library of these packages, or just have each build overwrite the >> last. >> >> Then the next step would be to allow these files to be fetched from a >> binary repo optionally, and then finally we'd need tools to create the= >> repo. But, this step isn't needed for your use case. With the proper= >> optional switches you could utilize as much of this scheme as you >> like. >> >> Also, you could optionally choose how much you want portage to encode >> in the tag and look for. Are you very fussy and only want a binary >> package with matching CFLAGS/USE/whatever? Or is just matching >> USE/arch/etc enough? Some of the existing portage options could >> potentially be re-used here. > We've already had this handled for a couple years now, via > FEATURES=3Dbinpkg-multi-instance. Working fine for me for catalyst ARM runs ... --1Sm9wvnHEXdBYWTvdbzuUxdJMgYSqcwvZ-- --I3XMmduIAMJcKDMvBH57D77TymxOkW0ti Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQIcBAEBCAAGBQJb8pRqAAoJEGPnxnn01DHd3WkP/RzF1stAeYUyufhMxRe+ZKDe OG7+Z7ZPV1W3otUfbhaZSjgf4NuRLxv8GIhOeXoigOFuiF+FEQcxwECU5Sa1kRl9 YvuKKD5WoxxXzTZEVfuJbROP83LsV6ZNqIRJLz520vLDoPvcdI5sk9RTsOQimdYK QYfYN0n0+nu+I7ILhdaka8lpDPGUbrN+MEAXcWLNBlfLAqGHhTliyFhjobh4OWQe jyAdP0hAFrJMVrZfUikJkhPp36yy27/9KVYexCZP0XQ3gli7+SyHN1uZgGMInkyc COAlli3jHuWEQt6DRyN/LYF3qKp90YpEXmvGE86+PO/rSPGDj7a82idTcr/JbRd4 +lRD4nu45X7QvvVjLDSMc49LIrEqC+o5qZ3Icrb8Pr2BFMAuNPUUza1xuCg6Tgy/ cXulm2A2kogaoTCK0mjlO+/igujO1sV/G65nvbJwPYXpy9h2CSjHdaYrRIqL625I XQIkrn8H7eBrVNwjz8AnClSEh8kVFJPliDu5lsXMxB+EwmLv5KpQS0Lusv9NdFFL Ku7Mox3U9Pp/RuPVbvmhUdaVTKsTbf7LTUyeGEHCSvxvj6V4tEeIqGOIGyOgnBfk CzBgBUis3N2r3TchAOPijI1NUjAUKgfjL2Orcu9jYPdpu69aoqx1iIXkdHqs/CDT 37DiOct6eLnER47LCehY =IzMP -----END PGP SIGNATURE----- --I3XMmduIAMJcKDMvBH57D77TymxOkW0ti--