From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by finch.gentoo.org (Postfix) with ESMTPS id 8AD6F1382C5 for ; Tue, 23 Feb 2021 20:05:52 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id E5386E084A; Tue, 23 Feb 2021 20:05:49 +0000 (UTC) Received: from smtp.gentoo.org (woodpecker.gentoo.org [IPv6:2001:470:ea4a:1:5054:ff:fec7:86e4]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id 750BFE0845 for ; Tue, 23 Feb 2021 20:05:49 +0000 (UTC) Subject: Re: [gentoo-dev] New project: binhost From: Zac Medico To: gentoo-dev@lists.gentoo.org, =?UTF-8?B?TWljaGHFgiBHw7Nybnk=?= , =?UTF-8?Q?Andreas_K=2e_H=c3=bcttel?= , Sam James Cc: binhost@gentoo.org References: <24819743.1r3eYUQgxm@farino> <20210210195128.192bbb13@abudhabi.paradoxon.rec> <3e4793a0-864d-9253-2309-55e969b8f290@gentoo.org> <860da025-1bde-8507-159c-1c94b96ab0ec@gentoo.org> <2bf5402f-41d1-34cd-ddf8-beb42efe472f@gentoo.org> <06162931-355c-1253-98fe-5e89ccd5619f@gentoo.org> Autocrypt: addr=zmedico@gentoo.org; prefer-encrypt=mutual; keydata= mQINBFs7tmwBEADTzG+IcYtRfTfKryU7sUH7LlV1M+TdaCMfIkY4x6RyHXkaaqYuQ+U9HKn0 +m5FcZsZ1Ojik+We3Tz0F6kDbam6EWzBxmsLb/IHeUEsvsuLzuBQjiD9zzqGocZiPWr+uWJs AdbueS72R7FPXJPDUEPrJ9GdhGFyYARveY9cmdisOwcDOiSFfBjk3/89t4gROn4KUhezVuO9 VS14gVSns1561CJjlB47HkSBu4+FuzrfVygg4xitWAH119Ehw0vJcgkTw4Bqhk01Iw9us80m dFyU8JbJ0CVYe30gYKFFbnXoiT6xLLogKOkv0goPFxaXcMwWM9ei3SjAGVqgN6i8VnO7kquV LwkTe6ntEK0iY+l4qTKuyIOQLpCbWNI0eVwlx5b/pY2pt5TEGWAPMCZGjlidMx0aDcVX4oji 2/xegFAcxALrfOX3kj2FZ9kNAqLZu26AfqtslIqlBEAb5sZwPr351msBIdbaWX2UNw21I478 7eQ7UfohwXQHlXdhc/wop3VDkDzLBnvlK4ozSJI/9T5F/+9yEZvc6DKUWdEfD12o2El5hHan gCUQWDBKqZb1wcekK8KY2tmH8BBQi7k52IWYLJYfJdir/XpGm5SsDpf3zvDcIFXqFHAG7w7b fhriM+6oBOeIO9ew1Xj3swbRhDwdzRUhu7Uqayq1vdvKqGkgcQARAQABtCNaYWNoYXJ5IE1l ZGljbyA8em1lZGljb0BnZW50b28ub3JnPokCVAQTAQgAPgIbAwULCQgHAwUVCgkICwUWAwIB AAIeAQIXgBYhBEdYrNjamv1GpqYECtYQzzch54rNBQJe6PQ6BQkIJuVOAAoJENYQzzch54rN 5kwP/0JoUBkfLY8upPO+QylTvchOA/4ah3G+la20J1GSlANv7sV+aV2FdMt9ZGxue/iaV0o7 hdin1yTyv8NksfQGCi8zn1NT848UmnXfVZmBVYK9tAdoMvPx6rl0oeklGCAcDHMcCXjNqrIP A5IY9UdM/OFbbig/K1fcW+UmvkJtqos4lw9XXFFhGxJXMh6f/k8fyBS6pEJjDcw/bFP4Kfmc rioFpF4N0I1+dI5Nr0msjEgc2wnMtf2DzQ7MG/XSFYhAe0/QtKIlt/PoCt9hQ4hETmPOYeja PpoHM6YrJ5k5dEyiCFYcEzX0VVS5dxbrqcmJvYJn3yxs1KpoR3+w5Y6WM1EO196Yt/moEQWK 0pxTgdtn7ztcVvVuo0O0m64YdrWgyVR8aGXENNjdS/7HTBRc7GsEATI4zev3YcIKxJSMdDx7 EjS68CvsNorrJXJuOxmcsdV6I3+Ku6r0ARlDB/myKMinwtXyQCEJpAsggLgr59EVMDXU+L6j szHDEMFM3Aw219JtL6QhjrHS2hp4g9fZJLUCEgRzgTsEG9/ruTclpygy468pFrdFl++IknsO ntIKSJm/SmsDlAlkLg7t39bSegsNLnQ/PRFVr0CDoUlc+yRHOKl/lTd3IlDW5hNE9FhnpXsG NynjIggZfBUX0nafffuJLoNHF5NG9zWexAS6T4L9uQINBFs7tmwBEACfZb/EePObKC8tuVFl IMQaTRzm7q5THbwQvbdKdw/31cdYJaZZ7BFgnSBq2CBYDPxcm+TxvvjgNTam8kZGdEpCm3/v P1YdJSoiYbisJubV7JiAOoAmGtaDOVX5thpv28HL17wqK2d5jgqMTLFeT3hyaro5cjGAQlhT NOyfwVkdFMFLjOhGzq7aki4UZ9ieS/IedoyZvOblf79d5PV1xI0mf2w5yoHcfZRv7nwI9XMz nqlgC9/RQP7O+WfCl2pl9gyd0hc3uqUWl0ke9xHvVxlEdORH/f+OzeybYj9r80GkC6MeqiG8 qzuWO0IZZ5Gvzwkq0KgRAefr9Z/4vmyOiVhJrvk1gLp6VEdB54fUO3MG/PcnYiasRJOUwRQQ 1+q25w5i9ooZRk0LQ6oNnWbeVj+Pwn0mzL0/GjkdPsYclxzOLSlRAwkisepVl62L2m+XwXsZ j9DS3vIHEbbfCmKayBuGCXQEpJMmEnGqFLnOzv29cOutm3BnGXcWAg5aJjiV5PKEmr/4g9/E J8lphGnNCRQ2DvUzO1tlHpmT+JvDBwAgo5rfq5wjjeiS578kAgPoitOBzp/z5YM5FXX+shEd i5/ratErb9ysUfr3Z45YV3yM6MHgCpEg8+5k6fM6ey4tRnxXAYdJ4XzaSyML9fsnEg9aVaCP iRl+fuLSuF1QJf7LwwARAQABiQI8BBgBCAAmAhsMFiEER1is2Nqa/UampgQK1hDPNyHnis0F Al7o9MEFCQgllFUACgkQ1hDPNyHnis2fKQ/+MXfRZofwAIB4vR6AGPQyQxYWqk5LV0H0BKAv G5q4FTMXizFrHlWZP201agJ7/Pf1wdTGVfa+XAB4EADyC+UWlALKuai28m8oF1ccfgyp23GW yDtxdZ2TtWmBAS1kxrzfsll0/3Dm4edr5diZxlsysH9J8U0y2Q3BZx4jMzBkzSev61EHwK3z lQrQSw7YJO9vM843p2hxyjgiCeC5tOmk/1wXTrv0m8kTp96p3Wc0Jfcda1aTCMJ2t3NnCtOj vTJJe11lPp0FRDfZKrkHMTopkKOUdOQUfSFI2hsh+xNC1mUDw4U3IV4Mp5rFCoXbNbq67I0B nhLgwLE4pqWaGPflkCqDmTPQ+WOYppRsU8iF1I4xD3J/SqYjeqdg+Q2DRjeoibv2y/FNlVgU aCe9zGQNELPUPQ2ifEr387EB9fgkFtpEwjyinK3wCjaso4qtXFM2twdE6ycarW0dSSqXHQaq 27wRY5jtO0ZOUJjuJTYifxG47BAbR/4oVcJpTeNUSPV/qA4K1XiIFHot5bTuAJHbSNTbskKL U1EZncrijOxdgBTamNt5ByPZR+ccfPYDev8NU+fgYA+3kKolAChdDW12jITKSa7CBMZwgqBT 1nlri5bLi+DTmDaj7tKzOeBVUIfj0aILZwSsfaCuH7HpDlxM0zS7HYO6I8ZlbF8gSOzjJqG5 Ag0EWzvRagEQANK1C/HvZgnFVa+3tFmS4OVnCRO611C7WXubm5Y2xj/Lh2LOWv5TeTtTp5FR S3961b429TbJNv0q9N4mDi6XOGpZvWLkfiDw/VT9I+48B2eVXKx5N2H48S7t1Knwut6vuTEx 14MGiZToCs2Tu1fEUnaBv2Hg60ysVfplDAQadixzboLHM1DxLYn1W/cAUrhXAW5uNQlyE0Ze kiB10JxbnAurdpRSu4X81IrGJDK/oNAgAcWRieVX5J1N5LStPrloFKf+Dtl2z49WibXVTjwF Ir/BZYprkTTgNzeM3VRPnyRz7IA1pMkVX0r4C0O38mqHyDCpkM/TKsOpNMDqYcllD8Fa/Zyg S08RLymWvRXWn7Sz7MlZE9CCQ2aG+N20esYH3nwrYsdUdj87/nSwqYKhTWwBBIWtrrCHw56O ZMTXznX3OkLOBB0gXH92G5dKv4azBeAZzR6c+qvP6PxgVuAlvlnFbzgW5m4CrkTsEwSh/s2Y d9sJPctzkPkif6tDWk0qKy9lRwTKyOK0xqwZGcJBLdqInU05DLJlrf2QJKBS2SE1tEparQvT 8/+EBpzGk0omSxGmDxLW6EY1CTXV+LfbRYz42Y71f7aVNNqfF/CbJYLupe9DadjvceRM/ZFG WO6SzWoO7ed5uT2i8M33tC2EnK/BL1oZ5Wr7Kv5XED10JI+5ABEBAAGJBNIEGAEIACYCGwIW IQRHWKzY2pr9RqamBArWEM83IeeKzQUCXuj0wQUJCCV5VwKgwdQgBBkBCAB9FiEE8OgXaltW zqgSupCu0HX7jBBKPSAFAls70WpfFIAAAAAALgAoaXNzdWVyLWZwckBub3RhdGlvbnMub3Bl bnBncC5maWZ0aGhvcnNlbWFuLm5ldEYwRTgxNzZBNUI1NkNFQTgxMkJBOTBBRUQwNzVGQjhD MTA0QTNEMjAACgkQ0HX7jBBKPSAkQw/+I/z0S3uMfcCL3DVtDX1PQKE4Pg7foiOKxJMZNiyh 4gBSCRr9cWa5BICB5OPlNzvf83LRXmOxyOa1UqFRsWQsZ60e4DSAcmnER6ePTN50AhDfpOhT SCJrtCyTtykkklGB7d91pSBvhpRxTl9ODaWQ92wypbYHX92OUrPpPZypfzKia8HKIF1FJZUm VGaCphBMnJBrrMsRFZyScIb1PagP3L1UmVVbeRwtPZCYHpr/er8zSAJQGXyoYdlgMa/7Sy7h J6mlDkEA6709c1XykZ2pMyyKtD4TbQrlCmvOY+DmRUbjHyobVSlGkL+En0TvnBrH2jhauocf g2aG+cv89+zaMrs8kuL/FGq87rnAYY77glbSRqKWGO8uhFgmLQHqKvkmG0rjiRy1yquftDKA 71kHmvb+LUvJmsD4tYotyl3vHGutq6cWJ2hzrczPlBp29YZw524zoM4pLhuwuCvnZX7jXdSR 228Gu7/iED2zULwOlzoNPSnTAVInsQEoTh2W71UKcn37tfodUyirtoyPtlaonVLUmn+bq4nD MEN7FxOiSPytM8HNsij7cR9oZYyTjtWhCBxx57kHWO/GYvGEhsR34tRz16SMNDQURM3t04G4 giDn5noh0DJywswd815JM/SMwcdkEpum1DCJpD+GJ4xtKto3p+OjO1riPDyZQGg4lOAJENYQ zzch54rNMCcP/0OQwh/SD90Y15FltrJ/gdQz49xOgriAPYuZYKSPsXfYoPwXdX9KunzZLudZ mU/4Tq4mbSyEmgKdC+RYvaRlU1MlKT767EC2l1BYB+j+LpR4n93awCjEZXD+hLCCyekpimr6 gT+rEMLg5cZgPkaVgBI2mlHZ4UE4Pm2fp3jHi8HioAReaa9387/90Ar9neXtIXR+5MhGxFjf HOTxhUStVVCgGbtOksu9xaYKpvx8e1mGtdXyEaELC/m29saPYYwbVPzAfmd8poEnkTnXdpP9 8DwBSqU6BS2TxA58GVxc49mWEq8MjJMDzEYHWrR4KiWUKKNG+obKOP5KDz8EbeXNRJm4HbZ9 WJoA7VGTOtBht/AeZ/AAZU2WafotIYwCp9X3YnXa3ykhgQIFmPVZlR3Rm8fRw2TjS0wpXorj BNQDMNEca3GBxj5yKYnZLCO8/shoHBc3j/OL/I9xT2Ru8cOliAYQduoiP9zShZGw4/lKr4d4 hxOBCEoWTwgydFXdsJEbINCWK5gvz7pNiOb09+Hi6uNyIYQ9vFSTTUaTKYVZwk0h55RcKXWe lW54GktnxxU0pszdAsxILi5A0/5yzNYazX16m3EYseCzwFQRM+PJ4/2lC/WKnbSelNnhbbhd lopMa4aFZs0j8mtbfh500sMp6uIcWsdTbrJEimM4LN4GgpSf Message-ID: Date: Tue, 23 Feb 2021 12:05:46 -0800 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.12.0 Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-dev@lists.gentoo.org Reply-to: gentoo-dev@lists.gentoo.org X-Auto-Response-Suppress: DR, RN, NRN, OOF, AutoReply MIME-Version: 1.0 In-Reply-To: <06162931-355c-1253-98fe-5e89ccd5619f@gentoo.org> Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="jq7rbLARQIImEJvCiCw2w3UndDMrUos4a" X-Archives-Salt: ddfca46d-e4a2-40af-8854-1abf49e91247 X-Archives-Hash: 761073ed26905c8fb72453690dea316f This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --jq7rbLARQIImEJvCiCw2w3UndDMrUos4a Content-Type: multipart/mixed; boundary="3JDMpeUDLv7JEkL2G7SZIXXgllp8VTcp7" --3JDMpeUDLv7JEkL2G7SZIXXgllp8VTcp7 Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable On 2/23/21 11:46 AM, Zac Medico wrote: > On 2/20/21 8:17 PM, Zac Medico wrote: >> On 2/13/21 4:53 PM, Zac Medico wrote: >>> On 2/13/21 4:37 PM, Zac Medico wrote: >>>> On 2/11/21 1:17 AM, Micha=C5=82 G=C3=B3rny wrote: >>>>> On Wed, 2021-02-10 at 19:51 +0100, Lars Wendler wrote: >>>>>> On Wed, 10 Feb 2021 19:57:48 +0200 Andreas K. H=C3=BCttel wrote: >>>>>> >>>>>>> Hi all,=20 >>>>>>> >>>>>>> I'm announcing a new project here - "binhost" >>>>>>> >>>>>>> "The Gentoo Binhost project aims to provide readily installable, >>>>>>> precompiled packages for a subset of configurations, via central >>>>>>> binary package hosting. Currently we are still in the conceptual >>>>>>> planning stage. " >>>>>>> >>>>>>> https://wiki.gentoo.org/wiki/Project:Binhost >>>>>>> >>>>>>> If you're interested in helping out, feel free to add yourself on= the >>>>>>> wiki page. >>>>>>> >>>>>>> Note that I see actually *building* the packages not as the centr= al >>>>>>> point of the project (that could be e.g. a side effect of a >>>>>>> tinderbox). I'm more concerned about >>>>>>> * what configurations should we use >>>>>>> * what portage features are still needed or need improvements (e.= g. >>>>>>> binpkg signing and verification) >>>>>>> * how should hosting look like >>>>>>> * and how we can test this on a limited scale before it goes "int= o >>>>>>> production" >>>>>>> * ... >>>>>>> >>>>>>> Comments, ideas, flamebaits? :D >>>>>>> >>>>>>> Cheers,=20 >>>>>>> Andreas >>>>>>> >>>>>> >>>>>> It would be great to improve portage speed with handling binpkgs. = I >>>>>> already have my own binhost for a couple of Gentoo systems and eve= n >>>>>> though these systems don't have to compile anything themselves, >>>>>> installing ~100 to ~200 binpkgs takes way more than an hour of >>>>>> installation time. Arch Linux' pacman only takes a fraction of thi= s >>>>>> time for the very same task. >>>>>> I know that I compare apples with pears here but even reducing the= >>>>>> current portage time by 50% would be a huge improvement. >>>>> >>>>> Is that really a problem? For me, Portage takes about an hour just= to >>>>> do the dependency processing these days. In fact, building from so= urces >>>>> is now faster than dependency calculations. >>>> >>>> The ratio of these times is dependent on the complexity of the >>>> dependencies involved, and so is the answer to your question. >>> >>> Also, in the context of binary packages, dependencies calculations ar= e >>> generally simpler for binary packages because their USE conditionals = and >>> slot-operator :=3D dependencies are frozen in a particular state. Thi= s >>> dramatically reduces the search space involved in dependency calculat= ion. >> >> IUSE_RUNTIME will obviously introduce conditionals in binary package >> dependencies, but we should welcome these conditionals because they wi= ll >> provide useful flexibility. >> >> I think IUSE_RUNTIME will be a very nice feature to have for project >> binhost, since it will allow binary package dependencies to behave wit= h >> flexibility that more closely resembles the flexibility of ebuild >> dependencies. >=20 > We can borrow paludis's notion of pbins [1] to generate ebuilds which > install pre-built content, and the generated ebuilds could have USE > flags that behave similarly to IUSE_RUNTIME in the sense that changes t= o > USE flags will result in different builds of pre-built content being > installed. A content-hash distfiles layout [2] could serve as a > convenient way to store separate builds of pre-built content for > multiple combinations of USE flags, and a generated ebuild would index > the build by USE flag combination. >=20 > Also, for the generated ebuilds, we can generate USE flags to include > separate SRC_URI downloads for pre-built content to support things like= > FEATURES=3Dsplit-debug and FEATURES=3Dinstall-sources. Note that all of this can existing EAPI features, since everything new would be implemented in an ebuild generator that generates a single ebuild to index pre-built content from multiple binary package builds. > [1] https://paludis.exherbo.org/overview/pbins.html > [2] https://bugs.gentoo.org/756778 --=20 Thanks, Zac --3JDMpeUDLv7JEkL2G7SZIXXgllp8VTcp7-- --jq7rbLARQIImEJvCiCw2w3UndDMrUos4a Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQKTBAEBCgB9FiEE8OgXaltWzqgSupCu0HX7jBBKPSAFAmA1YBtfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldEYw RTgxNzZBNUI1NkNFQTgxMkJBOTBBRUQwNzVGQjhDMTA0QTNEMjAACgkQ0HX7jBBK PSA+/xAAyx/nYI9+csOmqJIysYF9OU/JirjHNuw9qkgrF2vAVuOo4lEu4AePSv48 A9Ms68dj9zcPdFqNOBSi1r7UC45vvRcWo6R951T4pc5M0LESpLMYFbYx87ooD4qK 8eTubnZrHbO4smVKZcqcDgZuQedOIXdHX5ShhxWmdZOV0x5CEosAja2/z53DfMs1 OqLcT9uJ2ELDSMfGHXsLLjplueBNduUVOjXe614XqYuMCvFyHN9YTKadUdIVBoOP Og+cdsp/TwbX5eJYYCe2Osa1Q6+bJ54Sp1wGKzrenpq96IAWegvNAv6YwTinbH5A albna7YjVAcWiKWvqSnwEW7xPHOjLpzkAH4DzB38WXJnqLTY9upDBaLmxE987hle E/ldOS9bFzMqAkBJFhJoTiVtwpSWM7vh9fAKp6q76DMalRvyZi/1LcDoRiLx90oX TCGV1gAridMx8dOmIGgfosw49AkgGbUkjz7IRQIZIqyRtapu6DqG/G3ecsRNwqAh 1RGxghuC6Id4VxHkTyAgitjeHzIhrh4F+8WSCns1uYHkvDRY8H4v23WiAoqgsjOO yOlvdZYoQEXjjlb02xy86MxcwOrhrs1pLQ3pGC3Q3vaN771UnA8slgRi5WuS9oXU H4EcyOluQzfeY8M/In8GknGi9jx1RqqOVeKvlqhNqBV97oWGKak= =SuIR -----END PGP SIGNATURE----- --jq7rbLARQIImEJvCiCw2w3UndDMrUos4a--