From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by finch.gentoo.org (Postfix) with ESMTPS id 5CE36158094 for ; Fri, 30 Sep 2022 19:49:20 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 5FACDE0B54; Fri, 30 Sep 2022 19:49:15 +0000 (UTC) Received: from mail-lf1-x129.google.com (mail-lf1-x129.google.com [IPv6:2a00:1450:4864:20::129]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id 35D81E09C2 for ; Fri, 30 Sep 2022 19:49:15 +0000 (UTC) Received: by mail-lf1-x129.google.com with SMTP id d42so8454848lfv.0 for ; Fri, 30 Sep 2022 12:49:15 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gentoo-org.20210112.gappssmtp.com; s=20210112; h=to:subject:message-id:date:from:in-reply-to:references:mime-version :from:to:cc:subject:date; bh=SVOLZRasUhgowjE8eUWJnO3K43VW11Og8x4QVbLUBXE=; b=OpmGxhF2u+YzEXO5ce2IX130CQWraEZSVAjM3SVrk7h2E9pxgydpGp24vzxJwwCNPf sP+JfI2uKqFuGEw0N3GEkIkXlesYYXEnJiOv6HZKdYhkASsOWt5ubBYL09sf4/zZic8g kfg/zleMeC39MRJ3SD8yPLw0fydWiJFx2Yqm4sABikbwrOu5IMl85lgdSV58aJuy4c9c rLq9/Cc1eQDDhTVqbQbAV+N6Gdfe1iUlcict0Xh9q4A0fBni66awfvHsQmnLTeZfWPqH pd8ZBaZihfWTebclgQ06deGtOrjuW59aTZFVIXRT5foy1H13sHXR3a9XIXAFelUAQZa1 Jgcg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=to:subject:message-id:date:from:in-reply-to:references:mime-version :x-gm-message-state:from:to:cc:subject:date; bh=SVOLZRasUhgowjE8eUWJnO3K43VW11Og8x4QVbLUBXE=; b=LupfI94lgEeTHabdeszPm9xrQL6paNYwExQ4+Fx1JFlg7ntyReBh84CW4nhI9Zu3ad H5Xcg0MBjHpNIGCT4SUdJEP30spWHmsoFT607DUqZy46NSXUn1Yr124PnWwJJ8HFoC6e BsGfMtmENoJkjCk/eUW8raKi+UjWzPrMqnBjrxXp21uGABuhoVdsIR/ClOfBYzzQf0J+ 4icA+4cJ4BF8UgOUHIN1ijin1kHAx+6tqKUSGRhT1FT/qIEHl8yeocsHvcAgBEezHKM0 lIW47eK8dW+P0Ikg8ZLX1jypbIjMtNg5LRDYc5rQY6h7J3qTWI2zOgV9osvqvP6fCHcE znxA== X-Gm-Message-State: ACrzQf3nPsWwk4LHB4HPy324e1dfHaAL9ilNv7r4vcU1va7I5Bi46EHz 0a1zBzsr+gwa4nFgA2Y9ljCExj+Oe42t5xdqbrlnXYereTsotp06 X-Google-Smtp-Source: AMsMyM6v/yqJ1hzxO7KpofAYxbSKUX/oNvk/H7KI0AoZGQD9Fu2yqHSSd0O6XLO4gFj1h9i4TDncuu8TI564HEJSIpE= X-Received: by 2002:ac2:4842:0:b0:4a0:53a0:51c with SMTP id 2-20020ac24842000000b004a053a0051cmr3659903lfy.202.1664567353149; Fri, 30 Sep 2022 12:49:13 -0700 (PDT) Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-dev@lists.gentoo.org Reply-to: gentoo-dev@lists.gentoo.org X-Auto-Response-Suppress: DR, RN, NRN, OOF, AutoReply MIME-Version: 1.0 References: <20220613074411.341909-1-flow@gentoo.org> In-Reply-To: From: Alec Warner Date: Fri, 30 Sep 2022 12:49:02 -0700 Message-ID: Subject: Re: [gentoo-dev] Proposal to undeprecate EGO_SUM To: gentoo-dev@lists.gentoo.org Content-Type: text/plain; charset="UTF-8" X-Archives-Salt: b562fdc2-661c-437b-adeb-b4d831090693 X-Archives-Hash: cc5930819e9742d16c6fafe506727e47 On Fri, Sep 30, 2022 at 7:53 AM Florian Schmaus wrote: > > On 30/09/2022 02.36, William Hubbs wrote: > > On Wed, Sep 28, 2022 at 06:31:39PM +0200, Ulrich Mueller wrote: > >>>>>>> On Wed, 28 Sep 2022, Florian Schmaus wrote: > >>> 2.) the number of EGO_SUM entries exceeds 1000 and a Gentoo developer > >>> maintains the package > >>> 3.) the number of EGO_SUM entries exceeds 1500 and a proxied > >>> maintainer maintains the package > >> > >> These numbers seem quite large, compared to the mean number of 3.4 > >> distfiles for packages in the Gentoo repository. (The median and the > >> 99-percentile are 1 and 22, respectively.) > > The numbers may appear large when compared to the whole tree, but I > think a fair comparison would be within the related programming language > ecosystem, e.g., Golang or Rust. > > For example, analyzing ::gentoo yields the following histogram for > 2022-01-01: > https://dev.gentoo.org/~flow/ego_sum_entries_histogram-2020-01-01.png > > > > To stay with your example, restic has a 300k manifest, multiple 30k+ > > ebuilds and897 distfiles. > > > > I'm thinking the limit would have to be much lower. Say, around 256 > > entries in EGO_SUM_SRC_URI. > > A limit of 256 appears to be to low to be of any use. It is slightly > above the 50th percentile, half of the packages could not use it. > > We have to realize that programming language ecosystems that only build > static binaries tend to produce software projects that have a large > number of dependencies. For example, app-misc/broot, a tool written in > Rust, has currently 310 entries in its Manifest. Why should we threat > one programming language different from another? Will be see voices that > ask for banning Rust packages in ::gentoo in the future? With the rising > popularity of Golang and Rust, we will (hopefully) only ever see an > increase of such packages in ::gentoo. And most existing packages in > this category will at best keep their dependency count constant, but are > also likely to accumulate further dependencies over time. > > And quite frankly, I don't see a problem with "large" Manifests and/or > ebuilds. Yes, it means our FTPs are hosting many files, in some cases > even many small files. And yes, it means that in some cases ebuild > parsing takes a bit longer. But I spoke with a few developers in the > past few months and was not presented with any real world issues that > EGO_SUM caused. If someone wants to fill in here, then now is a good > time to speak up. But my impression is that the arguments against > EGO_SUM are mostly of cosmetic nature. Again, please correct me if I am > wrong. I thought the problem was that EGO_SUM ends up in SRC_URI, which ends up in A. A ends up in the environment, and then exec() fails with E2BIG because there is an imposed limit on environment variables (and also command line argument length.) Did this get fixed? https://bugs.gentoo.org/719202 > > - Flow