From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by finch.gentoo.org (Postfix) with ESMTPS id 7A016158089 for ; Mon, 18 Sep 2023 18:10:21 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 0C6F82BC0D0; Mon, 18 Sep 2023 18:10:17 +0000 (UTC) Received: from mail-yb1-xb31.google.com (mail-yb1-xb31.google.com [IPv6:2607:f8b0:4864:20::b31]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id 964832BC016 for ; Mon, 18 Sep 2023 18:10:16 +0000 (UTC) Received: by mail-yb1-xb31.google.com with SMTP id 3f1490d57ef6-d8168d08bebso4642769276.0 for ; Mon, 18 Sep 2023 11:10:16 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1695060616; x=1695665416; darn=lists.gentoo.org; h=to:subject:message-id:date:from:in-reply-to:references:mime-version :from:to:cc:subject:date:message-id:reply-to; bh=CALXFvjbm6xYv4RRG9XoFVOcYaozxu0i4w5OW9SCSks=; b=goL8b9FddSqde7vngVaUnaeMVxY2NmVlsO5thV4DDQnkIKmmvM7l/huIxZHsdTNhfK onYC+eCrQq4PPltuTx3KFzc2lbGOB5167+zsecgAEgB8USdkc4YOzza6ucgOcfImVTK+ iHW+MUDs7FvRHpkZrjyEpfNzRL5a9hRNgfx39+K4M4qpMkdTnQvVnPAEwqzWd4zJTX3M 7KjlK24njroc8xoW7u6RmJzHyN6KZuateA/ctgM6IKnVXfDhbNqb4kKvo/YRgUYKLymM mwnvwDo9AuOdYzwoT0W1fo+lA61jERhsfLes7u9hkGLmicFyR7p0CyFbogs4ibwx6cFN PKKA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1695060616; x=1695665416; h=to:subject:message-id:date:from:in-reply-to:references:mime-version :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=CALXFvjbm6xYv4RRG9XoFVOcYaozxu0i4w5OW9SCSks=; b=Q1ih8bUN9e90iU1Sf2J5o6zkXkGQ/0t3JxgUR5hp4RWEEPfbiYaPLHC/jFEXMYw1ij 6Uip3Qx6BMJln9LihyY9BmxTgM6cxukdrAjIPYRcwU+u6ZGUNGWecLaXcuh1fDDPBE8r cim34+mO1qgkfRjtIlcCdUcYgPGZ3R0jcseMRMvF3u1uXJj7WPm8nC1/BznMvUgU75Th G5LpHZSyjq4PC1ew1huGwggslGoUQUB3qqDqc2oJMNnMkqMRPC+ltda7yCm3IEf0L07+ ANff/QgL/o04TCMA0j4GIY2LKJBw9V/DFqpE6sOcX6HDu83G3w3l1WQq0FxAiRLGApib poEg== X-Gm-Message-State: AOJu0YzGSayONELKgrBO74QSV0mcHd4vhgN3dWxMaMEHFQ/XHUR/40Sf E2Cqa+PGCpusrpiI5DzWcrtT+OaWptq14d98bgmSzFnZ X-Google-Smtp-Source: AGHT+IH3liSVw6YEaLs+W/xDsPzqqZO5Mvzd/SCxP3y0KkG2y/lD6sDdx8sxYYqay+BN9yULLEJ7yVk6b6EH0S05NP8= X-Received: by 2002:a5b:d46:0:b0:d11:61da:3a58 with SMTP id f6-20020a5b0d46000000b00d1161da3a58mr8940076ybr.54.1695060615619; Mon, 18 Sep 2023 11:10:15 -0700 (PDT) Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-user@lists.gentoo.org Reply-to: gentoo-user@lists.gentoo.org X-Auto-Response-Suppress: DR, RN, NRN, OOF, AutoReply MIME-Version: 1.0 References: <4531844.LvFx2qVVIh@wstn> <8292274.T7Z3S40VBb@wstn> <1983362.usQuhbGJ8B@wstn> In-Reply-To: From: John Blinka Date: Mon, 18 Sep 2023 14:10:04 -0400 Message-ID: Subject: Re: [gentoo-user] Controlling emerges To: gentoo-user@lists.gentoo.org Content-Type: multipart/alternative; boundary="000000000000dde90b0605a60d2f" X-Archives-Salt: f19deecb-2b02-454a-b39a-6293adda38f7 X-Archives-Hash: 7d2d413c38bc8858beade7ef48b7dc27 --000000000000dde90b0605a60d2f Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Mon, Sep 18, 2023 at 12:13 PM Alan McKinnon wrote: > > > If webkit-gtk is the only big package, have you considered: > > emerge -1v webkit-gtk && emerge -avuND @world? > > > What you have is not a portage problem. It is a orthodox parallelism > problem, and I think you are thinking your constraint is unique in the wo= rk > - it isn't. > With parallelism, trying to fiddle single nodes to improve things overall > never really works out. > > Just my $0.02 > > > Alan > I use this idea, but it requires (for me) a more sophisticated implementation. As is, it pulls in webkit-gtk-x.y.z and webkit-gtk-x.y.z-r410 simultaneously - for my portage setup. I don=E2=80=99= t have the memory to handle both at the same time. It=E2=80=99s guaranteed to cras= h on my system. Instead, I do a preliminary emerge -p, saving the specific package builds to a file. I then inspect the file to see what portage wants to do. Too often, the file contains webkit-gtk-x.y.z and webkit-gtk-x.y.z-r410 in sequence, usually preceded and followed by other packages. Portage always wants to build both versions simultaneously - guaranteed crash for me. Instead of invoking emerge, I write a little bash script to emerge the preceding packages in parallel, followed by a serial webkit-gtk-x.y.z, followed by a serial webkit-gtk-x.y.z-r410, and then finally all the remaining packages. Four emerge invocations in sequence. The script builds specific versions, ie, =3Dnet-libs/webkit-gtk-x.y.z, to ensure it builds on= ly 1 package at a time. It=E2=80=99s trivial to write. A problem arises when splitting up builds as you suggest. Emerge has its own ideas about what it=E2=80=99s going to do - and in what sequence. When = you try to impose a build order not of its making, emerge will often do something unintuitive and frustrating to you. I=E2=80=99ve learned to respect its seq= uencing. This technique keeps portage happy and predictable by using its sequencing. It gives me reliable overnight unattended upgrades. John Blinka > --000000000000dde90b0605a60d2f Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


On Mon, Sep 18, 2023 at 12:13 PM Alan McKinnon <alan.mckinnon@gmail.com> wrote:<= br>

I use this idea, but it requires (for me) a more sophist= icated implementation. As is, it pulls in webkit-gtk-x.y.z and webkit-gtk-x= .y.z-r410 simultaneously - for my portage setup. I don=E2=80=99t have the m= emory to handle both at the same time. It=E2=80=99s guaranteed to crash on = my system.

Instead, I do= a preliminary emerge -p<etc>, saving the specific package builds to = a file. I then inspect the file to see what portage wants to do. Too often,= the file contains webkit-gtk-x.y.z and webkit-gtk-x.y.z-r410 in sequence, = usually preceded and followed by other packages. Portage always wants to bu= ild both versions simultaneously - guaranteed crash for me.

Instead of invoking emerge, I write a= little bash script to emerge the preceding packages in parallel, followed = by a serial webkit-gtk-x.y.z, followed by a serial webkit-gtk-x.y.z-r410, a= nd then finally all the remaining packages. Four emerge invocations in sequ= ence. The script builds specific versions, ie, =3Dnet-libs/webkit-gtk-x.y.z= , to ensure it builds only 1 package at a time. It=E2=80=99s trivial to wri= te.

A problem arises whe= n splitting up builds as you suggest. Emerge has its own ideas about what i= t=E2=80=99s going to do - and in what sequence. When you try to impose a bu= ild order not of its making, emerge will often do something unintuitive and= frustrating to you. I=E2=80=99ve learned to respect its sequencing. This t= echnique keeps portage happy and predictable by using its sequencing. It gi= ves me reliable overnight unattended upgrades.

<= /div>
John Blinka=C2=A0
--000000000000dde90b0605a60d2f--