From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by finch.gentoo.org (Postfix) with ESMTPS id 3D657138334 for ; Sun, 16 Dec 2018 06:50:51 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 0333CE093D; Sun, 16 Dec 2018 06:50:50 +0000 (UTC) Received: from mail-oi1-x243.google.com (mail-oi1-x243.google.com [IPv6:2607:f8b0:4864:20::243]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id B7EA5E0934 for ; Sun, 16 Dec 2018 06:50:49 +0000 (UTC) Received: by mail-oi1-x243.google.com with SMTP id c206so7829962oib.0 for ; Sat, 15 Dec 2018 22:50:49 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=4n9TkyywlA3hmMxegiq+nLq4bU1clpH6Db4ZyhRHrjE=; b=nq9K/+midWfLk6DZ6u15zO3ea1cYthrjccmQ7I9NhUKula5vOBGd7003ePiURd5woY E3J2Mkz8iA4Hj76U16zZVjKFYnIMKvyfKiZPcO5eAYtMbR3sRVKdzv8CA/mHob25e4YY ej2YqsQAEd5BH5AdTSLyqUxtx+EM3LU3LaW+IC1DSh5ccblDmj/HJcGpv3K5VHImwFqE fVoeihQjvI5WavC2F65vY/hX0DRC0pelCzJx8nXO9tN5VkGit3IJLfmNyO47p9grNP5r ad6rM9+LKsO8/jVCYTl86mCqJ4jz4GblLG8rx44psZ4z5QICEY1FYjxh4u6y/C6yRSrH dvYA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=4n9TkyywlA3hmMxegiq+nLq4bU1clpH6Db4ZyhRHrjE=; b=f6Qefyv1LN4XG0jD+9bkaEmO7fDYHp/ynz5n4WdsJi6m5A7Ajsc2wvr3YwbtPMa70s ib9dsUc0FEJNxuAMBZVj7fb3jwHXeUq2dzuIiPFwpyrH28Ft0+BdTcvBKWkWsm8M0/7g Ll1Vziy8bV0gJP/wpYVLIeXOgjgsE/pXi6CNDaj+/NdneSxCOYJSjntp1nGEJ/0zMWJO GRhKtFc2+4Gxz0huElSgYKUUWEN0ORCrCFKKLU3XAneTzRdM+l50ben8yYUTrEgRe47n 1SbkIjt2moriSZ7WSHJB1FwG7wYpKWQhwhnY563C7qpDfosYE+MCLo92GCdMnzdR6kSq Iobw== X-Gm-Message-State: AA+aEWagHJLXdwHmqqtUYSvkIDCzdz+j3Fw/e6R3cJUBtAkyoldtvF7C xQEga1Pb5VZCgPPvM7HM7QyWjKaPzmEEPTcDdlJZTxZk X-Google-Smtp-Source: AFSGD/XF+EMrKhYiYp/r11G03XLQ38qpoSOjW2Jpi8jSirlxtXUd7I1o/kD9lnDKXVJJur68DABceBwn1z8eOAKGtXA= X-Received: by 2002:a54:4581:: with SMTP id z1mr2783342oib.192.1544943048322; Sat, 15 Dec 2018 22:50:48 -0800 (PST) Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Project discussion list X-BeenThere: gentoo-project@lists.gentoo.org Reply-To: gentoo-project@lists.gentoo.org X-Auto-Response-Suppress: DR, RN, NRN, OOF, AutoReply MIME-Version: 1.0 References: <1600658.mo6uCtQdLC@reaper> In-Reply-To: From: Raymond Jennings Date: Sat, 15 Dec 2018 22:50:12 -0800 Message-ID: Subject: Re: [gentoo-project] RFC: Dropping rsync as a tree distribution method To: gentoo-project@lists.gentoo.org, antarus@gentoo.org Cc: Zac Medico Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Archives-Salt: 910c042d-f165-4627-bfad-6998a4b11bac X-Archives-Hash: 618ad661f0973f289f6549bd01b6986c I filed a bug on this suggestion myself recently, here: https://bugs.gentoo.org/671174 The commentary there from the others may prove useful in this conversation. On Sat, Dec 15, 2018 at 9:18 PM Alec Warner wrote: > > > > On Sun, Dec 16, 2018 at 12:13 AM Georgy Yakovlev w= rote: >> >> On Saturday, December 15, 2018 8:40:38 PM PST Matt Turner wrote: >> > On Sat, Dec 15, 2018 at 11:16 PM Alec Warner wrot= e: >> > > - Disk usage for git vs rsync >> > >> > This is why I have not switched. With git you pull down increasing >> > amounts of history, whereas with rsync the data fits easily in a <1GB >> > partition. >> >> Recent portage can use sync-depth =3D 1 >> repo dir no longer grows as it used to and it's works fine unlike initia= l >> implementation that was giving trouble >> >> https://bugs.gentoo.org/552814 >> >> du -hs /var/db/repos/gentoo >> 350M /var/db/repos/gentoo >> >> example /etc/portage/repos.conf/gentoo.conf : >> [DEFAULT] >> main-repo =3D gentoo >> >> [gentoo] >> auto-sync =3D yes >> location =3D /var/db/repos/gentoo >> sync-type =3D git >> sync-uri =3D https://github.com/gentoo-mirror/gentoo.git >> sync-depth =3D 1 >> sync-git-clone-extra-opts =3D -b master >> sync-git-verify-commit-signature =3D true >> >> >> sync is almost instantaneous compared to rsync, but some folks not going= to >> like github as a mirror in this case. > > > I don't plan on using github for the mirror, so I'm not overly worried ab= out that portion. > > +Zac Medico > > My recollection was that git doesn't ship with ebuild metadata by default= , so even if we make the first sync fast (by using depth=3D1 in the clone) = do we have a good story for ebuild metadata? Is portage just faster than in= the past for ebuilds with missing metadata? Does emerge --sync handle meta= data regen for syncs with git origins? > > -A > >> >> >> >> -- >> Georgy Yakovlev >> Gentoo Linux Developer