From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by finch.gentoo.org (Postfix) with ESMTPS id 4A63F138334 for ; Tue, 18 Dec 2018 11:55:33 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id B94B9E0798; Tue, 18 Dec 2018 11:55:31 +0000 (UTC) Received: from smtp.gentoo.org (dev.gentoo.org [IPv6:2001:470:ea4a:1:5054:ff:fec7:86e4]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id 7EE2FE077C for ; Tue, 18 Dec 2018 11:55:31 +0000 (UTC) Received: from pomiot (d202-252.icpnet.pl [109.173.202.252]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) (Authenticated sender: mgorny) by smtp.gentoo.org (Postfix) with ESMTPSA id 9389C335C5A; Tue, 18 Dec 2018 11:55:28 +0000 (UTC) Message-ID: <1545134118.924.3.camel@gentoo.org> Subject: Re: [gentoo-project] RFC: Dropping rsync as a tree distribution method From: =?UTF-8?Q?Micha=C5=82_G=C3=B3rny?= To: gentoo-project@lists.gentoo.org Date: Tue, 18 Dec 2018 12:55:18 +0100 In-Reply-To: <20181218125555.1927321328046d0a2ecd3e16@gentoo.org> References: <20181218125555.1927321328046d0a2ecd3e16@gentoo.org> Organization: Gentoo Content-Type: multipart/signed; micalg="pgp-sha512"; protocol="application/pgp-signature"; boundary="=-rUBVhD99pBeoFLXNgbUe" X-Mailer: Evolution 3.26.6 Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Project discussion list X-BeenThere: gentoo-project@lists.gentoo.org Reply-To: gentoo-project@lists.gentoo.org X-Auto-Response-Suppress: DR, RN, NRN, OOF, AutoReply Mime-Version: 1.0 X-Archives-Salt: af5ef431-ad0c-4ef6-8e1e-9f17ba0d109d X-Archives-Hash: 23c2b0b810c6bcd42459ceccd006dcba --=-rUBVhD99pBeoFLXNgbUe Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Tue, 2018-12-18 at 12:55 +0300, Andrew Savchenko wrote: > On Sat, 15 Dec 2018 23:15:47 -0500 Alec Warner wrote: > > Hi, > >=20 > > I am currently embarking on a plan to redo our existing rsync[0] mirror > > network. The current network has aged a bit. Its likely too large and i= s > > under-maintained. I think in the ideal case we would instead pivot this > > project to scaling out our git mirror capabilities and slowly migrate a= ll > > consumers to pulling the git tree directly. To that end, I'm looking fo= r > > blockers as to why various customers cannot switch to pulling the gento= o > > ebuild repository from git[1] instead of rsync. > >=20 > > So for example: > >=20 > > - bandwidth concerns (preferably with documentation / data.) > > - Firewall concerns > > - CPU concerns (e.g. rsync is great for tiny systems?) > > - Disk usage for git vs rsync > > - Other things i have not thought of. >=20 > My main concern with git is downlink fault tolerance. If rsync > connection is broken, it can be easily restored without much data > retransmission. If git download connection is broken, it has to > start all over again. So there are cases where rsync will be always > much more preferable than git. >=20 I think this mostly applies to the initial clone, and in this case the git bundles (that will be) offered by Infra should solve it. You'd download them over regular HTTP(S) connection which you can freely resume. --=20 Best regards, Micha=C5=82 G=C3=B3rny --=-rUBVhD99pBeoFLXNgbUe Content-Type: application/pgp-signature; name="signature.asc" Content-Description: This is a digitally signed message part Content-Transfer-Encoding: 7bit -----BEGIN PGP SIGNATURE----- iQKTBAABCgB9FiEEXr8g+Zb7PCLMb8pAur8dX/jIEQoFAlwY4CZfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldDVF QkYyMEY5OTZGQjNDMjJDQzZGQ0E0MEJBQkYxRDVGRjhDODExMEEACgkQur8dX/jI EQqNlxAAuzXdG1Rxlv98ZGQFORXGtNp4+IxsUQBQrtsiYmAM+gvnRGftNOymsZqI xKhwaht/Ys3GD1x0slmVuuy1oQRrRDs//By/+/NGlpEuYNIY0QzDwQ15jQ7HAt/S 7c7xKLSzmgOx+X9mOJMuXOEszrmFjCd+Cet+Txkx9X5mel0KS66w/l3Fxo01Ebi7 EAwS+KS94j/UcXIR8a0ohsCcsq+UJpSHoDnbBlbb6OkrMOR4X2aRyHtarGjB6rbR 27Lg97xjYharSVU8ouOSDiTvULzZt4rQbRrmFgg94WX+zBkwce5qr8IdUXgyKGKQ 4YCy/r4NK1tzpTVfoC2uClJm79uDN0kw/Y1FjV1a+968t5TZTXfQygNLsRODBU3/ 4YmtPb8C/LZ7eSfpiFjwyU/8auSfvmxntmYMCt8YGxEFPX+KDU2fjGNjrVbzlZ4u f67JP6wvd5gaU0i+iAfD9dsu+L5pmqzNq2o5+Hkw5uY3iTA0NXIvzjFOBeYMeyd0 UNwKZuupM2JSrlxj547C1MgavcL4ndoX5UQW6TCQOgHmPOJvrPTYGcKoMEAcm2SL VbneG2AoCBj73AfNy0Zl1DDFtSz79RwaUc5KRSTCFAs6Zw8n1JWbjDHbUCi94wib rcGRrZkAMzIHpblAJf24c3Ui64Ts3WNk9Pz4zHWcF34G/c00r6E= =7iej -----END PGP SIGNATURE----- --=-rUBVhD99pBeoFLXNgbUe--