From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) by finch.gentoo.org (Postfix) with ESMTP id 289FD1387FD for ; Wed, 11 Jun 2014 09:39:15 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 89A98E0A64; Wed, 11 Jun 2014 09:39:09 +0000 (UTC) Received: from smtp.gentoo.org (smtp.gentoo.org [140.211.166.183]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id 8BEBEE0962 for ; Wed, 11 Jun 2014 09:39:08 +0000 (UTC) Received: from [91.220.220.251] (pinkbyte.micronet-rostov.ru [91.220.220.251]) (using TLSv1 with cipher ECDHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) (Authenticated sender: pinkbyte) by smtp.gentoo.org (Postfix) with ESMTPSA id 4A4D533FE57 for ; Wed, 11 Jun 2014 09:39:07 +0000 (UTC) Message-ID: <53982385.3090907@gentoo.org> Date: Wed, 11 Jun 2014 13:38:13 +0400 From: Sergey Popov User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.5.0 Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-dev@lists.gentoo.org Reply-to: gentoo-dev@lists.gentoo.org MIME-Version: 1.0 To: gentoo-dev@lists.gentoo.org Subject: Re: [gentoo-dev] The infinite git migration References: <20140607201920.0e0ccd5c@gentoo.org> <53937778.7020604@sporkbox.us> <20140607230815.07bc18e7@marga.jer-c2.orkz.net> <5393B6D8.4080201@gentoo.org> <20140608135616.581807d8@marga.jer-c2.orkz.net> <53947600.50506@gentoo.org> <20140608171543.45bf6ce7@marga.jer-c2.orkz.net> <53948A21.6020809@gentoo.org> <5396106A.4010209@gentoo.org> <53962AF6.1050500@gentoo.org> <20140610194500.2185800828ffd57eb1947614@gmail.com> <53978DD1.8020603@gentoo.org> In-Reply-To: X-Enigmail-Version: 1.6 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="qVOdLJbFgqFNdJVOUPRpkJ3Acpi3EoF6l" X-Archives-Salt: 4dda15b9-62b7-42a9-87cc-a98b6dc96924 X-Archives-Hash: 1d6d33a4c7764a620a3f17917a5ac6b4 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --qVOdLJbFgqFNdJVOUPRpkJ3Acpi3EoF6l Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable 11.06.2014 04:48, Duy Nguyen =D0=BF=D0=B8=D1=88=D0=B5=D1=82: > On Wed, Jun 11, 2014 at 5:59 AM, Patrick Lauer wro= te: >> Another part: Git wasn't ready. >> The first migration attempt failed after consuming nearly 100GB of RAM= ! >> When it did work it took obscene amounts of time, and the result was >> unusably large (e.g. initial checkout would take 16GB RAM on the serve= r, >> thus not allowing a few hundred devs to do checkouts the same day). >> The current state is almost usable, but it is still obscenely slow (e.= g. >> initial clone taking ~10 CPU-minutes just to figure out what to do), b= ut >> we can just throw more hardware at it. >> (10 minutes @ 3.6Ghz, so on my notebook it'll take about 4h to just >> clone the friggin repository. Too awesome!) >=20 > Since v1.9.0 we can clone from a shallow repository. We can host two > repos on the server: a full repo and a shallow one, containing history > of only last year. Most of the time spent in initial clone is to > verify the history. Shorter history would shorten that time. But you > need to try out to see how long it actually is. I'm not sure if that > 16GB includes cloning, or just plain checkout. If the latter, Git has > a problem. >=20 Not sure if you can commit into that shallow repo(IIRC, you can not). I thought shallow clones is more suitable for users that want some state but do not want the whole history. --=20 Best regards, Sergey Popov Gentoo developer Gentoo Desktop Effects project lead Gentoo Qt project lead Gentoo Proxy maintainers project lead --qVOdLJbFgqFNdJVOUPRpkJ3Acpi3EoF6l Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQEcBAEBAgAGBQJTmCOFAAoJECo/aRed9267cx0IAIf9szs2VrGl1BAUf9XULFH0 zaySw9CCzigRpak7uVLDq1TjubdhRb8yyqqBmb2Iq8ZhCLXYop0XwNqwdiTlPt0p onnenx8ah14yPm33FBvMkfPu5gfLUpsz+rO62h7rIJhdFthfMopz6o3lYCrAQCf3 txACLHP1NgVQCbk/PNYQ6Kv1Uf6CVnbV+htJu2ML+SE5j/7pqLTknyRAQnow/3yM gg1+w3WEnqH9oqS3bVbbebWAcDxjpHWKF6soik3j2ZNh9prTwZ1RGT+2Ovbxwrb2 F4RRJQhqhR+HIBV5YYGEGlffV6O1iH1ncxUDZ6DU8f8+/exXrtFN8738BS2zTz8= =s5v0 -----END PGP SIGNATURE----- --qVOdLJbFgqFNdJVOUPRpkJ3Acpi3EoF6l--