From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) by finch.gentoo.org (Postfix) with ESMTP id 604E41387FD for ; Wed, 11 Jun 2014 13:36:33 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id CC819E0B5E; Wed, 11 Jun 2014 13:36:28 +0000 (UTC) Received: from mail-qa0-f45.google.com (mail-qa0-f45.google.com [209.85.216.45]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id EF25FE0A02 for ; Wed, 11 Jun 2014 13:36:27 +0000 (UTC) Received: by mail-qa0-f45.google.com with SMTP id v10so445651qac.4 for ; Wed, 11 Jun 2014 06:36:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type:content-transfer-encoding; bh=1lUon3anNVX0RDUE3KkcBBO3q+qW+VSRixnh9meYNuY=; b=RZURvhdOir9+3phx8W2ZKFjEfa9Y5832nW8rleuBDxU+nfuR/weqf2nxSUD7DdszMF U1pjNQbDwOKF9GSPEBUIZueDpcI+CAZrw4vYPm/iAm3beXgXSvlDvme0qYBus92pl2Kd uLYtOtIy0ZdI/7FQy10IDhCQ0Ui4p/vGRBdeuQFto7M8Vj/WXTzpUSEccXb2ViD0HCrc 9ewQvdLydZN6W1jftJOv/vO9AV+OSavCv/jDN3Lw9BWP+jFtMQTXoMn3G/mySpdFrUf6 KLQkkG93WEEvcCHWolRDIJRvaQ6f24yGVq2DfKxZjprVaR8MlnUKkI/XL16AMqKH0Pyt rGug== X-Received: by 10.229.70.196 with SMTP id e4mr51300808qcj.16.1402493787053; Wed, 11 Jun 2014 06:36:27 -0700 (PDT) Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-dev@lists.gentoo.org Reply-to: gentoo-dev@lists.gentoo.org MIME-Version: 1.0 Received: by 10.96.66.129 with HTTP; Wed, 11 Jun 2014 06:35:56 -0700 (PDT) In-Reply-To: <53982385.3090907@gentoo.org> References: <20140607201920.0e0ccd5c@gentoo.org> <53937778.7020604@sporkbox.us> <20140607230815.07bc18e7@marga.jer-c2.orkz.net> <5393B6D8.4080201@gentoo.org> <20140608135616.581807d8@marga.jer-c2.orkz.net> <53947600.50506@gentoo.org> <20140608171543.45bf6ce7@marga.jer-c2.orkz.net> <53948A21.6020809@gentoo.org> <5396106A.4010209@gentoo.org> <53962AF6.1050500@gentoo.org> <20140610194500.2185800828ffd57eb1947614@gmail.com> <53978DD1.8020603@gentoo.org> <53982385.3090907@gentoo.org> From: Duy Nguyen Date: Wed, 11 Jun 2014 20:35:56 +0700 Message-ID: Subject: Re: [gentoo-dev] The infinite git migration To: gentoo-dev@lists.gentoo.org Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Archives-Salt: b751ffcb-5ec6-4f17-990f-39653fc1d059 X-Archives-Hash: 9ba44baf1fd2c33378c5b1a26f3e2d1d On Wed, Jun 11, 2014 at 4:38 PM, Sergey Popov wrote: > 11.06.2014 04:48, Duy Nguyen =D0=BF=D0=B8=D1=88=D0=B5=D1=82: >> On Wed, Jun 11, 2014 at 5:59 AM, Patrick Lauer wrot= e: >>> Another part: Git wasn't ready. >>> The first migration attempt failed after consuming nearly 100GB of RAM! >>> When it did work it took obscene amounts of time, and the result was >>> unusably large (e.g. initial checkout would take 16GB RAM on the server= , >>> thus not allowing a few hundred devs to do checkouts the same day). >>> The current state is almost usable, but it is still obscenely slow (e.g= . >>> initial clone taking ~10 CPU-minutes just to figure out what to do), bu= t >>> we can just throw more hardware at it. >>> (10 minutes @ 3.6Ghz, so on my notebook it'll take about 4h to just >>> clone the friggin repository. Too awesome!) >> >> Since v1.9.0 we can clone from a shallow repository. We can host two >> repos on the server: a full repo and a shallow one, containing history >> of only last year. Most of the time spent in initial clone is to >> verify the history. Shorter history would shorten that time. But you >> need to try out to see how long it actually is. I'm not sure if that >> 16GB includes cloning, or just plain checkout. If the latter, Git has >> a problem. >> > > Not sure if you can commit into that shallow repo(IIRC, you can not). Not before v1.9.0. Since 1.9, shallow repos are no different than full ones. You can fetch from a shallow repo, to a shallow repo, as well as push from/to a shallow repo. --=20 Duy