From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from pigeon.gentoo.org ([208.92.234.80] helo=lists.gentoo.org) by finch.gentoo.org with esmtp (Exim 4.60) (envelope-from ) id 1SNJyB-0008WI-4k for garchives@archives.gentoo.org; Thu, 26 Apr 2012 08:22:31 +0000 Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id A5AD4E06F7; Thu, 26 Apr 2012 08:22:12 +0000 (UTC) Received: from mail-bk0-f53.google.com (mail-bk0-f53.google.com [209.85.214.53]) by pigeon.gentoo.org (Postfix) with ESMTP id 40504E0687 for ; Thu, 26 Apr 2012 08:21:36 +0000 (UTC) Received: by bkcjk13 with SMTP id jk13so393724bkc.40 for ; Thu, 26 Apr 2012 01:21:36 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; bh=tyPTwq++X6ffjkGRzgebGpXDO+efNTabkUThkmGsabE=; b=f/Xa37n3YQmfqheUJ7XZqwrk4TcFvU3Xgl/qSWvjxqeYXhCVnpoDpVfL/xANwVzNdF ZrXl/X+BImEt8Rx4Cx0c+kLfoB7dcCEz23PVIScTWHq7oHl8KRlZVQxsaGaIi94O/TU3 KGntTf6Exshw3Od+Vlck7Xv6eXoCLUmVsske3vY5U20cpzdyHrLxqKFCSsJRuHOQ8Mfh v96Sq5FRNzU/U7aTSn4zvG5qK/sjbqeZWKrJNWzmL9UajtfN3/yRCeejPJoor50lYcC4 Q8m2qN4me8ly21bpgn9YRH0G4Y0d6dFOnSG+xB9ybYqVXYrUUtLHXI9vIuv6jy94A6e6 8rXQ== Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-dev@lists.gentoo.org Reply-to: gentoo-dev@lists.gentoo.org MIME-Version: 1.0 Received: by 10.204.152.88 with SMTP id f24mr1870407bkw.121.1335428496179; Thu, 26 Apr 2012 01:21:36 -0700 (PDT) Received: by 10.205.82.129 with HTTP; Thu, 26 Apr 2012 01:21:36 -0700 (PDT) In-Reply-To: <4F990226.8030800@gentoo.org> References: <20120424130959.GB13543@falgoret> <20120424183826.499652b0@pomiocik.lan> <20120425184128.0f4a00d6@pomiocik.lan> <4F98FFD6.1060402@gentoo.org> <4F990226.8030800@gentoo.org> Date: Thu, 26 Apr 2012 10:21:36 +0200 Message-ID: Subject: Re: [gentoo-dev] [RFC] New third party mirrors From: Corentin Chary To: Zac Medico Cc: gentoo-dev@lists.gentoo.org, =?UTF-8?B?TWljaGHFgiBHw7Nybnk=?= , robbat2@gentoo.org Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Archives-Salt: bcbfde79-7189-467f-8efc-fbf1f4b4ea12 X-Archives-Hash: 7d1aa81a3d04c070674a4da5dfd4a915 On Thu, Apr 26, 2012 at 10:07 AM, Zac Medico wrote: > On 04/26/2012 01:03 AM, Corentin Chary wrote: >> On Thu, Apr 26, 2012 at 9:57 AM, Zac Medico wrote: >>> On 04/26/2012 12:30 AM, Corentin Chary wrote: >>>> On Wed, Apr 25, 2012 at 6:41 PM, Micha=C5=82 G=C3=B3rny wrote: >>>>> On Wed, 25 Apr 2012 09:16:05 +0200 >>>>> Corentin Chary wrote: >>>>> >>>>>> On Tue, Apr 24, 2012 at 6:38 PM, Micha=C5=82 G=C3=B3rny >>>>>> wrote: >>>>>>> On Tue, 24 Apr 2012 16:19:11 +0000 >>>>>>> "Robin H. Johnson" wrote: >>>>>>> >>>>>>>> On Tue, Apr 24, 2012 at 04:50:49PM +0200, Corentin Chary wrote: >>>>>>>>>>> $ ./mirrors.py --all --count >>>>>>>>>>> 297 ?? ?? http://pear.php.net >>>>>>>>>>> 297 ?? ?? http://pear.php.net/get >>>>>>>>>>> 88 ?? ?? ??http://pecl.php.net >>>>>>>>>>> 88 ?? ?? ??http://pecl.php.net/get >>>>>>>>>> These are already mirror bouncers. If you visit the above, >>>>>>>>>> you'll get the closest mirror for downloading. >>>>>>>>> And since there is already ~10 "mirrors" with only one actual >>>>>>>>> backend, should they go to thirdpartymirrors or not ? If not, >>>>>>>>> what about this pseudo-mirrors already present in >>>>>>>>> thirdpartymirrors ? >>>>>>>> I think we should add the pseudo-mirrors, but explicitly mark them >>>>>>>> as such in the file, so that they don't get duplicate entries >>>>>>>> added (eg adding us.pear, de.pear and the pear bouncer is bad. >>>>>>>> Should have just the bouncer). >>>>>>> >>>>>>> It'd be great if we could add some kind of additional mirror >>>>>>> entries, which would be used by repoman to signal missing mirror:// >>>>>>> entries but won't be used for downloads. >>>>>> >>>>>> Yep, we could put that in it too: >>>>>> github =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0http:/= /github.com/downloads/ >>>>>> https://github.com/downloads/ >>>>> >>>>> Per spec, portage can choose a random mirror of the list. If we put >>>>> entries like that, these two will be equally possible as the preferre= d >>>>> cloud. URL -- while they redirect one to another. >>>>> >>>>> We might decide on some common syntax like preceding all extra entrie= s >>>>> with '-' but I don't want to be the one deciding here. >>>> >>>> I checked, and current portage code already handle entries starting >>>> with a - gracefully thanks to stack_dictlist (removing them from the >>>> list of mirrors). >>> >>> That means repoman will ignore them too. If you want existing versions >>> of repoman to check for those paths in SRC_URI, you can add a line like >>> this to thirdpartymirrors: >>> >>> github-bad-urls http://github.com/downloads/ https://github.com/downloa= ds/ >> >> Hum, I checked repoman source code, and I didn't find where it checks >> if SRC_URI matches something in thirdpartymirror. Any hint ? > > Search for SRC_URI.mirror in /usr/bin/repoman. Arg.. ok, I only looked in pym/repoman/. So two solutions here: First one: github http://cloud.github.com/downloads -http://github.com/downloads/ -https://github.com/downloads/ + a small patch that would allow repoman to do something like settings.thirdpartymirrors(keep_bad_uris=3DTrue) in order to keep uris starting with a - in the list. Second solution: github http://cloud.github.com/downloads github-bad-uris -http://github.com/downloads/ -https://github.com/downloads= / The good thing with the first one is that it would allow repoman to outputs something like "you should use 'mirror://github'". --=20 Corentin Chary http://xf.iksaif.net