[gentoo-portage-dev] Portage Feature Request: making thirdpartymirrors easier to manage

[gentoo-portage-dev] Portage Feature Request: making thirdpartymirrors easier to manage

[Robin H. Johnson]

This is a small feature request, but it will require a modification to
PMS, so I describe it here.

The present thirdpartymirrors file is unwieldy, and difficult to manage
due to it's format with very long lines. It also doesn't permit easy
comments. Presently commits to it look very ugly, because diffs are
line-based, and we pack a lot into each line.

I would like to make it a directory instead of a single file, and extend
the internal syntax.

1. New location: $PROFILEDIR/thirdpartymirrors/$MIRRORNAME
1.1. The name of the mirror is now the name of the file.
1.2. We can have a file extension of .mirrors if somebody would like
     that.

2. New format (for directory-mode):
2.1. Comments permitted, shell-style.
2.2. Blank lines ignored
2.3. One URL per line, optionally prefixed with "-" or "+"
2.4. For stack repos/overlays:
2.4.1. No prefix: replace all prior mirrors from masters with new URLS in this file.
2.4.2. "-" prefix: remove this URL from the list from masters.
2.4.2. "+" prefix: append this URL to the list from masters.

3. New format (for file-mode):
3.1. This is for cases where thirdpartymirrors is still a file.
3.2. The first token on a line remains the name of the mirror.
3.3. Each subsequent token may be prefixed with "+" or "-", and impacts
     prior lines/masters.

-- 
Robin Hugh Johnson
Gentoo Linux: Developer, Infrastructure Lead
E-Mail     : robbat2@gentoo.org
GnuPG FP   : 11ACBA4F 4778E3F6 E4EDF38E B27B944E 34884E85

[gentoo-portage-dev] Re: [gentoo-dev] Portage Feature Request: making thirdpartymirrors easier to manage

[Kent Fredric]

[-- Attachment #1: Type: text/plain, Size: 1106 bytes --]

On 10 January 2014 17:58, Michał Górny <mgorny@gentoo.org> wrote:

>
> Just to be clear, what is the exact use case for this? I can't think
> of a really good reason to manipulate mirror lists in subsequent repos.
>

For Perl, in ::gentoo , its considered not too optimal to have backpan
listed as a mirror, and its unnesscary, as ::gentoo gets to mirror
everything on cpan anyway, so that there's no problem when upstream delete
the version gentoo is using from cpan.

But in the overlay, we don't have the luxury of a mirror, so we have
backpan listed as a mirror for when cpan deletes a release.

diff <( grep cpan
/var/paludis/repositories/perl-git/profiles/thirdpartymirrors  ) <( grep
cpan /usr/portage/profiles/thirdpartymirrors  )
1c1
< cpan          http://search.cpan.org/CPAN http://cpan.hexten.net/
http://cpan.cpantesters.org http://www.cpan.org http://backpan.perl.org
---
> cpan          http://search.cpan.org/CPAN http://www.cpan.org

So here, it would be nicer if we could simply specify new mirrors instead
of having to override the whole thing.

-- 
Kent

[-- Attachment #2: Type: text/html, Size: 2014 bytes --]

[gentoo-portage-dev] Re: [gentoo-dev] Portage Feature Request: making thirdpartymirrors easier to manage

[Kent Fredric]

[-- Attachment #1: Type: text/plain, Size: 832 bytes --]

On 12 January 2014 08:16, Kent Fredric <kentfredric@gmail.com> wrote:

> diff <( grep cpan
> /var/paludis/repositories/perl-git/profiles/thirdpartymirrors  ) <( grep
> cpan /usr/portage/profiles/thirdpartymirrors  )
>


Oh... also, there's a wide variety of location specific CPAN mirrors
available that are location-specific.

Specifying them in GENTOO_MIRRORS will simply mess up portage as they'll
tell portage to try them for gentoo packages too, which will mean a lot of
waiting while gentoo erroneously tries to fetch files from servers that
will never have them.

So having a location-specific subkey for each class of mirrors, and having
a priority within each class of mirrors, so that users can just specify
their location and the fetch system uses an appropriate mirror for each
mirror class, that'd be great.


-- 
Kent

[-- Attachment #2: Type: text/html, Size: 1345 bytes --]