* [gentoo-mirrors] Mirror survey re rsync --hard-link (distfiles/releases/experimental/snapshots)
@ 2018-01-27 0:47 99% Robin H. Johnson
0 siblings, 0 replies; 1+ results
From: Robin H. Johnson @ 2018-01-27 0:47 UTC (permalink / raw
To: gentoo-mirrors
[-- Attachment #1: Type: text/plain, Size: 1643 bytes --]
Hi,
TL;DR: is your mirror fetching with --hard-link/-H? Would adding it be
problematic for you? Speak up to save yourself bandwidth!
The infrastructure team is having some discussions [1] about splitting apart
the very large distfiles directory, as it now contains ~75000 files, and
this leads some issues on some file-systems.
The distfiles directory is around ~240GB presently, and we would like to
have a reasonable transition period for users, without temporarily
doubling the storage requirement on mirrors.
The best means for this is going to be hard-links, but I don't know how
many mirrors still have that enabled.
None of the rsync setup documentation has ever included it (either right
now or historically). It was strongly encouraged in this mailing list
back in 2004/2005, as part of the new release staging process, but the
most recent mention of hard-linking on the mailing list was Feb 2009.
Ideally, the mirrors that offer rsync service to users for distfiles
would ALSO offer hard-link fetching to users, but that isn't strictly
needed at this point.
To this end, I'm like to know
1. How many mirrors are already fetching from rsync with the
--hard-link/-H option.
2. How many mirrors would NOT be able to enable rsync fetching with
hard-links.
3. Does your mirror offer or explicitly reject hard-link data to users?
[1] https://bugs.gentoo.org/534528
--
Robin Hugh Johnson
Gentoo Linux: Dev, Infra Lead, Foundation Treasurer
E-Mail : robbat2@gentoo.org
GnuPG FP : 11ACBA4F 4778E3F6 E4EDF38E B27B944E 34884E85
GnuPG FP : 7D0B3CEB E9B85B1F 825BCECF EE05E6F6 A48F6136
[-- Attachment #2: Digital signature --]
[-- Type: application/pgp-signature, Size: 1113 bytes --]
^ permalink raw reply [relevance 99%]
Results 1-1 of 1 | reverse | options above
-- pct% links below jump to the message on this page, permalinks otherwise --
2018-01-27 0:47 99% [gentoo-mirrors] Mirror survey re rsync --hard-link (distfiles/releases/experimental/snapshots) Robin H. Johnson
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox