public inbox for gentoo-dev@lists.gentoo.org
 help / color / mirror / Atom feed
From: "Andreas K. Huettel" <dilfridge@gentoo.org>
To: gentoo development <gentoo-dev@lists.gentoo.org>
Cc: Jaco Kroon <jaco@uls.co.za>
Subject: Re: [gentoo-dev] mirror storage growth rate
Date: Fri, 15 Mar 2024 19:21:37 +0100	[thread overview]
Message-ID: <3820004.MHq7AAxBmi@noumea> (raw)
In-Reply-To: <57119c8c-24bd-49b0-b3a1-1ff31113e7f8@uls.co.za>

[-- Attachment #1: Type: text/plain, Size: 1513 bytes --]

Hi Jaco, 

* we have more stages
* the binary packages have to go somewhere
* and, temporarily, things are duplicated due to the 17.x / 23.0 profile transition

The third point will eventually go away. However, I'm not sure how much it actually
contributes.

https://www.akhuettel.de/~huettel/plots/mirrors.php

If you look at the plots, the distfiles part is surprisingly large.
Binary packages (17.x and 23.0) and 17.x stages are under "releases".
The 23.0 stages for testing are under "experimental".

Lastly, I'm still working on an automated cleanup for outdated "small arches" binary
packages (i.e. not arm64 and amd64, these are cleaned automatically already).
This just wasn't a priority so far.

Hope this helps.
-a

Am Freitag, 15. März 2024, 09:06:36 CET schrieb Jaco Kroon:
> Hi All,
> 
> I was messing with some storage related caching on some of our hosts 
> this morning when I wondered about how much storage the gentoo mirrors 
> were consuming.  I'm not too worried about the current storage, but I am 
> noticing that the storage requirements are creeping quite a bit (as per 
> attached), and if that growth rate continues it may become a problem 
> *eventually*.
> 
> Can this growth be explained?
> 
> Is it expected to continue at this rate?
> 
> Kind regards,
> Jaco
> 


-- 
Andreas K. Hüttel
dilfridge@gentoo.org
Gentoo Linux developer 
(council, comrel, toolchain, base-system, perl, libreoffice)
https://wiki.gentoo.org/wiki/User:Dilfridge

[-- Attachment #2: This is a digitally signed message part. --]
[-- Type: application/pgp-signature, Size: 833 bytes --]

      parent reply	other threads:[~2024-03-15 18:21 UTC|newest]

Thread overview: 5+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2024-03-15  8:06 [gentoo-dev] mirror storage growth rate Jaco Kroon
2024-03-15 12:05 ` Michał Górny
2024-03-15 15:40   ` Hoël Bézier
2024-03-15 16:15     ` Maciej Barć
2024-03-15 18:21 ` Andreas K. Huettel [this message]

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=3820004.MHq7AAxBmi@noumea \
    --to=dilfridge@gentoo.org \
    --cc=gentoo-dev@lists.gentoo.org \
    --cc=jaco@uls.co.za \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox