[gentoo-releng] Historical release archives

[gentoo-releng] Historical release archives

[Lance Albertson]

[-- Attachment #1: Type: text/plain, Size: 1989 bytes --]

Hey all,

I just got to thinking and realized we need to decide how far back we
want to keep releases on mirrors. Since we're planning on doing 4
releases per year, its going to get big really fast. I did some checking
around, and our current historical directory is 12GB in size... below
shows how big each arch has. This includes 1.4 releases plus some 1.2
releases.

12G     /space/historical

4.5G    ./ppc
6.0G    ./x86
1.4G    ./sparc

Each 2004.x release is going to be rather large too. Below has some
sizes for the archs we have for 2004.{0-1}. 

x86			sparc
5.0G    ./2004.0	1.2G    ./2004.0
4.5G    ./2004.1	2.4G    ./2004.1

ppc			amd64
3.0G    ./2004.0	1.2G    ./2004.0
2.9G    ./2004.1	1.3G    ./2004.1

Of course, we can keep whatever we want on our master server, but what
I'm concerned about is space concerns for our mirror admins. Some have a
huge amount of free space, while others only have limited space.

How far back should we keep archives to the public? I suppose we could
setup a single server or two to keep all the archives for public, but
for the rest of the mirrors, we should only have so many releases on
there. I'm not sure what the magic number should be. I'm not sure what
kind of a demand we have for our historical releases, I would assume
something probably low. If its not bad, our infra might be able to
support older archives in the long run (don't shoot me kurt).

What are your takes on this issue? I think once we decide, zhen should
put this in his releng documentation so we have it on digital paper.

P.S. - Sorry you can't view the historical archives at this moment,
jforman sent an email about an hour ago stating whats up with that.
Blame kurt for it :)

Thanks!

-- 
Lance Albertson <ramereth@gentoo.org>
Gentoo Infrastructure

---
GPG Public Key:  <http://www.ramereth.net/lance.asc>
Key fingerprint: 0423 92F3 544A 1282 5AB1  4D07 416F A15D 27F4 B742

ramereth/irc.freenode.net

[-- Attachment #2: This is a digitally signed message part --]
[-- Type: application/pgp-signature, Size: 189 bytes --]

Re: [gentoo-releng] Historical release archives

[Pieter Van den Abeele]

Hi,

I no longer have all the release I have ever built on cd. I would like 
to get a copy of the historic ppc stuff before it gets thrown away. Is 
that possible?

Pieter

On 28 Apr 2004, at 03:05, Lance Albertson wrote:

> Hey all,
>
> I just got to thinking and realized we need to decide how far back we
> want to keep releases on mirrors. Since we're planning on doing 4
> releases per year, its going to get big really fast. I did some 
> checking
> around, and our current historical directory is 12GB in size... below
> shows how big each arch has. This includes 1.4 releases plus some 1.2
> releases.
>
> 12G     /space/historical
>
> 4.5G    ./ppc
> 6.0G    ./x86
> 1.4G    ./sparc
>
> Each 2004.x release is going to be rather large too. Below has some
> sizes for the archs we have for 2004.{0-1}.
>
> x86			sparc
> 5.0G    ./2004.0	1.2G    ./2004.0
> 4.5G    ./2004.1	2.4G    ./2004.1
>
> ppc			amd64
> 3.0G    ./2004.0	1.2G    ./2004.0
> 2.9G    ./2004.1	1.3G    ./2004.1
>
> Of course, we can keep whatever we want on our master server, but what
> I'm concerned about is space concerns for our mirror admins. Some have 
> a
> huge amount of free space, while others only have limited space.
>
> How far back should we keep archives to the public? I suppose we could
> setup a single server or two to keep all the archives for public, but
> for the rest of the mirrors, we should only have so many releases on
> there. I'm not sure what the magic number should be. I'm not sure what
> kind of a demand we have for our historical releases, I would assume
> something probably low. If its not bad, our infra might be able to
> support older archives in the long run (don't shoot me kurt).
>
> What are your takes on this issue? I think once we decide, zhen should
> put this in his releng documentation so we have it on digital paper.
>
> P.S. - Sorry you can't view the historical archives at this moment,
> jforman sent an email about an hour ago stating whats up with that.
> Blame kurt for it :)
>
> Thanks!
>
> -- 
> Lance Albertson <ramereth@gentoo.org>
> Gentoo Infrastructure
>
> ---
> GPG Public Key:  <http://www.ramereth.net/lance.asc>
> Key fingerprint: 0423 92F3 544A 1282 5AB1  4D07 416F A15D 27F4 B742
>
> ramereth/irc.freenode.net


--
gentoo-releng@gentoo.org mailing list

Re: [gentoo-releng] Historical release archives

[Kurt Lieber]

[-- Attachment #1: Type: text/plain, Size: 883 bytes --]

On Tue, Apr 27, 2004 at 08:05:08PM -0500 or thereabouts, Lance Albertson wrote:
> I just got to thinking and realized we need to decide how far back we
> want to keep releases on mirrors. Since we're planning on doing 4
> releases per year, its going to get big really fast. I did some checking
> around, and our current historical directory is 12GB in size... below
> shows how big each arch has. This includes 1.4 releases plus some 1.2
> releases.

I was planning on keeping the current release + 2 older releases available
online.  The others would be deleted and/or archived somewhere.  (I'll be
deleting them.  If releng wants to take the responsibility of archiving
them, that's fine, too)

We don't have unlimited space on our master mirror, so we do need to be
cognizant of space limitations even there.  That's what caused the
historical/ snafu in the first place.

--kurt

[-- Attachment #2: Type: application/pgp-signature, Size: 189 bytes --]

Re: [gentoo-releng] Historical release archives

[Lance Albertson]

[-- Attachment #1: Type: text/plain, Size: 702 bytes --]

On Tue, 2004-04-27 at 20:14, Pieter Van den Abeele wrote:
> Hi,
> 
> I no longer have all the release I have ever built on cd. I would like 
> to get a copy of the historic ppc stuff before it gets thrown away. Is 
> that possible?
> 
> Pieter

Yeah, sure.. I'm not talking totally deleting this from our master
server. I'm mainly talking about stuff people will see on the public
mirrors. How far back do you want? I can pop the ppc stuff on your home
on emu.

-- 
Lance Albertson <ramereth@gentoo.org>
Gentoo Infrastructure

---
GPG Public Key:  <http://www.ramereth.net/lance.asc>
Key fingerprint: 0423 92F3 544A 1282 5AB1  4D07 416F A15D 27F4 B742

ramereth/irc.freenode.net

[-- Attachment #2: This is a digitally signed message part --]
[-- Type: application/pgp-signature, Size: 189 bytes --]

Re: [gentoo-releng] Historical release archives

[John Davis]

[-- Attachment #1: Type: text/plain, Size: 1389 bytes --]

On Tue, 2004-04-27 at 21:22, Kurt Lieber wrote:
> On Tue, Apr 27, 2004 at 08:05:08PM -0500 or thereabouts, Lance Albertson wrote:
> > I just got to thinking and realized we need to decide how far back we
> > want to keep releases on mirrors. Since we're planning on doing 4
> > releases per year, its going to get big really fast. I did some checking
> > around, and our current historical directory is 12GB in size... below
> > shows how big each arch has. This includes 1.4 releases plus some 1.2
> > releases.
> 
> I was planning on keeping the current release + 2 older releases available
> online.  The others would be deleted and/or archived somewhere.  (I'll be
> deleting them.  If releng wants to take the responsibility of archiving
> them, that's fine, too)
> 
> We don't have unlimited space on our master mirror, so we do need to be
> cognizant of space limitations even there.  That's what caused the
> historical/ snafu in the first place.
> 
> --kurt

Current +2 is just fine, I can archive the rest on media at my house.
Let's go this route, not forgetting to put a README on the mirrors where
all of the old stuff is ;)

Cheers,
//zhen
-- 
John Davis
Gentoo Linux Developer
<http://dev.gentoo.org/~zhen>

----
GnuPG Public Key: <http://dev.gentoo.org/~zhen/zhen_pub.asc>
Fingerprint: 2364 71BD 4BC2 705D F338  FF70 6650 1235 1946 2D47


[-- Attachment #2: This is a digitally signed message part --]
[-- Type: application/pgp-signature, Size: 189 bytes --]

Re: [gentoo-releng] Historical release archives

[Pieter Van den Abeele]

On 28 Apr 2004, at 03:24, Lance Albertson wrote:

> On Tue, 2004-04-27 at 20:14, Pieter Van den Abeele wrote:
>> Hi,
>>
>> I no longer have all the release I have ever built on cd. I would like
>> to get a copy of the historic ppc stuff before it gets thrown away. Is
>> that possible?
>>
>> Pieter
>
> Yeah, sure.. I'm not talking totally deleting this from our master
> server. I'm mainly talking about stuff people will see on the public
> mirrors. How far back do you want? I can pop the ppc stuff on your home
> on emu.

that would be nice.

> -- 
> Lance Albertson <ramereth@gentoo.org>
> Gentoo Infrastructure
>
> ---
> GPG Public Key:  <http://www.ramereth.net/lance.asc>
> Key fingerprint: 0423 92F3 544A 1282 5AB1  4D07 416F A15D 27F4 B742
>
> ramereth/irc.freenode.net


--
gentoo-releng@gentoo.org mailing list

Re: [gentoo-releng] Historical release archives

[Lance Albertson]

[-- Attachment #1: Type: text/plain, Size: 709 bytes --]

On Tue, 2004-04-27 at 20:35, John Davis wrote:
> Current +2 is just fine, I can archive the rest on media at my house.
> Let's go this route, not forgetting to put a README on the mirrors where
> all of the old stuff is ;)
> 
> Cheers,
> //zhen

Ok, so how is the directory structure going to work? Are we going to
move 2004.0 to historical? keep it where its at? If we keep it where its
at, what's the point of keeping a historical directory? etc etc

Just thinking :)
-- 
Lance Albertson <ramereth@gentoo.org>
Gentoo Infrastructure

---
GPG Public Key:  <http://www.ramereth.net/lance.asc>
Key fingerprint: 0423 92F3 544A 1282 5AB1  4D07 416F A15D 27F4 B742

ramereth/irc.freenode.net

[-- Attachment #2: This is a digitally signed message part --]
[-- Type: application/pgp-signature, Size: 189 bytes --]

Re: [gentoo-releng] Historical release archives

[Kurt Lieber]

[-- Attachment #1: Type: text/plain, Size: 147 bytes --]

On Tue, Apr 27, 2004 at 08:40:31PM -0500 or thereabouts, Lance Albertson
wrote:
> Are we going to move 2004.0 to historical? 

yes.

--kurt

[-- Attachment #2: Type: application/pgp-signature, Size: 189 bytes --]