public inbox for gentoo-dev@lists.gentoo.org
 help / color / mirror / Atom feed
Search results ordered by [date|relevance]  view[summary|nested|Atom feed]
thread overview below | download: 
* Re: [gentoo-dev] Re: RFC: Hosting daily gx86 squashfs images and deltas
  @ 2014-01-17 23:36 99%       ` Michał Górny
  0 siblings, 0 replies; 1+ results
From: Michał Górny @ 2014-01-17 23:36 UTC (permalink / raw
  To: gentoo-dev; +Cc: 1i5t5.duncan

[-- Attachment #1: Type: text/plain, Size: 2094 bytes --]

Dnia 2014-01-17, o godz. 23:31:32
Duncan <1i5t5.duncan@cox.net> napisał(a):

> Michał Górny posted on Fri, 17 Jan 2014 20:30:00 +0100 as excerpted:
> 
> > Dnia 2014-01-17, o godz. 19:19:14 Duncan <1i5t5.duncan@cox.net>
> > napisał(a):
> > 
> >> Michał Górny posted on Fri, 17 Jan 2014 17:27:30 +0100 as excerpted:
> >> 
> >> > 96M	portage-20140108.sqfs
> 
> >> > For deltas [...]
> >> > 
> >> > 6,3M portage-20140109.sqfs-portage-20140110.sqfs.vcdiff.djw
> 
> >> > applying it takes ~2.5 second on my 2 GHz Athlon64.
> >> 
> >> diffs are ~1/16 the full squashfs size[.] So people updating once a
> >> week [or] 10 days would see a bandwidth savings, provided the sync
> >> script was intelligent enough to apply updates serially.
> >> 
> >> The breakover point would be roughly an update every two weeks, or
> >> twice a month
> > 
> > However, it may be actually beneficial to provide other durations, like
> > weekly deltas. In my tests, the daily updates for this week summed up to
> > almost 50M while the weekly was barely 20M.
> 
> That's useful additional data.  Thanks.
> 
> And yes, a weekly delta would be quite useful, taking the breakover point 
> out to about a month or so.  Practically speaking, I'd guess most 
> gentooers update once a month or more, so that should cover the vast 
> majority.  Beyond a month, just downloading a new full squashfs makes as 
> much sense anyway, and as the cutover would be automated, users on the 
> borderline wouldn't have to worry about whether they should just do the 
> normal sync or download an entirely new tarball, as they now need to do, 
> if they even bother at all.  For those users, it'd be an even BIGGER win.

Well, I've got even a better idea and I'll try to provide direct deltas
from N days back to the newest snapshot. Since the tree changes a lot,
those deltas will be smaller to download ;).

Now, does anyone have an old portage-XXXXYYZZ.tar.{bz2,xz} snapshot? I
need the official one from our mirrors, preferably 3-4 months old.

-- 
Best regards,
Michał Górny

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 966 bytes --]

^ permalink raw reply	[relevance 99%]

Results 1-1 of 1 | reverse | options above
-- pct% links below jump to the message on this page, permalinks otherwise --
2014-01-17 16:27     [gentoo-dev] RFC: Hosting daily gx86 squashfs images and deltas Michał Górny
2014-01-17 19:19     ` [gentoo-dev] " Duncan
2014-01-17 19:30       ` Michał Górny
2014-01-17 23:31         ` Duncan
2014-01-17 23:36 99%       ` Michał Górny

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox