public inbox for gentoo-dev@lists.gentoo.org
 help / color / mirror / Atom feed
* [gentoo-dev] Upcoming Infra maintenance/downtimes: anon{cvs,svn,git}, archives, bouncer, overlays
@ 2008-01-17 21:47 Robin H. Johnson
  2008-01-18  8:37 ` Fabian Groffen
                   ` (3 more replies)
  0 siblings, 4 replies; 22+ messages in thread
From: Robin H. Johnson @ 2008-01-17 21:47 UTC (permalink / raw
  To: gentoo-dev, gentoo-dev-announce

[-- Attachment #1: Type: text/plain, Size: 1337 bytes --]

Hi folks,

Infra is working on a bunch of things lately, and there are going to be
changes or brief outages for the following services (this is pretty much
the order they are being worked on).

anonvcs.gentoo.org: anoncvs, anonsvn, anongit
- Moving between machines
- Anonymous SVN is changing from http:// to svn:// [1]

archives.gentoo.org:
- Moving between machines
- Update of some missing mail

bouncer.gentoo.org:
- Moving between machines
- Maybe upgrade at the same time?

overlays.gentoo.org [3]:
- Moving between machines
- Git service is already on the new machine
- Anonymous SVN is changing from http:// to svn://
- Trac being replaced [2]

Footnotes:
1. You do not need to do a new checkout at all, you can use the
following command to update your SVN repos:
svn switch --relocate \
http://anonsvn.gentoo.org/repositories/$REPO \
svn://anonsvn.gentoo.org/$REPO

2. Trac doesn't scale well enough, as users of the existing overlay
machine have noted performance problems before. Being replaced with
ViewVC and as yet undecided which Wiki application.

3. I'll send another notification closer to the overlays
work/switchover.

-- 
Robin Hugh Johnson
Gentoo Linux Developer & Infra Guy
E-Mail     : robbat2@gentoo.org
GnuPG FP   : 11AC BA4F 4778 E3F6 E4ED  F38E B27B 944E 3488 4E85

[-- Attachment #2: Type: application/pgp-signature, Size: 329 bytes --]

^ permalink raw reply	[flat|nested] 22+ messages in thread

* Re: [gentoo-dev] Upcoming Infra maintenance/downtimes: anon{cvs,svn,git}, archives, bouncer, overlays
  2008-01-17 21:47 [gentoo-dev] Upcoming Infra maintenance/downtimes: anon{cvs,svn,git}, archives, bouncer, overlays Robin H. Johnson
@ 2008-01-18  8:37 ` Fabian Groffen
  2008-01-18  9:21   ` Robin H. Johnson
  2008-01-18 11:37 ` Mike Frysinger
                   ` (2 subsequent siblings)
  3 siblings, 1 reply; 22+ messages in thread
From: Fabian Groffen @ 2008-01-18  8:37 UTC (permalink / raw
  To: gentoo-dev

First and foremost: thanks for the work!

On 17-01-2008 13:47:28 -0800, Robin H. Johnson wrote:
> overlays.gentoo.org [3]:
> - Moving between machines
> - Git service is already on the new machine
> - Anonymous SVN is changing from http:// to svn://
> - Trac being replaced [2]
> 
> Footnotes:
> 1. You do not need to do a new checkout at all, you can use the
> following command to update your SVN repos:
> svn switch --relocate \
> http://anonsvn.gentoo.org/repositories/$REPO \
> svn://anonsvn.gentoo.org/$REPO

Would it be possible to have a transition period of 1 or 2 months for
the svn repo move?  The main problem for me is that Prefix users are on
a Portage tree from overlays (in SVN), which means if this switch is
done without transition they cannot update (emerge --sync) any more.
While this will result in some mail/bug activity, it might also leave
other people in the dark, ending up (needlessly) rebootstrapping.

If a transition period would be available, I could make Portage
alarm users to fix the SYNC variable to reflect the new URL.  I also
need to add/fix/change Portage's support for this new URL scheme.


-- 
Fabian Groffen
Gentoo on a different level
-- 
gentoo-dev@lists.gentoo.org mailing list



^ permalink raw reply	[flat|nested] 22+ messages in thread

* Re: [gentoo-dev] Upcoming Infra maintenance/downtimes: anon{cvs,svn,git}, archives, bouncer, overlays
  2008-01-18  8:37 ` Fabian Groffen
@ 2008-01-18  9:21   ` Robin H. Johnson
  2008-01-18  9:46     ` Fabian Groffen
  0 siblings, 1 reply; 22+ messages in thread
From: Robin H. Johnson @ 2008-01-18  9:21 UTC (permalink / raw
  To: gentoo-dev

[-- Attachment #1: Type: text/plain, Size: 2019 bytes --]

On Fri, Jan 18, 2008 at 09:37:35AM +0100, Fabian Groffen wrote:
> First and foremost: thanks for the work!
> 
> On 17-01-2008 13:47:28 -0800, Robin H. Johnson wrote:
> > overlays.gentoo.org [3]:
> > - Moving between machines
> > - Git service is already on the new machine
> > - Anonymous SVN is changing from http:// to svn://
> > - Trac being replaced [2]
> > 
> > Footnotes:
> > 1. You do not need to do a new checkout at all, you can use the
> > following command to update your SVN repos:
> > svn switch --relocate \
> > http://anonsvn.gentoo.org/repositories/$REPO \
> > svn://anonsvn.gentoo.org/$REPO
> Would it be possible to have a transition period of 1 or 2 months for
> the svn repo move?  The main problem for me is that Prefix users are on
> a Portage tree from overlays (in SVN), which means if this switch is
> done without transition they cannot update (emerge --sync) any more.
> While this will result in some mail/bug activity, it might also leave
> other people in the dark, ending up (needlessly) rebootstrapping.
> 
> If a transition period would be available, I could make Portage
> alarm users to fix the SYNC variable to reflect the new URL.  I also
> need to add/fix/change Portage's support for this new URL scheme.
You're syncing directly from overlays SVN-HTTP? I hope not with the sync
frequency of some of the other users out there.

As you support SVN already, you should just need to change the URL
(since you are just handing it to SVN), and run svn switch. But ok, I'll
give you 30 days for /repositories/alt/ once the new overlays box has
SVN. (Combined with a suitably large warning in the SVN browse view).

As a migration help, I have enabled the svn:// protocol on the old
overlays box, so you can make a start on getting your users converted.
svn://overlays.gentoo.org/proj/alt/

-- 
Robin Hugh Johnson
Gentoo Linux Developer & Infra Guy
E-Mail     : robbat2@gentoo.org
GnuPG FP   : 11AC BA4F 4778 E3F6 E4ED  F38E B27B 944E 3488 4E85

[-- Attachment #2: Type: application/pgp-signature, Size: 329 bytes --]

^ permalink raw reply	[flat|nested] 22+ messages in thread

* Re: [gentoo-dev] Upcoming Infra maintenance/downtimes: anon{cvs,svn,git}, archives, bouncer, overlays
  2008-01-18  9:21   ` Robin H. Johnson
@ 2008-01-18  9:46     ` Fabian Groffen
  2008-01-18 11:32       ` Robin H. Johnson
  0 siblings, 1 reply; 22+ messages in thread
From: Fabian Groffen @ 2008-01-18  9:46 UTC (permalink / raw
  To: gentoo-dev

On 18-01-2008 01:21:21 -0800, Robin H. Johnson wrote:
> > If a transition period would be available, I could make Portage
> > alarm users to fix the SYNC variable to reflect the new URL.  I also
> > need to add/fix/change Portage's support for this new URL scheme.
> You're syncing directly from overlays SVN-HTTP? I hope not with the sync
> frequency of some of the other users out there.

I have no other option, do I?  I requested rsync in some bug a while ago
with one of the reasons to reduce overlays' load.

> As you support SVN already, you should just need to change the URL
> (since you are just handing it to SVN), and run svn switch. But ok, I'll
> give you 30 days for /repositories/alt/ once the new overlays box has
> SVN. (Combined with a suitably large warning in the SVN browse view).

The problem is that emerge --sync obfuscates that SVN is being used
underneath.  Some (most?) users will not have a clue they are using SVN.

> As a migration help, I have enabled the svn:// protocol on the old
> overlays box, so you can make a start on getting your users converted.
> svn://overlays.gentoo.org/proj/alt/

Thanks, I'll priorise on that to get it rolling.  Thanks a lot!


-- 
Fabian Groffen
Gentoo on a different level
-- 
gentoo-dev@lists.gentoo.org mailing list



^ permalink raw reply	[flat|nested] 22+ messages in thread

* Re: [gentoo-dev] Upcoming Infra maintenance/downtimes: anon{cvs,svn,git}, archives, bouncer, overlays
  2008-01-18  9:46     ` Fabian Groffen
@ 2008-01-18 11:32       ` Robin H. Johnson
  2008-01-18 11:39         ` Fabian Groffen
  0 siblings, 1 reply; 22+ messages in thread
From: Robin H. Johnson @ 2008-01-18 11:32 UTC (permalink / raw
  To: gentoo-dev

[-- Attachment #1: Type: text/plain, Size: 1407 bytes --]

On Fri, Jan 18, 2008 at 10:46:28AM +0100, Fabian Groffen wrote:
> On 18-01-2008 01:21:21 -0800, Robin H. Johnson wrote:
> > > If a transition period would be available, I could make Portage
> > > alarm users to fix the SYNC variable to reflect the new URL.  I also
> > > need to add/fix/change Portage's support for this new URL scheme.
> > You're syncing directly from overlays SVN-HTTP? I hope not with the sync
> > frequency of some of the other users out there.
> I have no other option, do I?  I requested rsync in some bug a while ago
> with one of the reasons to reduce overlays' load.
Not really doable at the moment (but after some of the other pending
infra stuff, it is up for handling).

> > As you support SVN already, you should just need to change the URL
> > (since you are just handing it to SVN), and run svn switch. But ok, I'll
> > give you 30 days for /repositories/alt/ once the new overlays box has
> > SVN. (Combined with a suitably large warning in the SVN browse view).
> The problem is that emerge --sync obfuscates that SVN is being used
> underneath.  Some (most?) users will not have a clue they are using SVN.
How about rolling out a prefix-portage update that just kicks them into
updating it?

-- 
Robin Hugh Johnson
Gentoo Linux Developer & Infra Guy
E-Mail     : robbat2@gentoo.org
GnuPG FP   : 11AC BA4F 4778 E3F6 E4ED  F38E B27B 944E 3488 4E85

[-- Attachment #2: Type: application/pgp-signature, Size: 329 bytes --]

^ permalink raw reply	[flat|nested] 22+ messages in thread

* Re: [gentoo-dev] Upcoming Infra maintenance/downtimes: anon{cvs,svn,git}, archives, bouncer, overlays
  2008-01-17 21:47 [gentoo-dev] Upcoming Infra maintenance/downtimes: anon{cvs,svn,git}, archives, bouncer, overlays Robin H. Johnson
  2008-01-18  8:37 ` Fabian Groffen
@ 2008-01-18 11:37 ` Mike Frysinger
  2008-01-18 22:26   ` Alon Bar-Lev
  2008-01-18 17:41 ` [gentoo-dev] " Christian Faulhammer
  2008-01-20 12:56 ` [gentoo-dev] " Thomas Anderson
  3 siblings, 1 reply; 22+ messages in thread
From: Mike Frysinger @ 2008-01-18 11:37 UTC (permalink / raw
  To: gentoo-dev

[-- Attachment #1: Type: text/plain, Size: 422 bytes --]

On Thursday 17 January 2008, Robin H. Johnson wrote:
> anonvcs.gentoo.org: anoncvs, anonsvn, anongit
> - Anonymous SVN is changing from http:// to svn:// [1]
> overlays.gentoo.org [3]:
> - Anonymous SVN is changing from http:// to svn://

i'd point out that http:// syncing is usable from behind firewalls while 
svn:// is not ... while this does not affect me personally, it's something to 
keep in mind.
-mike

[-- Attachment #2: This is a digitally signed message part. --]
[-- Type: application/pgp-signature, Size: 827 bytes --]

^ permalink raw reply	[flat|nested] 22+ messages in thread

* Re: [gentoo-dev] Upcoming Infra maintenance/downtimes: anon{cvs,svn,git}, archives, bouncer, overlays
  2008-01-18 11:32       ` Robin H. Johnson
@ 2008-01-18 11:39         ` Fabian Groffen
  0 siblings, 0 replies; 22+ messages in thread
From: Fabian Groffen @ 2008-01-18 11:39 UTC (permalink / raw
  To: gentoo-dev

On 18-01-2008 03:32:36 -0800, Robin H. Johnson wrote:
> > The problem is that emerge --sync obfuscates that SVN is being used
> > underneath.  Some (most?) users will not have a clue they are using SVN.
> How about rolling out a prefix-portage update that just kicks them into
> updating it?

That's exactly what I asked the transition period for.  I'll do this
asap.  I only need the little period for people to catch up and do it.
As long as the majority switches, it's all fine.

Since you enabled svn:// on the old box, I can already roll a version
out this weekend, so people are told to switch.  At the same time I can
update the bootstrap images/snapshot and scripts to use the new scheme,
and install a prefix-portage that uses/supports the new scheme.

Thanks.


-- 
Fabian Groffen
Gentoo on a different level
-- 
gentoo-dev@lists.gentoo.org mailing list



^ permalink raw reply	[flat|nested] 22+ messages in thread

* [gentoo-dev] Re: Upcoming Infra maintenance/downtimes: anon{cvs,svn,git}, archives, bouncer, overlays
  2008-01-17 21:47 [gentoo-dev] Upcoming Infra maintenance/downtimes: anon{cvs,svn,git}, archives, bouncer, overlays Robin H. Johnson
  2008-01-18  8:37 ` Fabian Groffen
  2008-01-18 11:37 ` Mike Frysinger
@ 2008-01-18 17:41 ` Christian Faulhammer
  2008-01-18 22:13   ` Robin H. Johnson
  2008-01-20 12:56 ` [gentoo-dev] " Thomas Anderson
  3 siblings, 1 reply; 22+ messages in thread
From: Christian Faulhammer @ 2008-01-18 17:41 UTC (permalink / raw
  To: gentoo-dev

[-- Attachment #1: Type: text/plain, Size: 454 bytes --]

"Robin H. Johnson" <robbat2@gentoo.org>:

> 2. Trac doesn't scale well enough, as users of the existing overlay
> machine have noted performance problems before. Being replaced with
> ViewVC and as yet undecided which Wiki application.

 Am I right that Wiki content is not migrated?

V-Li

-- 
Christian Faulhammer, Gentoo Lisp project
<URL:http://www.gentoo.org/proj/en/lisp/>, #gentoo-lisp on FreeNode

<URL:http://www.faulhammer.org/>

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 189 bytes --]

^ permalink raw reply	[flat|nested] 22+ messages in thread

* Re: [gentoo-dev] Re: Upcoming Infra maintenance/downtimes: anon{cvs,svn,git}, archives, bouncer, overlays
  2008-01-18 17:41 ` [gentoo-dev] " Christian Faulhammer
@ 2008-01-18 22:13   ` Robin H. Johnson
  2008-01-19 16:36     ` Petteri Räty
  0 siblings, 1 reply; 22+ messages in thread
From: Robin H. Johnson @ 2008-01-18 22:13 UTC (permalink / raw
  To: gentoo-dev

[-- Attachment #1: Type: text/plain, Size: 868 bytes --]

On Fri, Jan 18, 2008 at 06:41:44PM +0100, Christian Faulhammer wrote:
> > 2. Trac doesn't scale well enough, as users of the existing overlay
> > machine have noted performance problems before. Being replaced with
> > ViewVC and as yet undecided which Wiki application.
>  Am I right that Wiki content is not migrated?
We do want to migrate the content, either by just putting up static
snapshots, or actively moving it.
dokuwiki is a contender at the moment, because the Java guys already use
it, and I have a personal interest in MediaWiki (as I've hacked on that
codebase before) - but either way, this is quite a way further down my
list of things to do, at least 2 weeks away at this point.

-- 
Robin Hugh Johnson
Gentoo Linux Developer & Infra Guy
E-Mail     : robbat2@gentoo.org
GnuPG FP   : 11AC BA4F 4778 E3F6 E4ED  F38E B27B 944E 3488 4E85

[-- Attachment #2: Type: application/pgp-signature, Size: 329 bytes --]

^ permalink raw reply	[flat|nested] 22+ messages in thread

* Re: [gentoo-dev] Upcoming Infra maintenance/downtimes: anon{cvs,svn,git}, archives, bouncer, overlays
  2008-01-18 11:37 ` Mike Frysinger
@ 2008-01-18 22:26   ` Alon Bar-Lev
  2008-01-18 22:49     ` Robin H. Johnson
  2008-01-21 18:34     ` Michael Haubenwallner
  0 siblings, 2 replies; 22+ messages in thread
From: Alon Bar-Lev @ 2008-01-18 22:26 UTC (permalink / raw
  To: gentoo-dev

On 1/18/08, Mike Frysinger <vapier@gentoo.org> wrote:
> On Thursday 17 January 2008, Robin H. Johnson wrote:
> > anonvcs.gentoo.org: anoncvs, anonsvn, anongit
> > - Anonymous SVN is changing from http:// to svn:// [1]
> > overlays.gentoo.org [3]:
> > - Anonymous SVN is changing from http:// to svn://
>
> i'd point out that http:// syncing is usable from behind firewalls while
> svn:// is not ... while this does not affect me personally, it's something to
> keep in mind.
> -mike
>
>

Just wanted to note this too... I am one of the affected ones...
I think that it is very important to have http, and even https for
formal resources.
git://, svn://, rsync:// or ssh+X:// are inaccessible for a large
group of users.

Also using none secured protocols, exposes users to man-in-the-middle attacks.

Best Regards,
Alon Bar-Lev.
-- 
gentoo-dev@lists.gentoo.org mailing list



^ permalink raw reply	[flat|nested] 22+ messages in thread

* Re: [gentoo-dev] Upcoming Infra maintenance/downtimes: anon{cvs,svn,git}, archives, bouncer, overlays
  2008-01-18 22:26   ` Alon Bar-Lev
@ 2008-01-18 22:49     ` Robin H. Johnson
  2008-01-18 23:01       ` Alon Bar-Lev
  2008-01-19 20:50       ` Mike Frysinger
  2008-01-21 18:34     ` Michael Haubenwallner
  1 sibling, 2 replies; 22+ messages in thread
From: Robin H. Johnson @ 2008-01-18 22:49 UTC (permalink / raw
  To: gentoo-dev

[-- Attachment #1: Type: text/plain, Size: 1688 bytes --]

On Sat, Jan 19, 2008 at 12:26:44AM +0200, Alon Bar-Lev wrote:
> On 1/18/08, Mike Frysinger <vapier@gentoo.org> wrote:
> > On Thursday 17 January 2008, Robin H. Johnson wrote:
> > > anonvcs.gentoo.org: anoncvs, anonsvn, anongit
> > > - Anonymous SVN is changing from http:// to svn:// [1]
> > > overlays.gentoo.org [3]:
> > > - Anonymous SVN is changing from http:// to svn://
> > i'd point out that http:// syncing is usable from behind firewalls while
> > svn:// is not ... while this does not affect me personally, it's something to
> > keep in mind.
> > -mike
> Just wanted to note this too... I am one of the affected ones...
> I think that it is very important to have http, and even https for
> formal resources.
> git://, svn://, rsync:// or ssh+X:// are inaccessible for a large
> group of users.
My core concern with the SVN http://, was the crappy performance it
provided compared to svn://. The main rsync tree has never been
available for iterative syncing via http://, just had tarball snapshots
and deltas instead.

> Also using none secured protocols, exposes users to man-in-the-middle attacks.
The existing http:// had this problem already, it's not a new one.
git:// and svn:// do both have patches around adding support for adding
TLS. This however just adds overhead, I really need to finish the
tree-signing work I was doing, as that protects the content better (MITM
is still possible on SSL without it, just a lot harder as an attacker
has to deal with the SSL stream first).

-- 
Robin Hugh Johnson
Gentoo Linux Developer & Infra Guy
E-Mail     : robbat2@gentoo.org
GnuPG FP   : 11AC BA4F 4778 E3F6 E4ED  F38E B27B 944E 3488 4E85

[-- Attachment #2: Type: application/pgp-signature, Size: 329 bytes --]

^ permalink raw reply	[flat|nested] 22+ messages in thread

* Re: [gentoo-dev] Upcoming Infra maintenance/downtimes: anon{cvs,svn,git}, archives, bouncer, overlays
  2008-01-18 22:49     ` Robin H. Johnson
@ 2008-01-18 23:01       ` Alon Bar-Lev
  2008-01-18 23:06         ` Arfrever Frehtes Taifersar Arahesis
  2008-01-19  2:36         ` Robin H. Johnson
  2008-01-19 20:50       ` Mike Frysinger
  1 sibling, 2 replies; 22+ messages in thread
From: Alon Bar-Lev @ 2008-01-18 23:01 UTC (permalink / raw
  To: gentoo-dev

On 1/19/08, Robin H. Johnson <robbat2@gentoo.org> wrote:
> My core concern with the SVN http://, was the crappy performance it
> provided compared to svn://. The main rsync tree has never been
> available for iterative syncing via http://, just had tarball snapshots
> and deltas instead.

If I understand correctly, the performance of svn under apache is
better than the svnserver, the same for git... Well... This is only
for my experience.
In git case, apache is used to transfer files, and it is much better
in this than the most available alternatives.
In svn case, apache provides the concurrency missing from svnserve.

> > Also using none secured protocols, exposes users to man-in-the-middle attacks.
> The existing http:// had this problem already, it's not a new one.
> git:// and svn:// do both have patches around adding support for adding
> TLS. This however just adds overhead, I really need to finish the
> tree-signing work I was doing, as that protects the content better (MITM
> is still possible on SSL without it, just a lot harder as an attacker
> has to deal with the SSL stream first).

Even if tree signing will be available, the developers should work in
secured channel... ssh or https... The users will benefit from the
signing and not require secured channel.

Until signing will be available, I think it is very important for us
to provide reliable source.

Regards,
Alon Bar-Lev.
-- 
gentoo-dev@lists.gentoo.org mailing list



^ permalink raw reply	[flat|nested] 22+ messages in thread

* Re: [gentoo-dev] Upcoming Infra maintenance/downtimes: anon{cvs,svn,git}, archives, bouncer, overlays
  2008-01-18 23:01       ` Alon Bar-Lev
@ 2008-01-18 23:06         ` Arfrever Frehtes Taifersar Arahesis
  2008-01-18 23:28           ` Alon Bar-Lev
  2008-01-19  2:36         ` Robin H. Johnson
  1 sibling, 1 reply; 22+ messages in thread
From: Arfrever Frehtes Taifersar Arahesis @ 2008-01-18 23:06 UTC (permalink / raw
  To: Gentoo Development

[-- Attachment #1: Type: text/plain, Size: 521 bytes --]

2008-01-19 00:00:41 Alon Bar-Lev napisał(a):
> On 1/19/08, Robin H. Johnson <robbat2@gentoo.org> wrote:
> > My core concern with the SVN http://, was the crappy performance it
> > provided compared to svn://. The main rsync tree has never been
> > available for iterative syncing via http://, just had tarball snapshots
> > and deltas instead.
> 
> If I understand correctly, the performance of svn under apache is
> better than the svnserver

The other way round.

-- 
Arfrever Frehtes Taifersar Arahesis

[-- Attachment #2: This is a digitally signed message part. --]
[-- Type: application/pgp-signature, Size: 197 bytes --]

^ permalink raw reply	[flat|nested] 22+ messages in thread

* Re: [gentoo-dev] Upcoming Infra maintenance/downtimes: anon{cvs,svn,git}, archives, bouncer, overlays
  2008-01-18 23:06         ` Arfrever Frehtes Taifersar Arahesis
@ 2008-01-18 23:28           ` Alon Bar-Lev
  0 siblings, 0 replies; 22+ messages in thread
From: Alon Bar-Lev @ 2008-01-18 23:28 UTC (permalink / raw
  To: gentoo-dev

On 1/19/08, Arfrever Frehtes Taifersar Arahesis <arfrever.fta@gmail.com> wrote:
> > If I understand correctly, the performance of svn under apache is
> > better than the svnserver
>
> The other way round.

We are talking about read-only anonymous repository, right?
But I will take your word for it :)

Thanks!
Alon.
-- 
gentoo-dev@lists.gentoo.org mailing list



^ permalink raw reply	[flat|nested] 22+ messages in thread

* Re: [gentoo-dev] Upcoming Infra maintenance/downtimes: anon{cvs,svn,git}, archives, bouncer, overlays
  2008-01-18 23:01       ` Alon Bar-Lev
  2008-01-18 23:06         ` Arfrever Frehtes Taifersar Arahesis
@ 2008-01-19  2:36         ` Robin H. Johnson
  1 sibling, 0 replies; 22+ messages in thread
From: Robin H. Johnson @ 2008-01-19  2:36 UTC (permalink / raw
  To: gentoo-dev

[-- Attachment #1: Type: text/plain, Size: 2067 bytes --]

On Sat, Jan 19, 2008 at 01:01:04AM +0200, Alon Bar-Lev wrote:
> On 1/19/08, Robin H. Johnson <robbat2@gentoo.org> wrote:
> > My core concern with the SVN http://, was the crappy performance it
> > provided compared to svn://. The main rsync tree has never been
> > available for iterative syncing via http://, just had tarball snapshots
> > and deltas instead.
> If I understand correctly, the performance of svn under apache is
> better than the svnserver, the same for git... Well... This is only
> for my experience.
> In git case, apache is used to transfer files, and it is much better
> in this than the most available alternatives.
Umm, I think you've got things a bit reversed here.
The core problem with using both SVN and Git over HTTP, is the number of
round trips required. Git provides the best example, if the server side
isn't already packed, each object needs to get fetched individually.
Whereas the git:// protocol effectively sends 'I have rev XYZ, give me
everything up to HEAD.' One message in each direction, with a slight
wait in the middle while the server prepares the response.

> In svn case, apache provides the concurrency missing from svnserve.
svnserve running under xinetd so it's niced and set to a max of 10
concurrent users. I benched it up with 30 concurrent updates myself, but
I want to save room for now.

> Even if tree signing will be available, the developers should work in
> secured channel... ssh or https... The users will benefit from the
> signing and not require secured channel.
> 
> Until signing will be available, I think it is very important for us
> to provide reliable source.
The git:// and svn:// are for the anonymous side - I did state
that clearly in my original post. Git commits are using git+ssh:// (via
gitosis), and while I'd like to do the same for SVN, it will probably
remain SVN-over-https:// for now.

-- 
Robin Hugh Johnson
Gentoo Linux Developer & Infra Guy
E-Mail     : robbat2@gentoo.org
GnuPG FP   : 11AC BA4F 4778 E3F6 E4ED  F38E B27B 944E 3488 4E85

[-- Attachment #2: Type: application/pgp-signature, Size: 329 bytes --]

^ permalink raw reply	[flat|nested] 22+ messages in thread

* Re: [gentoo-dev] Re: Upcoming Infra maintenance/downtimes: anon{cvs,svn,git}, archives, bouncer, overlays
  2008-01-18 22:13   ` Robin H. Johnson
@ 2008-01-19 16:36     ` Petteri Räty
  0 siblings, 0 replies; 22+ messages in thread
From: Petteri Räty @ 2008-01-19 16:36 UTC (permalink / raw
  To: gentoo-dev

[-- Attachment #1: Type: text/plain, Size: 818 bytes --]

Robin H. Johnson kirjoitti:
> On Fri, Jan 18, 2008 at 06:41:44PM +0100, Christian Faulhammer wrote:
>>> 2. Trac doesn't scale well enough, as users of the existing overlay
>>> machine have noted performance problems before. Being replaced with
>>> ViewVC and as yet undecided which Wiki application.
>>  Am I right that Wiki content is not migrated?
> We do want to migrate the content, either by just putting up static
> snapshots, or actively moving it.
> dokuwiki is a contender at the moment, because the Java guys already use
> it, and I have a personal interest in MediaWiki (as I've hacked on that
> codebase before) - but either way, this is quite a way further down my
> list of things to do, at least 2 weeks away at this point.
> 

We do?

Regards,
Petteri
--
Gentoo/Java project lead


[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 252 bytes --]

^ permalink raw reply	[flat|nested] 22+ messages in thread

* Re: [gentoo-dev] Upcoming Infra maintenance/downtimes: anon{cvs,svn,git}, archives, bouncer, overlays
  2008-01-18 22:49     ` Robin H. Johnson
  2008-01-18 23:01       ` Alon Bar-Lev
@ 2008-01-19 20:50       ` Mike Frysinger
  2008-01-19 20:56         ` Alon Bar-Lev
  2008-01-19 21:27         ` Fabian Groffen
  1 sibling, 2 replies; 22+ messages in thread
From: Mike Frysinger @ 2008-01-19 20:50 UTC (permalink / raw
  To: gentoo-dev; +Cc: Robin H. Johnson

[-- Attachment #1: Type: text/plain, Size: 2270 bytes --]

On Friday 18 January 2008, Robin H. Johnson wrote:
> On Sat, Jan 19, 2008 at 12:26:44AM +0200, Alon Bar-Lev wrote:
> > On 1/18/08, Mike Frysinger <vapier@gentoo.org> wrote:
> > > On Thursday 17 January 2008, Robin H. Johnson wrote:
> > > > anonvcs.gentoo.org: anoncvs, anonsvn, anongit
> > > > - Anonymous SVN is changing from http:// to svn:// [1]
> > > > overlays.gentoo.org [3]:
> > > > - Anonymous SVN is changing from http:// to svn://
> > >
> > > i'd point out that http:// syncing is usable from behind firewalls
> > > while svn:// is not ... while this does not affect me personally, it's
> > > something to keep in mind.
> > > -mike
> >
> > Just wanted to note this too... I am one of the affected ones...
> > I think that it is very important to have http, and even https for
> > formal resources.
> > git://, svn://, rsync:// or ssh+X:// are inaccessible for a large
> > group of users.
>
> My core concern with the SVN http://, was the crappy performance it
> provided compared to svn://. The main rsync tree has never been
> available for iterative syncing via http://, just had tarball snapshots
> and deltas instead.

i'm not suggesting you *not* provide the proper svn:// and git:// ones.  i'd 
always use those myself when possible (as performance is a ton better as ive 
seen many times).  i'm suggesting we provide both and tell people to use 
svn:// and git://, but if you're behind a stupid firewall, there is also 
http:// available.

> > Also using none secured protocols, exposes users to man-in-the-middle
> > attacks.
>
> The existing http:// had this problem already, it's not a new one.
> git:// and svn:// do both have patches around adding support for adding
> TLS. This however just adds overhead, I really need to finish the
> tree-signing work I was doing, as that protects the content better (MITM
> is still possible on SSL without it, just a lot harder as an attacker
> has to deal with the SSL stream first).

using https:// to secure your data here is the wrong way to go.  if you have a 
man-in-the-middle attacking you, they can do a lot more than inject crap into 
your syncs, some of which you wouldnt even notice.  for the topic at hand, 
this topic does not matter i think.
-mike

[-- Attachment #2: This is a digitally signed message part. --]
[-- Type: application/pgp-signature, Size: 827 bytes --]

^ permalink raw reply	[flat|nested] 22+ messages in thread

* Re: [gentoo-dev] Upcoming Infra maintenance/downtimes: anon{cvs,svn,git}, archives, bouncer, overlays
  2008-01-19 20:50       ` Mike Frysinger
@ 2008-01-19 20:56         ` Alon Bar-Lev
  2008-01-19 21:27         ` Fabian Groffen
  1 sibling, 0 replies; 22+ messages in thread
From: Alon Bar-Lev @ 2008-01-19 20:56 UTC (permalink / raw
  To: gentoo-dev

On 1/19/08, Mike Frysinger <vapier@gentoo.org> wrote:
> using https:// to secure your data here is the wrong way to go.  if you have a
> man-in-the-middle attacking you, they can do a lot more than inject crap into
> your syncs, some of which you wouldnt even notice.  for the topic at hand,
> this topic does not matter i think.

The https solves man-in the middle for svn/git sync.

There is an option for rsync people (not to use it):
http://bugs.gentoo.org/show_bug.cgi?id=130039

Best Regards,
Alon Bar-Lev.
-- 
gentoo-dev@lists.gentoo.org mailing list



^ permalink raw reply	[flat|nested] 22+ messages in thread

* Re: [gentoo-dev] Upcoming Infra maintenance/downtimes: anon{cvs,svn,git}, archives, bouncer, overlays
  2008-01-19 20:50       ` Mike Frysinger
  2008-01-19 20:56         ` Alon Bar-Lev
@ 2008-01-19 21:27         ` Fabian Groffen
  1 sibling, 0 replies; 22+ messages in thread
From: Fabian Groffen @ 2008-01-19 21:27 UTC (permalink / raw
  To: gentoo-dev

On 19-01-2008 15:50:09 -0500, Mike Frysinger wrote:
> i'm not suggesting you *not* provide the proper svn:// and git:// ones.  i'd 
> always use those myself when possible (as performance is a ton better as ive 
> seen many times).  i'm suggesting we provide both and tell people to use 
> svn:// and git://, but if you're behind a stupid firewall, there is also 
> http:// available.

I know of at least two cases where people have to go through a
(corporate) firewall, so I fully second this suggestion.


-- 
Fabian Groffen
Gentoo on a different level
-- 
gentoo-dev@lists.gentoo.org mailing list



^ permalink raw reply	[flat|nested] 22+ messages in thread

* Re: [gentoo-dev] Upcoming Infra maintenance/downtimes: anon{cvs,svn,git}, archives, bouncer, overlays
  2008-01-17 21:47 [gentoo-dev] Upcoming Infra maintenance/downtimes: anon{cvs,svn,git}, archives, bouncer, overlays Robin H. Johnson
                   ` (2 preceding siblings ...)
  2008-01-18 17:41 ` [gentoo-dev] " Christian Faulhammer
@ 2008-01-20 12:56 ` Thomas Anderson
  2008-01-21 13:08   ` Robin H. Johnson
  3 siblings, 1 reply; 22+ messages in thread
From: Thomas Anderson @ 2008-01-20 12:56 UTC (permalink / raw
  To: gentoo-dev

[-- Attachment #1: Type: text/plain, Size: 776 bytes --]

On Thursday 17 January 2008 16:47:28 Robin H. Johnson wrote:
> Hi folks,
>
> Infra is working on a bunch of things lately, and there are going to be
> changes or brief outages for the following services (this is pretty much
> the order they are being worked on).
>
> anonvcs.gentoo.org: anoncvs, anonsvn, anongit
> - Moving between machines
> - Anonymous SVN is changing from http:// to svn:// [1]
 Did this plan include disabling of compression for anoncvs? I noticed my 
compression-enabled cvs up's were spewing out information about 
gzip-file-contents not being supported. This only started happening within 
the past few days, so it probably happened with this switch(assuming the 
switch happened already ;) ).

Regards,
Thomas
-- 
2.6.23-gentoo-r3

[-- Attachment #2: This is a digitally signed message part. --]
[-- Type: application/pgp-signature, Size: 189 bytes --]

^ permalink raw reply	[flat|nested] 22+ messages in thread

* Re: [gentoo-dev] Upcoming Infra maintenance/downtimes: anon{cvs,svn,git}, archives, bouncer, overlays
  2008-01-20 12:56 ` [gentoo-dev] " Thomas Anderson
@ 2008-01-21 13:08   ` Robin H. Johnson
  0 siblings, 0 replies; 22+ messages in thread
From: Robin H. Johnson @ 2008-01-21 13:08 UTC (permalink / raw
  To: gentoo-dev

[-- Attachment #1: Type: text/plain, Size: 1108 bytes --]

On Sun, Jan 20, 2008 at 07:56:12AM -0500, Thomas Anderson wrote:
> On Thursday 17 January 2008 16:47:28 Robin H. Johnson wrote:
> > Hi folks,
> >
> > Infra is working on a bunch of things lately, and there are going to be
> > changes or brief outages for the following services (this is pretty much
> > the order they are being worked on).
> >
> > anonvcs.gentoo.org: anoncvs, anonsvn, anongit
> > - Moving between machines
> > - Anonymous SVN is changing from http:// to svn:// [1]
>  Did this plan include disabling of compression for anoncvs? I noticed my 
> compression-enabled cvs up's were spewing out information about 
> gzip-file-contents not being supported. This only started happening within 
> the past few days, so it probably happened with this switch(assuming the 
> switch happened already ;) ).
Compression was disabled on the old side as well.
Now that we have more CPU however, I may be able to re-enable it.

-- 
Robin Hugh Johnson
Gentoo Linux Developer & Infra Guy
E-Mail     : robbat2@gentoo.org
GnuPG FP   : 11AC BA4F 4778 E3F6 E4ED  F38E B27B 944E 3488 4E85

[-- Attachment #2: Type: application/pgp-signature, Size: 329 bytes --]

^ permalink raw reply	[flat|nested] 22+ messages in thread

* Re: [gentoo-dev] Upcoming Infra maintenance/downtimes: anon{cvs,svn,git}, archives, bouncer, overlays
  2008-01-18 22:26   ` Alon Bar-Lev
  2008-01-18 22:49     ` Robin H. Johnson
@ 2008-01-21 18:34     ` Michael Haubenwallner
  1 sibling, 0 replies; 22+ messages in thread
From: Michael Haubenwallner @ 2008-01-21 18:34 UTC (permalink / raw
  To: gentoo-dev

On Sat, 2008-01-19 at 00:26 +0200, Alon Bar-Lev wrote:
> On 1/18/08, Mike Frysinger <vapier@gentoo.org> wrote:
> > On Thursday 17 January 2008, Robin H. Johnson wrote:
> > > anonvcs.gentoo.org: anoncvs, anonsvn, anongit
> > > - Anonymous SVN is changing from http:// to svn:// [1]
> > > overlays.gentoo.org [3]:
> > > - Anonymous SVN is changing from http:// to svn://
> >
> > i'd point out that http:// syncing is usable from behind firewalls while
> > svn:// is not ... while this does not affect me personally, it's something to
> > keep in mind.
> > -mike
> >
> >
> 
> Just wanted to note this too... I am one of the affected ones...

I'm also behind some firewall: +1 for keeping http.

/haubi/
-- 
Michael Haubenwallner
Gentoo on a different level

-- 
gentoo-dev@lists.gentoo.org mailing list



^ permalink raw reply	[flat|nested] 22+ messages in thread

end of thread, other threads:[~2008-01-21 18:34 UTC | newest]

Thread overview: 22+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2008-01-17 21:47 [gentoo-dev] Upcoming Infra maintenance/downtimes: anon{cvs,svn,git}, archives, bouncer, overlays Robin H. Johnson
2008-01-18  8:37 ` Fabian Groffen
2008-01-18  9:21   ` Robin H. Johnson
2008-01-18  9:46     ` Fabian Groffen
2008-01-18 11:32       ` Robin H. Johnson
2008-01-18 11:39         ` Fabian Groffen
2008-01-18 11:37 ` Mike Frysinger
2008-01-18 22:26   ` Alon Bar-Lev
2008-01-18 22:49     ` Robin H. Johnson
2008-01-18 23:01       ` Alon Bar-Lev
2008-01-18 23:06         ` Arfrever Frehtes Taifersar Arahesis
2008-01-18 23:28           ` Alon Bar-Lev
2008-01-19  2:36         ` Robin H. Johnson
2008-01-19 20:50       ` Mike Frysinger
2008-01-19 20:56         ` Alon Bar-Lev
2008-01-19 21:27         ` Fabian Groffen
2008-01-21 18:34     ` Michael Haubenwallner
2008-01-18 17:41 ` [gentoo-dev] " Christian Faulhammer
2008-01-18 22:13   ` Robin H. Johnson
2008-01-19 16:36     ` Petteri Räty
2008-01-20 12:56 ` [gentoo-dev] " Thomas Anderson
2008-01-21 13:08   ` Robin H. Johnson

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox