[gentoo-dev] Re: A better FTP client with Gentoo enhancements

[gentoo-dev] Re: A better FTP client with Gentoo enhancements

[Bryce Porter]

Ouch... Wget is very lightweight and does an excellent job of what it is
used for. It is small and simple, and easy to understand. Why fix what
isn't broken, anyway?

Re: [gentoo-dev] Re: A better FTP client with Gentoo enhancements

[drobbins]

On Thu, Mar 22, 2001 at 09:23:14AM -0600, Bryce Porter wrote:
> Ouch... Wget is very lightweight and does an excellent job of what it is
> used for. It is small and simple, and easy to understand. Why fix what
> isn't broken, anyway?

I think it would be a good idea to use the same ftp program as FreeBSD,
because their ftp program is great, and it will be another nice thing for
FreeBSD users who need to use Linux.  It'll make them feel at home.  Also,
the wget output *is* quite ugly.

If the new ftp program works well (haven't tested it yet), I'm willing to
make it the default download app for the above-stated reasons.

Best Regards,

-- 
Daniel Robbins					<drobbins@gentoo.org>
President/CEO					http://www.gentoo.org 
Gentoo Technologies, Inc.			

Re: [gentoo-dev] Re: A better FTP client with Gentoo enhancements

[Achim Gottinger]

Bryce Porter wrote:
> 
> Ouch... Wget is very lightweight and does an excellent job of what it is
> used for. It is small and simple, and easy to understand. Why fix what
> isn't broken, anyway?

I personaly use prozilla for fetching. This tool can find mirrors for a
source and downloads
from the fastes one. Additionaly it downloads the package parallel in
portions. I get the maximum
download speed most times. But it has a ugly ncurses based interface.
I think Philipe is enhancing our fetch function at the moment. And we
decided to use prozilla for default.
wget does a good job in most cases, but here it sometimes hangs after
downloading a big source and I must CTRL-C it. 

achim~

> 
> _______________________________________________
> gentoo-dev mailing list
> gentoo-dev@gentoo.org
> http://www.gentoo.org/mailman/listinfo/gentoo-dev

Re: [gentoo-dev] Re: A better FTP client with Gentoo enhancements

[drobbins]

On Thu, Mar 22, 2001 at 04:28:29PM +0100, Achim Gottinger wrote:
> Bryce Porter wrote:
> > 
> > Ouch... Wget is very lightweight and does an excellent job of what it is
> > used for. It is small and simple, and easy to understand. Why fix what
> > isn't broken, anyway?

> I personaly use prozilla for fetching. This tool can find mirrors for a
> source and downloads from the fastes one. Additionaly it downloads the
> package parallel in portions. I get the maximum download speed most times.
> But it has a ugly ncurses based interface.  I think Philipe is enhancing our
> fetch function at the moment. And we decided to use prozilla for default.
> wget does a good job in most cases, but here it sometimes hangs after
> downloading a big source and I must CTRL-C it. 

It looks like we need a virtual/download category... :) ...remember everyone,
it is *very* easy to select a different download app for Portage.

-- 
Daniel Robbins					<drobbins@gentoo.org>
President/CEO					http://www.gentoo.org 
Gentoo Technologies, Inc.			

Re: [gentoo-dev] Re: A better FTP client with Gentoo enhancements

[Philippe Namias]

On Thursday 22 March 2001 16:44, you wrote:
> On Thu, Mar 22, 2001 at 09:23:14AM -0600, Bryce Porter wrote:
> > Ouch... Wget is very lightweight and does an excellent job of what it is
> > used for. It is small and simple, and easy to understand. Why fix what
> > isn't broken, anyway?
>
> I think it would be a good idea to use the same ftp program as FreeBSD,
> because their ftp program is great, and it will be another nice thing for
> FreeBSD users who need to use Linux.  It'll make them feel at home.  Also,
> the wget output *is* quite ugly.

The ftp program considering the fecth function as been quite a discussion for 
a long time along FreeBSD developper and i think they still want to change it 
as there are some bug in it  (i will try to find out more on mailing list).
OpenBSD used a different way so... 
Why i disklike using this ftp or wget is the totally absence of 
"intellingence of them". I remember spendig more time downloading stuff under 
FreeBSD than compiling (when leaving fetch do stuff alone). 
That why for my part i recommend Prozilla (Achim wrote an e-mail about this 
one). 
This one is really forward (multiple donwload at the same time, searching the 
fastest mirror near you, resume...)

Go to 
http://www.lintux.cx/~kalum/prozilla.html for more details

I made a change in the make.default where i include a line for prozilla so 
just uncomment it and comment the wget line. And try it.

And concerning the ouput, i think each person have an esthetic point of view 
on this.
So i you don't like, just add some command line argument to change it or hack 
it (this kind of stuff are generally quiet easy to hack so you can ge wget 
look like ftp from FreeBSD/NetBSD).

>
> If the new ftp program works well (haven't tested it yet), I'm willing to
> make it the default download app for the above-stated reasons
>
> Best Regards,

Re: [gentoo-dev] Re: A better FTP client with Gentoo enhancements

[Achim Gottinger]

Philippe Namias wrote:
> 
> On Thursday 22 March 2001 16:44, you wrote:
> > On Thu, Mar 22, 2001 at 09:23:14AM -0600, Bryce Porter wrote:
> > > Ouch... Wget is very lightweight and does an excellent job of what it is
> > > used for. It is small and simple, and easy to understand. Why fix what
> > > isn't broken, anyway?
> >
> > I think it would be a good idea to use the same ftp program as FreeBSD,
> > because their ftp program is great, and it will be another nice thing for
> > FreeBSD users who need to use Linux.  It'll make them feel at home.  Also,
> > the wget output *is* quite ugly.
> 
> The ftp program considering the fecth function as been quite a discussion for
> a long time along FreeBSD developper and i think they still want to change it
> as there are some bug in it  (i will try to find out more on mailing list).
> OpenBSD used a different way so...
> Why i disklike using this ftp or wget is the totally absence of
> "intellingence of them". I remember spendig more time downloading stuff under
> FreeBSD than compiling (when leaving fetch do stuff alone).
> That why for my part i recommend Prozilla (Achim wrote an e-mail about this
> one).
> This one is really forward (multiple donwload at the same time, searching the
> fastest mirror near you, resume...)
> 
> Go to
> http://www.lintux.cx/~kalum/prozilla.html for more details
> 
> I made a change in the make.default where i include a line for prozilla so
> just uncomment it and comment the wget line. And try it.
> 
> And concerning the ouput, i think each person have an esthetic point of view
> on this.
> So i you don't like, just add some command line argument to change it or hack
> it (this kind of stuff are generally quiet easy to hack so you can ge wget
> look like ftp from FreeBSD/NetBSD).
> 

Philipe, did you fix the fetch function already?

I have an idea how we can make it more flexible for different download
apps.

We can add a script to each download app (example:
/usr/lib/portage/fetch/wget.fetch ). This script holds a wrapper
function for the fetch programm ,
a function to detect if we have already partial downloaded and a
function to remove partial downloaded files.

Then we can replace the FETCHCOMMAND variable with a var called FETCH.
If you set this for example to "wget",
ebuild sources /usr/lib/portage/fetch/wget.fetch and we can use the
functions in ebuild fetch function.

achim~ 


> >
> > If the new ftp program works well (haven't tested it yet), I'm willing to
> > make it the default download app for the above-stated reasons
> >
> > Best Regards,
> 
> _______________________________________________
> gentoo-dev mailing list
> gentoo-dev@gentoo.org
> http://www.gentoo.org/mailman/listinfo/gentoo-dev

Re: [gentoo-dev] Re: A better FTP client with Gentoo enhancements

[Philippe Namias]

On Thursday 22 March 2001 17:18, you wrote:
> Philippe Namias wrote:
> > On Thursday 22 March 2001 16:44, you wrote:
> > > On Thu, Mar 22, 2001 at 09:23:14AM -0600, Bryce Porter wrote:
> > > > Ouch... Wget is very lightweight and does an excellent job of what it
> > > > is used for. It is small and simple, and easy to understand. Why fix
> > > > what isn't broken, anyway?
> > >
> > > I think it would be a good idea to use the same ftp program as FreeBSD,
> > > because their ftp program is great, and it will be another nice thing
> > > for FreeBSD users who need to use Linux.  It'll make them feel at home.
> > >  Also, the wget output *is* quite ugly.
> >
> > The ftp program considering the fecth function as been quite a discussion
> > for a long time along FreeBSD developper and i think they still want to
> > change it as there are some bug in it  (i will try to find out more on
> > mailing list). OpenBSD used a different way so...
> > Why i disklike using this ftp or wget is the totally absence of
> > "intellingence of them". I remember spendig more time downloading stuff
> > under FreeBSD than compiling (when leaving fetch do stuff alone).
> > That why for my part i recommend Prozilla (Achim wrote an e-mail about
> > this one).
> > This one is really forward (multiple donwload at the same time, searching
> > the fastest mirror near you, resume...)
> >
> > Go to
> > http://www.lintux.cx/~kalum/prozilla.html for more details
> >
> > I made a change in the make.default where i include a line for prozilla
> > so just uncomment it and comment the wget line. And try it.
> >
> > And concerning the ouput, i think each person have an esthetic point of
> > view on this.
> > So i you don't like, just add some command line argument to change it or
> > hack it (this kind of stuff are generally quiet easy to hack so you can
> > ge wget look like ftp from FreeBSD/NetBSD).
>
> Philipe, did you fix the fetch function already?

I have been implementing in bash but now i am reimplementig it in Python (as 
Daniel told that he rewrite ebuild in python ). So give me till the end of 
the week and on monday i send you my work (i am quite new to python so it 
take me time sorry) 

>
> I have an idea how we can make it more flexible for different download
> apps.
>
> We can add a script to each download app (example:
> /usr/lib/portage/fetch/wget.fetch ). This script holds a wrapper
> function for the fetch programm ,
> a function to detect if we have already partial downloaded and a
> function to remove partial downloaded files.

Good idea. I will go with it. And also i would like to implement a background 
download if there is multiple depend , example :
kdevelop need cvs.
i fetch cvs then doing the  compile/install but as the time i began download 
kdevelop 

What do you think?

>
> Then we can replace the FETCHCOMMAND variable with a var called FETCH.
> If you set this for example to "wget",
> ebuild sources /usr/lib/portage/fetch/wget.fetch and we can use the
> functions in ebuild fetch function.

So we implement a function for each "downloader"?

prozilla.fetch
wget.fetch
bsdftp.fetch

>
> achim~
>
> > > If the new ftp program works well (haven't tested it yet), I'm willing
> > > to make it the default download app for the above-stated reasons
> > >
> > > Best Regards,
> >
> > _______________________________________________
> > gentoo-dev mailing list
> > gentoo-dev@gentoo.org
> > http://www.gentoo.org/mailman/listinfo/gentoo-dev
>
> _______________________________________________
> gentoo-dev mailing list
> gentoo-dev@gentoo.org
> http://www.gentoo.org/mailman/listinfo/gentoo-dev

Re: [gentoo-dev] Re: A better FTP client with Gentoo enhancements

[drobbins]

On Thu, Mar 22, 2001 at 06:15:19PM +0100, Philippe Namias wrote:

> So we implement a function for each "downloader"?
> 
> prozilla.fetch
> wget.fetch
> bsdftp.fetch

I think Achim's suggestion is excellent.  Each downloader (prozilla,
bsdftp,wget) should install a script into /usr/lib/portage/bin called
{app}.fetch.  It can be written in any language (C,python,bash) as
long as it can be called from the command-line.  It should accept one
or more URLs as arguments.  Do we need any command-line options?

Maybe a --passive option to force a passive ftp session?  Right now
there are ftp servers that are passive only, and others that are active
only.  Maybe we need some new URL types: ftpa:// ftpp:// ?

Best Regards,

-- 
Daniel Robbins					<drobbins@gentoo.org>
President/CEO					http://www.gentoo.org 
Gentoo Technologies, Inc.