[gentoo-user] Trying to make portage use "puf" instead of "wget"

[gentoo-user] Trying to make portage use "puf" instead of "wget"

[Ronan Mainbourg]

[-- Attachment #1: Type: text/plain, Size: 551 bytes --]

Because my Internet connection is not very fast, I'd like to make portage
fetch files using net-misc/puf (wich can dl several chunks of a file at the
same time) instead of wget.

I tried to do this setting the parameter FETCHCOMMAND in my make.conf, but
it doesn't work:


FETCHCOMMAND="/usr/bin/puf \${URI} -P \${DISTDIR}/\${FILE}"


... Give me when I try emerging a package (here"media-libs/libdvbpsi" for
instance):

!!! Couldn't download 'libdvbpsi5-0.1.6.tar.bz2'. Aborting.



Any Ideas ?


-- 
Ronan Mainbourg
Sent from Tananarive, Madagascar

[-- Attachment #2: Type: text/html, Size: 812 bytes --]

Re: [gentoo-user] Trying to make portage use "puf" instead of "wget"

[Paul Hartman]

On Fri, Dec 18, 2009 at 9:40 AM, Ronan Mainbourg
<ronan.mainbourg@gmail.com> wrote:
> Because my Internet connection is not very fast, I'd like to make portage
> fetch files using net-misc/puf (wich can dl several chunks of a file at the
> same time) instead of wget.
> I tried to do this setting the parameter FETCHCOMMAND in my make.conf, but
> it doesn't work:

puf crashes every time for me with this, maybe you have the same problem?

*** glibc detected *** puf: double free or corruption (top):
0x000000000169d730 ***
======= Backtrace: =========
/lib/libc.so.6(+0x72406)[0x7f0a980bd406]
/lib/libc.so.6(cfree+0x6c)[0x7f0a980c21ac]
puf[0x40ec8b]
puf[0x40204b]
/lib/libc.so.6(__libc_start_main+0xfd)[0x7f0a98069bbd]
puf[0x401da9]
======= Memory map: ========
00400000-00415000 r-xp 00000000 08:05 5292661
  /usr/bin/puf
00614000-00615000 r--p 00014000 08:05 5292661
  /usr/bin/puf
00615000-00616000 rw-p 00015000 08:05 5292661
  /usr/bin/puf
0169d000-016be000 rw-p 00000000 00:00 0                                  [heap]
7f0a93de9000-7f0a93dff000 r-xp 00000000 08:05 5145230
  /lib64/libgcc_s.so.1
7f0a93dff000-7f0a93ffe000 ---p 00016000 08:05 5145230
  /lib64/libgcc_s.so.1
7f0a93ffe000-7f0a93fff000 r--p 00015000 08:05 5145230
  /lib64/libgcc_s.so.1
7f0a93fff000-7f0a94000000 rw-p 00016000 08:05 5145230
  /lib64/libgcc_s.so.1
7f0a94000000-7f0a94021000 rw-p 00000000 00:00 0
7f0a94021000-7f0a98000000 ---p 00000000 00:00 0
7f0a9804b000-7f0a9819b000 r-xp 00000000 08:05 4260926
  /lib64/libc-2.11.so
7f0a9819b000-7f0a9839a000 ---p 00150000 08:05 4260926
  /lib64/libc-2.11.so
7f0a9839a000-7f0a9839e000 r--p 0014f000 08:05 4260926
  /lib64/libc-2.11.so
7f0a9839e000-7f0a9839f000 rw-p 00153000 08:05 4260926
  /lib64/libc-2.11.so
7f0a9839f000-7f0a983a4000 rw-p 00000000 00:00 0
7f0a983a4000-7f0a983c2000 r-xp 00000000 08:05 4260927
  /lib64/ld-2.11.so
7f0a98585000-7f0a98588000 rw-p 00000000 00:00 0
7f0a985bf000-7f0a985c1000 rw-p 00000000 00:00 0
7f0a985c1000-7f0a985c2000 r--p 0001d000 08:05 4260927
  /lib64/ld-2.11.so
7f0a985c2000-7f0a985c3000 rw-p 0001e000 08:05 4260927
  /lib64/ld-2.11.so
7f0a985c3000-7f0a985c4000 rw-p 00000000 00:00 0
7ffff5929000-7ffff5941000 rw-p 00000000 00:00 0                          [stack]
7ffff59ff000-7ffff5a00000 r-xp 00000000 00:00 0                          [vdso]
ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0
  [vsyscall]

Re: [gentoo-user] Trying to make portage use "puf" instead of "wget"

[Marcus Wanner]

On 12/18/2009 10:40 AM, Ronan Mainbourg wrote:
> Because my Internet connection is not very fast, I'd like to make portage
> fetch files using net-misc/puf (wich can dl several chunks of a file at the
> same time) instead of wget.
>
> I tried to do this setting the parameter FETCHCOMMAND in my make.conf, but
> it doesn't work:
>
> FETCHCOMMAND="/usr/bin/puf \${URI} -P \${DISTDIR}/\${FILE}"
>
> ... Give me when I try emerging a package (here"media-libs/libdvbpsi" for
> instance):
>
> !!! Couldn't download 'libdvbpsi5-0.1.6.tar.bz2'. Aborting.
>
> Any Ideas ?
>    
Does it actually download the file but put it in the wrong place? Can 
you attach a complete log?

Marcus

[gentoo-user] Re: Trying to make portage use "puf" instead of "wget"

[Nikos Chantziaras]

On 12/18/2009 05:40 PM, Ronan Mainbourg wrote:
> Because my Internet connection is not very fast, I'd like to make
> portage fetch files using net-misc/puf (wich can dl several chunks of a
> file at the same time) instead of wget.

You got it backwards.  Downloading more than one chunk at the same time 
is only useful on *fast* connections, not *slow* ones.

Re: [gentoo-user] Re: Trying to make portage use "puf" instead of "wget"

[Marcus Wanner]

On 12/18/2009 1:38 PM, Nikos Chantziaras wrote:
> On 12/18/2009 05:40 PM, Ronan Mainbourg wrote:
>> Because my Internet connection is not very fast, I'd like to make
>> portage fetch files using net-misc/puf (wich can dl several chunks of a
>> file at the same time) instead of wget.
> You got it backwards.  Downloading more than one chunk at the same 
> time is only useful on *fast* connections, not *slow* ones.
I hate to say it but he is correct...puf won't do you any good unless 
the speed at which to file is being downloaded is less than the maximum 
speed for your net connection :(

Marcus

Re: [gentoo-user] Re: Trying to make portage use "puf" instead of "wget"

[Ronan Mainbourg]

[-- Attachment #1: Type: text/plain, Size: 2544 bytes --]

Sorry, I should have given more details on why I am trying to do that:

the Internet connection I use at work is handled by a router which do
automatic load-balancing between two different connections.
So when bandwidth usage of the first connection is saturated, all new
connections are routed to the second one.

Although bandwidth of those two connections (1024kb/s + 512 kb/s) are
limited and shared with other colleagues, in general I see some good dl
speed improvements using tools that can do parallel fetch, that's why I'm
trying to make portage act this way.

Paul:

I tried your modified FETCHCOMMAND, but without success :(

My configuration only allows me to run emerge as root (most of the time I
use sudo).

The only thing I get trying to emerge media-libs/libdvbpsi is this log
(maybe I can activate a more verbose one, but I don't know how?) :


>>> Emerging (1 of 1) media-libs/libdvbpsi-0.1.6
>>> Downloading '
http://mirror.ovh.net/gentoo-distfiles/distfiles/libdvbpsi5-0.1.6.tar.bz2'
>>> Downloading '
http://download.videolan.org/pub/libdvbpsi/0.1.6/libdvbpsi5-0.1.6.tar.bz2'
!!! Couldn't download 'libdvbpsi5-0.1.6.tar.bz2'. Aborting.
* Fetch failed for 'media-libs/libdvbpsi-0.1.6', Log file:
* '/var/tmp/portage/media-libs/libdvbpsi-0.1.6/temp/build.log'

>>> Failed to emerge media-libs/libdvbpsi-0.1.6, Log file:

>>> '/var/tmp/portage/media-libs/libdvbpsi-0.1.6/temp/build.log'


And in the build.log:

>>> Downloading '
http://mirror.ovh.net/gentoo-distfiles/distfiles/libdvbpsi5-0.1.6.tar.bz2'
>>> Downloading '
http://download.videolan.org/pub/libdvbpsi/0.1.6/libdvbpsi5-0.1.6.tar.bz2'
!!! Couldn't download 'libdvbpsi5-0.1.6.tar.bz2'. Aborting.


Download work great when I type directly:

puf
http://download.videolan.org/pub/libdvbpsi/0.1.6/libdvbpsi5-0.1.6.tar.bz2'


Any help please ?

2009/12/19 Marcus Wanner <marcusw@cox.net>

> On 12/18/2009 1:38 PM, Nikos Chantziaras wrote:
>
>> On 12/18/2009 05:40 PM, Ronan Mainbourg wrote:
>>
>>> Because my Internet connection is not very fast, I'd like to make
>>> portage fetch files using net-misc/puf (wich can dl several chunks of a
>>> file at the same time) instead of wget.
>>>
>> You got it backwards.  Downloading more than one chunk at the same time is
>> only useful on *fast* connections, not *slow* ones.
>>
> I hate to say it but he is correct...puf won't do you any good unless the
> speed at which to file is being downloaded is less than the maximum speed
> for your net connection :(
>
> Marcus
>
>


-- 
Ronan Mainbourg
ronan.mainbourg@gmail.com

[-- Attachment #2: Type: text/html, Size: 4233 bytes --]

Re: [gentoo-user] Re: Trying to make portage use "puf" instead of "wget"

[Xi Shen]

according to puf's syntax, you should put the URI at the END of the command.


On Sat, Dec 19, 2009 at 10:08 PM, Ronan Mainbourg
<ronan.mainbourg@gmail.com> wrote:
> Sorry, I should have given more details on why I am trying to do that:
>
> the Internet connection I use at work is handled by a router which do
> automatic load-balancing between two different connections.
> So when bandwidth usage of the first connection is saturated, all new
> connections are routed to the second one.
> Although bandwidth of those two connections (1024kb/s + 512 kb/s) are
> limited and shared with other colleagues, in general I see some good dl
> speed improvements using tools that can do parallel fetch, that's why I'm
> trying to make portage act this way.
> Paul:
> I tried your modified FETCHCOMMAND, but without success :(
> My configuration only allows me to run emerge as root (most of the time I
> use sudo).
> The only thing I get trying to emerge media-libs/libdvbpsi is this log
> (maybe I can activate a more verbose one, but I don't know how?) :
>
>>>> Emerging (1 of 1) media-libs/libdvbpsi-0.1.6
>>>> Downloading
>>>> 'http://mirror.ovh.net/gentoo-distfiles/distfiles/libdvbpsi5-0.1.6.tar.bz2'
>>>> Downloading
>>>> 'http://download.videolan.org/pub/libdvbpsi/0.1.6/libdvbpsi5-0.1.6.tar.bz2'
> !!! Couldn't download 'libdvbpsi5-0.1.6.tar.bz2'. Aborting.
> * Fetch failed for 'media-libs/libdvbpsi-0.1.6', Log file:
> * '/var/tmp/portage/media-libs/libdvbpsi-0.1.6/temp/build.log'
>
>>>> Failed to emerge media-libs/libdvbpsi-0.1.6, Log file:
>
>>>> '/var/tmp/portage/media-libs/libdvbpsi-0.1.6/temp/build.log'
>
>
> And in the build.log:
>>>> Downloading
>>>> 'http://mirror.ovh.net/gentoo-distfiles/distfiles/libdvbpsi5-0.1.6.tar.bz2'
>>>> Downloading
>>>> 'http://download.videolan.org/pub/libdvbpsi/0.1.6/libdvbpsi5-0.1.6.tar.bz2'
> !!! Couldn't download 'libdvbpsi5-0.1.6.tar.bz2'. Aborting.
>
>
> Download work great when I type directly:
>
> puf http://download.videolan.org/pub/libdvbpsi/0.1.6/libdvbpsi5-0.1.6.tar.bz2'
>
> Any help please ?
> 2009/12/19 Marcus Wanner <marcusw@cox.net>
>>
>> On 12/18/2009 1:38 PM, Nikos Chantziaras wrote:
>>>
>>> On 12/18/2009 05:40 PM, Ronan Mainbourg wrote:
>>>>
>>>> Because my Internet connection is not very fast, I'd like to make
>>>> portage fetch files using net-misc/puf (wich can dl several chunks of a
>>>> file at the same time) instead of wget.
>>>
>>> You got it backwards.  Downloading more than one chunk at the same time
>>> is only useful on *fast* connections, not *slow* ones.
>>
>> I hate to say it but he is correct...puf won't do you any good unless the
>> speed at which to file is being downloaded is less than the maximum speed
>> for your net connection :(
>>
>> Marcus
>>
>
>
>
> --
> Ronan Mainbourg
> ronan.mainbourg@gmail.com
>
>



-- 
Best Regards,
David Shen

http://twitter.com/davidshen84/
http://meme.yahoo.com/davidshen84/

Re: [gentoo-user] Re: Trying to make portage use "puf" instead of "wget"

[Paul Hartman]

On Sat, Dec 19, 2009 at 8:08 AM, Ronan Mainbourg
<ronan.mainbourg@gmail.com> wrote:
> Download work great when I type directly:
>
> puf http://download.videolan.org/pub/libdvbpsi/0.1.6/libdvbpsi5-0.1.6.tar.bz2'
>
> Any help please ?

Like I said for me it fails when run as root. What happens if you run
it as root/sudo?

Re: [gentoo-user] Re: Trying to make portage use "puf" instead of "wget"

[Xi Shen]

i always run in root when doing emerge. every thing is ok.


On Tue, Dec 22, 2009 at 1:06 AM, Paul Hartman
<paul.hartman+gentoo@gmail.com> wrote:
> On Sat, Dec 19, 2009 at 8:08 AM, Ronan Mainbourg
> <ronan.mainbourg@gmail.com> wrote:
>> Download work great when I type directly:
>>
>> puf http://download.videolan.org/pub/libdvbpsi/0.1.6/libdvbpsi5-0.1.6.tar.bz2'
>>
>> Any help please ?
>
> Like I said for me it fails when run as root. What happens if you run
> it as root/sudo?
>
>



-- 
Best Regards,
David Shen

http://twitter.com/davidshen84/
http://meme.yahoo.com/davidshen84/

Re: [gentoo-user] Trying to make portage use "puf" instead of "wget"

[Paul Hartman]

On Fri, Dec 18, 2009 at 9:40 AM, Ronan Mainbourg
<ronan.mainbourg@gmail.com> wrote:
> Because my Internet connection is not very fast, I'd like to make portage
> fetch files using net-misc/puf (wich can dl several chunks of a file at the
> same time) instead of wget.
> I tried to do this setting the parameter FETCHCOMMAND in my make.conf, but
> it doesn't work:
>
> FETCHCOMMAND="/usr/bin/puf \${URI} -P \${DISTDIR}/\${FILE}"
>
> ... Give me when I try emerging a package (here"media-libs/libdvbpsi" for
> instance):
> !!! Couldn't download 'libdvbpsi5-0.1.6.tar.bz2'. Aborting.
>
>
> Any Ideas ?

I think the syntax should be:

FETCHCOMMAND="/usr/bin/puf \${URI} -P \${DISTDIR} -O \${FILE}"

That works for me if I run emerge as normal user. If I run as root, it
crashes... weird.