[gentoo-user] python-3.6.5 rebuild fails on new install

[gentoo-user] python-3.6.5 rebuild fails on new install

[Walter Dnes]

[-- Attachment #1: Type: text/plain, Size: 845 bytes --]

  I'm re-purposing a Lenovo T400 notebook (CORE2 and 3 gigs ram) with a
32-bit Gentoo install.  I try to do "emerge -e @system" early in the
install, when there's under 200 packages.  Anyhow, python 3.6.5 is not
rebuilding. I've put in all the "final" USE flags for the system.  The
buildlog is attached (gzipped).

  And a bit of a rant... WTF is the initial stage 3 built against PAM?
I wasted an hour dicking around, trying to get ssh working, so that I
could finish up the install.  I finally figured out that I had to set
"usePAM no" in /etc/ssh/sshd_config as a temporary hack.  The root
solution to the problem was to emerge openssh with USE="-pam".  I had
that in my flags, but the "emerge -e @system" died before getting to
openssh.

-- 
Walter Dnes <waltdnes@waltdnes.org>
I don't run "desktop environments"; I run useful applications

[-- Attachment #2: fail.txt.gz --]
[-- Type: application/octet-stream, Size: 15093 bytes --]

Re: [gentoo-user] python-3.6.5 rebuild fails on new install

[Mike Gilbert]

On Fri, Aug 17, 2018 at 8:58 PM Walter Dnes <waltdnes@waltdnes.org> wrote:
>
>   I'm re-purposing a Lenovo T400 notebook (CORE2 and 3 gigs ram) with a
> 32-bit Gentoo install.  I try to do "emerge -e @system" early in the
> install, when there's under 200 packages.  Anyhow, python 3.6.5 is not
> rebuilding. I've put in all the "final" USE flags for the system.  The
> buildlog is attached (gzipped).

The compiler was killed with signal SIGSEGV. You probably ran out of
memory or some similar problem. Check dmesg.

>   And a bit of a rant... WTF is the initial stage 3 built against PAM?
> I wasted an hour dicking around, trying to get ssh working, so that I
> could finish up the install.  I finally figured out that I had to set
> "usePAM no" in /etc/ssh/sshd_config as a temporary hack.  The root
> solution to the problem was to emerge openssh with USE="-pam".  I had
> that in my flags, but the "emerge -e @system" died before getting to
> openssh.

Most people want PAM. It's a good thing.

Re: [gentoo-user] python-3.6.5 rebuild fails on new install

[Walter Dnes]

[-- Attachment #1: Type: text/plain, Size: 960 bytes --]

On Sat, Aug 18, 2018 at 03:27:27PM -0400, Mike Gilbert wrote
> On Fri, Aug 17, 2018 at 8:58 PM Walter Dnes <waltdnes@waltdnes.org> wrote:
> >
> >   I'm re-purposing a Lenovo T400 notebook (CORE2 and 3 gigs ram) with a
> > 32-bit Gentoo install.  I try to do "emerge -e @system" early in the
> > install, when there's under 200 packages.  Anyhow, python 3.6.5 is not
> > rebuilding. I've put in all the "final" USE flags for the system.  The
> > buildlog is attached (gzipped).
> 
> The compiler was killed with signal SIGSEGV. You probably ran out of
> memory or some similar problem. Check dmesg.

  That would be worrisome. This is an off-lease Lenovo with 3 gigs of
ram, and 6.8 gigs of swap.  At this point of the install, I haven't even
built X, so there's no GUI running.  dmesg output is attached.  The last
line mentions something about python3.6m.

-- 
Walter Dnes <waltdnes@waltdnes.org>
I don't run "desktop environments"; I run useful applications

[-- Attachment #2: dmesg.txt.gz --]
[-- Type: application/octet-stream, Size: 14455 bytes --]

Re: [gentoo-user] python-3.6.5 rebuild fails on new install

[Walter Dnes]

  One interesting item early on in dmesg...

[    0.173494] [drm] Memory usable by graphics device = 2048M
[    0.173591] [drm] Replacing VGA console driver

  Would the "graphics driver" be capable of using up 2 gigs of ram in
a pure text console?  On a 3-gig machine, that would be very bad.

-- 
Walter Dnes <waltdnes@waltdnes.org>
I don't run "desktop environments"; I run useful applications

Re: [gentoo-user] python-3.6.5 rebuild fails on new install

[Franz Fellner]

[-- Attachment #1: Type: text/plain, Size: 719 bytes --]

I think the memory is only used in the context of OpenGL (or when it's used
for computing like with OpenCL).
I am sure you won't run out of memory when compiling on a pure text console
because of the grahics driver.


Am So., 19. Aug. 2018 um 05:27 Uhr schrieb Walter Dnes <
waltdnes@waltdnes.org>:

>   One interesting item early on in dmesg...
>
> [    0.173494] [drm] Memory usable by graphics device = 2048M
> [    0.173591] [drm] Replacing VGA console driver
>
>   Would the "graphics driver" be capable of using up 2 gigs of ram in
> a pure text console?  On a 3-gig machine, that would be very bad.
>
> --
> Walter Dnes <waltdnes@waltdnes.org>
> I don't run "desktop environments"; I run useful applications
>
>

[-- Attachment #2: Type: text/html, Size: 1140 bytes --]

Re: [gentoo-user] python-3.6.5 rebuild fails on new install

[Mick]

[-- Attachment #1: Type: text/plain, Size: 1642 bytes --]

On Sunday, 19 August 2018 02:56:13 BST Walter Dnes wrote:
> On Sat, Aug 18, 2018 at 03:27:27PM -0400, Mike Gilbert wrote
> 
> > On Fri, Aug 17, 2018 at 8:58 PM Walter Dnes <waltdnes@waltdnes.org> wrote:
> > >   I'm re-purposing a Lenovo T400 notebook (CORE2 and 3 gigs ram) with a
> > > 
> > > 32-bit Gentoo install.  I try to do "emerge -e @system" early in the
> > > install, when there's under 200 packages.  Anyhow, python 3.6.5 is not
> > > rebuilding. I've put in all the "final" USE flags for the system.  The
> > > buildlog is attached (gzipped).
> > 
> > The compiler was killed with signal SIGSEGV. You probably ran out of
> > memory or some similar problem. Check dmesg.
> 
>   That would be worrisome. This is an off-lease Lenovo with 3 gigs of
> ram, and 6.8 gigs of swap.  At this point of the install, I haven't even
> built X, so there's no GUI running.  dmesg output is attached.  The last
> line mentions something about python3.6m.

This is an informational message and would only be worrisome if it reported 0 
bytes left.  You can switch if off by disabling CONFIG_DEBUG_STACK_USAGE in 
the kernel.

Some ebuilds, I have chromium in mind here, can chew up all your RAM and then 
start thrashing swap continuously.  To make matters worse in pre-empting this, 
they only do it for a few versions, then revert to better managed memory 
usage.  On a box with 4G RAM I set MAKEOPTS="-j2 -l2" for such troublesome 
packages and swap usage is kept within normal limits.

I think the message "[drm] HPD interrupt storm" refers to some old kernel bug, 
but it could be a regression.  Which kernel are you using?

-- 
Regards,
Mick

[-- Attachment #2: This is a digitally signed message part. --]
[-- Type: application/pgp-signature, Size: 833 bytes --]

Re: [gentoo-user] python-3.6.5 rebuild fails on new install

[Walter Dnes]

On Sun, Aug 19, 2018 at 10:49:27AM +0100, Mick wrote

> Some ebuilds, I have chromium in mind here, can chew up all your
> RAM and then start thrashing swap continuously.  To make matters
> worse in pre-empting this, they only do it for a few versions, then
> revert to better managed memory usage.  On a box with 4G RAM I set
> MAKEOPTS="-j2 -l2" for such troublesome packages and swap usage is
> kept within normal limits.

  I just tried with MAKEOPTS="-j1" and got the same failure output at
the same place.  I normally run with the number equal to the number of
cores.  On this notebook MAKEOPTS="-j2".  Are there any other
memory-conserving tweaks available?

> I think the message "[drm] HPD interrupt storm" refers to some old
> kernel bug, but it could be a regression.  Which kernel are you using?

4.14.61-gentoo

[thimk][root][~] uname -a
Linux thimk 4.14.61-gentoo #3 SMP Fri Aug 17 04:14:29 EDT 2018 i686 Intel(R) Core(TM)2 Duo CPU P8700 @ 2.53GHz GenuineIntel GNU/Linux


-- 
Walter Dnes <waltdnes@waltdnes.org>
I don't run "desktop environments"; I run useful applications

Re: [gentoo-user] python-3.6.5 rebuild fails on new install

[Adam Carter]

[-- Attachment #1: Type: text/plain, Size: 588 bytes --]

>
>   I just tried with MAKEOPTS="-j1" and got the same failure output at
> the same place.  I normally run with the number equal to the number of
> cores.  On this notebook MAKEOPTS="-j2".  Are there any other
> memory-conserving tweaks available?
>

I guess you've stopped all the non-essential services and programs.

Does top or free -m confirm that you're running out of space? If so, you
could create a temporary swap file on an existing filesystem (
https://www.cyberciti.biz/faq/linux-add-a-swap-file-howto/) or make a USB
drive into some temporary swap get you through the build

[-- Attachment #2: Type: text/html, Size: 951 bytes --]

Re: [gentoo-user] python-3.6.5 rebuild fails on new install

[Franz Fellner]

[-- Attachment #1: Type: text/plain, Size: 971 bytes --]

Seems to be a known issue and probably fixed in gcc-7.4.0:
https://bugs.gentoo.org/662208
https://gcc.gnu.org/bugzilla/show_bug.cgi?id=83317

This error is also used in the Gentoo gcc internal compiler error reporting
wiki page:
https://wiki.gentoo.org/wiki/Gcc-ICE-reporting-guide

Am Mo., 20. Aug. 2018 um 08:23 Uhr schrieb Adam Carter <
adamcarter3@gmail.com>:

>   I just tried with MAKEOPTS="-j1" and got the same failure output at
>> the same place.  I normally run with the number equal to the number of
>> cores.  On this notebook MAKEOPTS="-j2".  Are there any other
>> memory-conserving tweaks available?
>>
>
> I guess you've stopped all the non-essential services and programs.
>
> Does top or free -m confirm that you're running out of space? If so, you
> could create a temporary swap file on an existing filesystem (
> https://www.cyberciti.biz/faq/linux-add-a-swap-file-howto/) or make a USB
> drive into some temporary swap get you through the build
>
>

[-- Attachment #2: Type: text/html, Size: 1821 bytes --]

Re: [gentoo-user] python-3.6.5 rebuild fails on new install

[Walter Dnes]

On Mon, Aug 20, 2018 at 08:46:22AM +0300, Franz Fellner wrote
> Seems to be a known issue and probably fixed in gcc-7.4.0:
> https://bugs.gentoo.org/662208
> https://gcc.gnu.org/bugzilla/show_bug.cgi?id=83317
> 
> This error is also used in the Gentoo gcc internal compiler error
> reporting wiki page:
> https://wiki.gentoo.org/wiki/Gcc-ICE-reporting-guide

  Would it cause problems if I built python 3.6 with -mfpmath=387 as a
temporary workaround?

-- 
Walter Dnes <waltdnes@waltdnes.org>
I don't run "desktop environments"; I run useful applications