From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) by finch.gentoo.org (Postfix) with ESMTP id ACC1D138010 for ; Thu, 23 Aug 2012 08:25:58 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 0A931E0732; Thu, 23 Aug 2012 08:25:34 +0000 (UTC) Received: from mail-bk0-f53.google.com (mail-bk0-f53.google.com [209.85.214.53]) by pigeon.gentoo.org (Postfix) with ESMTP id 6C1B721C01B for ; Thu, 23 Aug 2012 08:22:30 +0000 (UTC) Received: by bkwj4 with SMTP id j4so125791bkw.40 for ; Thu, 23 Aug 2012 01:22:29 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=20120113; h=from:to:cc:subject:date:message-id:user-agent:in-reply-to :references:mime-version:content-transfer-encoding:content-type; bh=gvkRhUFwp12w+WJ/tnkeJhBiNmtMQKyXAsa5wYJL2nQ=; b=MuGFi4QSzbTcUmMdvy7MD6JrOpzLMpB21+EUbvyApbsWUiZs7Je0s8JTxokvOUMZoK MIEuqFxdinyEM8K1ttQWoNUk78afd6XLf7iPp+a7OdFxFuMZdh4s262MxLeOUdAp0Eyr uxPBmvbNlAGQD71DOEskItSWi3TlpkB+TLZ3YT/RmFhIdawsFjcOamzGeY6hX4PIVhtG oGB99iHavOrHCzBNL5D/FSvMYAdqXJsUAX3buy+qQ/jEzNxY5xMb24MKRUKAJZwmG5Kv kwo4SnZHyA9bl4U4ZT+NvM6Q22PFdeqplZxTfMlrMnBuVTRNIvZiLn/r/6vQadCA/HOk 63oQ== Received: by 10.205.139.6 with SMTP id iu6mr166026bkc.20.1345710149548; Thu, 23 Aug 2012 01:22:29 -0700 (PDT) Received: from energy.localnet (p4FC61094.dip0.t-ipconnect.de. [79.198.16.148]) by mx.google.com with ESMTPS id y20sm4003839bkv.11.2012.08.23.01.22.27 (version=TLSv1/SSLv3 cipher=OTHER); Thu, 23 Aug 2012 01:22:28 -0700 (PDT) From: Volker Armin Hemmann To: gentoo-user@lists.gentoo.org Cc: Jorge Almeida Subject: Re: [gentoo-user] xz memory hungry? Date: Thu, 23 Aug 2012 10:22:26 +0200 Message-ID: <1502344.cAeGcK7EK0@energy> User-Agent: KMail/4.9 (Linux/3.2.27; KDE/4.9.0; x86_64; ; ) In-Reply-To: References: <5035439E.6090707@binarywings.net> Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-user@lists.gentoo.org Reply-to: gentoo-user@lists.gentoo.org MIME-Version: 1.0 Content-Transfer-Encoding: 7Bit Content-Type: text/plain; charset="us-ascii" X-Archives-Salt: 74f3d1a8-e2d8-4740-a0d5-95e297aed259 X-Archives-Hash: e322e910623d8677aef1827deb959df1 Am Mittwoch, 22. August 2012, 22:16:19 schrieb Jorge Almeida: > On Wed, Aug 22, 2012 at 9:39 PM, Florian Philipp wrote: > > Am 22.08.2012 20:52, schrieb Jorge Almeida: > > > > This should not happen, especially on such a small archive. I've tried > > `strace xz -t m4-1.4.16.tar.xz` and looked for calls to mmap (e.g. > > memory allocations). They never were larger than 68 MB > > > > Try it yourself. The second parameter in mmap is the allocated size in > > byte. > In the box where it works: > > $ strace -e trace=mmap2 xz -t m4-1.4.16.tar.xz > mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, > 0) = 0xb7746000 > mmap2(NULL, 134226, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7725000 > mmap2(NULL, 155888, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, > 0) = 0xb76fe000 > mmap2(0xb7723000, 8192, PROT_READ|PROT_WRITE, > MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x24) = 0xb7723000 > mmap2(NULL, 107004, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, > 0) = 0xb76e3000 > mmap2(0xb76fa000, 8192, PROT_READ|PROT_WRITE, > MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x16) = 0xb76fa000 > mmap2(0xb76fc000, 4604, PROT_READ|PROT_WRITE, > MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0xb76fc000 > mmap2(NULL, 1727172, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, > 3, 0) = 0xb753d000 > mmap2(0xb76dd000, 12288, PROT_READ|PROT_WRITE, > MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x19f) = 0xb76dd000 > mmap2(0xb76e0000, 10948, PROT_READ|PROT_WRITE, > MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0xb76e0000 > mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, > 0) = 0xb753c000 > mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, > 0) = 0xb753b000 > mmap2(NULL, 2097152, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb733b000 > mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, > 0) = 0xb7745000 > mmap2(NULL, 1052672, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, > -1, 0) = 0xb723a000 > +++ exited with 0 +++ > > > In the other box, in the gentoo chroot: > > # strace -e trace=mmap2 xz -t /usr/portage/distfiles/m4-1.4.16.tar.xz > mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, > 0) = 0xb779e000 > mmap2(NULL, 12143, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb779b000 > mmap2(NULL, 143600, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, > 0) = 0xb7777000 > mmap2(0xb7799000, 8192, PROT_READ|PROT_WRITE, > MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x21) = 0xb7799000 > mmap2(NULL, 1448488, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, > 3, 0) = 0xb7615000 > mmap2(0xb7771000, 12288, PROT_READ|PROT_WRITE, > MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x15c) = 0xb7771000 > mmap2(0xb7774000, 10792, PROT_READ|PROT_WRITE, > MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0xb7774000 > mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, > 0) = 0xb7614000 > mmap2(NULL, 2097152, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7414000 > mmap2(NULL, 4096, PROT_READ, MAP_PRIVATE, 3, 0x102a) = 0xb779d000 > mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, > 0) = 0xb779c000 > mmap2(NULL, 67112960, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, > -1, 0) = -1 ENOMEM (Cannot allocate memory) > mmap2(NULL, 67244032, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, > -1, 0) = -1 ENOMEM (Cannot allocate memory) > mmap2(NULL, 2097152, PROT_NONE, > MAP_PRIVATE|MAP_ANONYMOUS|MAP_NORESERVE, -1, 0) = 0xb7214000 > mmap2(NULL, 67112960, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, > -1, 0) = -1 ENOMEM (Cannot allocate memory) > mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, > 0) = 0xb779c000 > xz: /usr/portage/distfiles/m4-1.4.16.tar.xz: Cannot allocate memory > +++ exited with 1 +++ > > > Thanks, > > Jorge Almeida maybe a memory fragmentation problem? It tries to allocate 65mb continous chunk - and can't find one? -- #163933