From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by finch.gentoo.org (Postfix) with ESMTPS id 154BE158013 for ; Sun, 26 Sep 2021 12:25:40 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id D5F95E09C1; Sun, 26 Sep 2021 12:25:34 +0000 (UTC) Received: from EUR05-AM6-obe.outbound.protection.outlook.com (mail-am6eur05olkn2058.outbound.protection.outlook.com [40.92.91.58]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id 4052FE08FA for ; Sun, 26 Sep 2021 12:25:34 +0000 (UTC) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=TgvzWHifrAGc/x5SBPSYl0YfrKRnxfwWB+LOnZICdrPvEzwXGb7V9taeKl6SUqjwpwf5jAKijlKwCanxCSzf8Bfb9UGwc0u4e+jiUkZxw5m85uqnkisbzHZ4V5dbSgdhjtjQd4GVSSDaHnMfW8MoDhW1etWlZafCnqIi0xlTixAs82in3o60xUu1Ex6L6x310s2EmT6GxMOuAFdPzK1GgGBI6vSIPsev72QHdAjgZOAVsOV3mMqD/xN+feSoz8upw70/F1wdx5xrMIXrkyNML8CqpAVRRAsYs8g6/bSfJv+Rn/f3G5mM9x9hjWxj7bEfduzEGjVRQs3Xb0azjJrJRg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=p2Uo97p3A2KwQ4p+S5H50o6uO3FnwNV65szGdwqPuI8=; b=BfwfJNqEpuHfr9YUTXNERnCBxe2f8P2UHzc/HK5sornNA1xglFoER14gNijRA0FfxYe8qxzeyq2Enc4LgZivsg15lzPciakOGuUl01xC7JmfDZuEtPm6GJFyLpgHaX6iflOYpFWeoeTMDoTT2n0MQDiqSL3Leup5ptmiLk8gdjK8dmSOVZBsLFh4g07Ad/WxDzpeT+v5+qtbGCIODRjJXULF0WqsWcVwcLWVwfNJ59oaghSM+UjAHamgFWYBZdHSJvIEMCkwx8c5clPfao3nVudJEfj6Onl2YWg+LcrKrBmyFXS2nFYIhjTjt273caQ8JkDQDzslKWxLwk6ljxhj1w== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=none; dmarc=none; dkim=none; arc=none Received: from AM6PR10MB2440.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:20b:4c::30) by AM5PR10MB1716.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:206:1b::19) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4523.14; Sun, 26 Sep 2021 12:25:31 +0000 Received: from AM6PR10MB2440.EURPRD10.PROD.OUTLOOK.COM ([fe80::429:de52:1152:d88b]) by AM6PR10MB2440.EURPRD10.PROD.OUTLOOK.COM ([fe80::429:de52:1152:d88b%7]) with mapi id 15.20.4544.021; Sun, 26 Sep 2021 12:25:31 +0000 Subject: Re: [gentoo-user] How to compress lots of tarballs To: gentoo-user@lists.gentoo.org References: <5513654.DvuYhMxLoT@wstn> <20210926113622.E8352E09BE@pigeon.gentoo.org> From: Ramon Fischer Message-ID: Date: Sun, 26 Sep 2021 14:25:24 +0200 User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1) In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="oaITEXe03TKhkF5kif6Zzqu6pl1724N8l" X-TMN: [5klnpy2zcu+y1lV+eo3SgKtFkSqmZAKdqPc0Xg/g4KD1HpheIHI74g3JF8N62OFV] X-ClientProxiedBy: PR0P264CA0050.FRAP264.PROD.OUTLOOK.COM (2603:10a6:100:1d::14) To AM6PR10MB2440.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:20b:4c::30) X-Microsoft-Original-Message-ID: <92ec5b58-b0a4-e41a-c70a-da95b9ef39fd@hotmail.de> Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-user@lists.gentoo.org Reply-to: gentoo-user@lists.gentoo.org X-Auto-Response-Suppress: DR, RN, NRN, OOF, AutoReply MIME-Version: 1.0 X-MS-Exchange-MessageSentRepresentingType: 1 Received: from [IPv6:2a0a:a545:168:0:80a1:cb76:3526:a7cb] (2a0a:a545:168:0:80a1:cb76:3526:a7cb) by PR0P264CA0050.FRAP264.PROD.OUTLOOK.COM (2603:10a6:100:1d::14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4544.14 via Frontend Transport; Sun, 26 Sep 2021 12:25:30 +0000 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: fdad27ed-d1a6-4f8b-272f-08d980e8bb31 X-MS-TrafficTypeDiagnostic: AM5PR10MB1716: X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: yUb4Sl96E7PZdJpkQ7r7N6rAgKNy0vy/Ma7TEk00RJcejlMAH/M76gtNcw+D6OqaejP4s+EMFItXXSc1ARTY0Y1Q/Ky6ZLynmPZd0Azp2qzdiku/5O0cyHDKP5RYGNzGKsmLlsc2WKqhz3hQy2/YvJxEwCqj22cHYS/I7XQ8mWYrKH8MjWJNb7z8RdQe6PYpbW/qQs1z2wXcjaqZUUCifXG/X8671jLqXM1BmkOq0NO/jz99laYJegg7xHB31Q5uHc9ljYjc3xkOFUoO0e9pkKu8Zbv2KbmJ7YQlMpJVYQzLwVf2x/S44k7xPzbBhZlwPoJ/jKX1GO+Tx5hhJDdCKdGrsO1PzaZxFiY5wuTDFp3QDhqjO7Pm4K9/hAvmNOcYRA3zNENLXsnD5plaSlxfuJUN7jQJO7oBiKnHhHV0laQMcs4isHJw+IKkW7rz4YpqJq3z2hpGY765spIHuzIO8qXpx+eWZ2sKeZdhI62IQl0= X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: gSQWzsovk+OSaRfQDDa8RltENabsGOSDxpzKhmkINt44ickXWTYHj/3iLWKsZjZ5aWtHZEn/2Qc9EdmlCCBSLwUDQ3FhwUcofpQm3i8E1da1ssbHEc8atyRibKE73u/2OWcu1qroov+ufBlLTJ4Bfa77z4YHaeXUeJYGacDiEC6exJCKwEyl5Av4Pi/Po5VxCQnlRL/S1OPoqbBcEvgKAw== X-OriginatorOrg: sct-15-20-3174-20-msonline-outlook-dfa5a.templateTenant X-MS-Exchange-CrossTenant-Network-Message-Id: fdad27ed-d1a6-4f8b-272f-08d980e8bb31 X-MS-Exchange-CrossTenant-AuthSource: AM6PR10MB2440.EURPRD10.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 26 Sep 2021 12:25:31.4038 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 84df9e7f-e9f6-40af-b435-aaaaaaaaaaaa X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM5PR10MB1716 X-Archives-Salt: 18422199-ac7c-4b99-9d9e-34d911cb1898 X-Archives-Hash: 664cc6b8146960a1dc26c74a14c08db6 --oaITEXe03TKhkF5kif6Zzqu6pl1724N8l Content-Type: multipart/mixed; boundary="fQs3oRqqyGUKJZw1YpiokbeCYgyjhZRTY"; protected-headers="v1" From: Ramon Fischer To: gentoo-user@lists.gentoo.org Message-ID: <92ec5b58-b0a4-e41a-c70a-da95b9ef39fd@hotmail.de> Subject: Re: [gentoo-user] How to compress lots of tarballs References: <5513654.DvuYhMxLoT@wstn> <20210926113622.E8352E09BE@pigeon.gentoo.org> In-Reply-To: --fQs3oRqqyGUKJZw1YpiokbeCYgyjhZRTY Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: quoted-printable Content-Language: en-US Addendum: To complete the list. Here the parallel implementation of "lzip": "plzip": https://www.nongnu.org/lzip/plzip.html -Ramon On 26/09/2021 14:23, Ramon Fischer wrote: > In addition to this, you may want to use the parallel implementations=20 > of "gzip", "xz", "bzip2" or the new "zstd" (zstandard), which are=20 > "pigz"[1], "pixz"[2], "pbzip2"[3], or "zstmt" (within package=20 > "app-arch/zstd")[4] in order to increase performance: > > =C2=A0=C2=A0 $ cd > =C2=A0=C2=A0 $ for tar_archive in *.tar; do pixz "${tar_archive}"; done= > > -Ramon > > [1] > * https://www.zlib.net/pigz/ > > [2] > * https://github.com/vasi/pixz > > [3] > * https://launchpad.net/pbzip2 > * http://compression.ca/pbzip2/ > > [4] > * https://facebook.github.io/zstd/ > > > On 26/09/2021 13:36, Simon Thelen wrote: >> [2021-09-26 11:57] Peter Humphrey >>> part=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 text/plain 382 >>> Hello list, >> Hi, >> >>> I have an external USB-3 drive with various system backups. There=20 >>> are 350 .tar >>> files (not .tar.gz etc.), amounting to 2.5TB. I was sure I wouldn't=20 >>> need to >>> compress them, so I didn't, but now I think I'm going to have to. Is = >>> there a >>> reasonably efficient way to do this? I have 500GB spare space on=20 >>> /dev/sda, and >>> the machine runs constantly. >> Pick your favorite of gzip, bzip2, xz or lzip (I recommend lzip) and >> then: >> mount USB-3 /mnt; cd /mnt; lzip * >> >> The archiver you chose will compress the file and add the appropriate >> extension all on its own and tar will use that (and the file magic) to= >> find the appropriate decompresser when you want to extract files later= >> (you can use `tar tf' to test if you want). >> >> --=20 >> Simon Thelen >> > --=20 GPG public key: 5983 98DA 5F4D A464 38FD CF87 155B E264 13E6 99BF --fQs3oRqqyGUKJZw1YpiokbeCYgyjhZRTY-- --oaITEXe03TKhkF5kif6Zzqu6pl1724N8l Content-Type: application/pgp-signature; name="OpenPGP_signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="OpenPGP_signature" -----BEGIN PGP SIGNATURE----- wsF5BAABCAAjFiEEWYOY2l9NpGQ4/c+HFVviZBPmmb8FAmFQZrUFAwAAAAAACgkQFVviZBPmmb/W MQ/7BoKpjyXFUpQ59byeOfd7+s4iHZBPA95GCVg7G2TUKuyouucFIVfGwywDs6wgNnk7CjtEFD7q +GQdlXMgmJD0hCUZl4zYF5z+TyLaAfm+JXQFsKWv7N1GEOJHSDd4tWu4WrQP4WMNedANX8ELHKrm NdJBsw/J+m96ePDdxYje9mQrlQMB8hWSJm/9ctcvQZiQSZ+JHhUEOsid8+QCg8KWaBcffC+UMKXj bV6ME0N8KDck8PkoPGc3zqQiOpVKAUQ7VqWbXsV3UfKxYayw4CfvI2fszALX4GjCEysCLvkG0ODF K+NHNP181/Celn5ekl2fMtPZYe91JI+n76H9TZUo0OypDpF0H03PNyWTbk0p/Of/MbkLh2GUFXv0 DAzH5gppGUxFrk6Olebr0S2BLTlbnZfA7uQmSJhkH2lkbj/SspgGBGZsikV+U1F/YFqn7JZjE1pU GXs3kvxEAQxR3gIe7CBJ40E+on+JTC8DcTNMsuDS5UTTjeX6o0QuZ561v/f/via/Ky0zcNBouZoD HqYYpOv4QbxokkVPtE/VOoYc0c617j3AUTBOAkU0UaY3MZG/WAeZiL4HmbCtW0IVJ6HuzOSzPTS9 ePxeGZPLuzLpzr82gRKvon+iB+/TC4C/y6j+YXOBUwZX6hgBf7KY4eXCtflfnNL9MJD0QhxdQ5Rb hsU= =nJvp -----END PGP SIGNATURE----- --oaITEXe03TKhkF5kif6Zzqu6pl1724N8l--