From mboxrd@z Thu Jan 1 00:00:00 1970
Return-Path: <gentoo-user+bounces-199524-garchives=archives.gentoo.org@lists.gentoo.org>
Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80])
(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
key-exchange X25519 server-signature RSA-PSS (2048 bits))
(No client certificate requested)
by finch.gentoo.org (Postfix) with ESMTPS id 2B3DE158095
for <garchives@archives.gentoo.org>; Thu, 25 Aug 2022 12:43:32 +0000 (UTC)
Received: from pigeon.gentoo.org (localhost [127.0.0.1])
by pigeon.gentoo.org (Postfix) with SMTP id CDE04E08F7;
Thu, 25 Aug 2022 12:43:25 +0000 (UTC)
Received: from mail-qv1-xf30.google.com (mail-qv1-xf30.google.com [IPv6:2607:f8b0:4864:20::f30])
(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
(No client certificate requested)
by pigeon.gentoo.org (Postfix) with ESMTPS id 85550E089A
for <gentoo-user@lists.gentoo.org>; Thu, 25 Aug 2022 12:43:23 +0000 (UTC)
Received: by mail-qv1-xf30.google.com with SMTP id d1so15246370qvs.0
for <gentoo-user@lists.gentoo.org>; Thu, 25 Aug 2022 05:43:23 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=20210112;
h=content-transfer-encoding:in-reply-to:mime-version:user-agent:date
:message-id:autocrypt:openpgp:from:references:to:subject:from:to:cc;
bh=Obe89pWxAnSKsqrPC4kI9+ex1U5Qob/NWzqpsKNHWC0=;
b=oTkuZb4cFDvCsgxQCLw47MY1TVg3XOcvbeAPd7QDQ7LNS+EzFvRvBdGpxw/A7Hj7HY
xmp+lVabRy+4bSn2qLXI2kgoV2F9nhsKKaOGXuR/KUvEXXMCklqyzgvEqEV/ottrehuo
UVcHwfipapVq4HT9JqjXghxFN+i+/PLQtvzEw2Wmi8RdToM8ET+h5z095MvEJvDihV4X
lfCtms+DyORr8PEH9z528zDwg7ByT6qW9Qw1R/qqrNlV/zxq0Qk1NV+ynGcgPRim0yih
TnVDR4g4Ce4Df7OarOQro6BrIbuGxvcbbzPdU500I4fpWMpDfetHjIazhCmY4rNxVZmN
6tLw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=1e100.net; s=20210112;
h=content-transfer-encoding:in-reply-to:mime-version:user-agent:date
:message-id:autocrypt:openpgp:from:references:to:subject
:x-gm-message-state:from:to:cc;
bh=Obe89pWxAnSKsqrPC4kI9+ex1U5Qob/NWzqpsKNHWC0=;
b=8BeCREuESg0dJH3LJ/QI8NygXN2CAmcpyJ0WHZ20PLmH44c6Pg020lS8ad4RI7qTeA
0G4rnIl4B1cqFi/6+MqLxFFFqqJMzFZ0fjB+FvXENs492yezMg+0C8sZK95id3ctDXyo
IBsGQP79gLBkqJJ09MfR1x5fOO0WphkT2CdXkjyQiT2m20r5S65WSkc2sEFFHUgkAw0P
nXnefe3pZZMRbT9M7vtbRHdrXQi/W68mv+EikFooyf0WZY2hMwjoPeJi3DkrEKzOz4KY
bv539ROxHunQDL0pZD8Pc0RYTUyS8mER7HAjHtSescPPgRt7AhOkoTRvFEXnHSr/ymTr
1Kyw==
X-Gm-Message-State: ACgBeo3NUePRa7mgLK20EGalRXgygJIVLO9sm54tHovIDpbNA2pNUhHO
0RB840y6yNghz3dJQ94jce7zKsAqi8A=
X-Google-Smtp-Source: AA6agR53y8VgdZRVwhossBG7GXPxAfE6FnfuRpPcD8utSm5eqpqnC9w+abdt+4a6pbKauHxSw2xixA==
X-Received: by 2002:a0c:aa89:0:b0:48f:5a1b:2e4a with SMTP id f9-20020a0caa89000000b0048f5a1b2e4amr3379616qvb.102.1661431402577;
Thu, 25 Aug 2022 05:43:22 -0700 (PDT)
Received: from [10.0.0.2] ([207.244.201.197])
by smtp.gmail.com with ESMTPSA id j20-20020a05620a411400b006b9a24dc9d7sm17613858qko.7.2022.08.25.05.43.21
(version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128);
Thu, 25 Aug 2022 05:43:22 -0700 (PDT)
Subject: Re: [gentoo-user] Getting maximum space out of a hard drive
To: gentoo-user@lists.gentoo.org
References: <b918b55b-80c0-40be-975c-825a8586da8f@gmail.com>
<CAGfcS_m0BNWQ10uptnH-T=QzWi6OWFA7WPeB_ZKutM0mzFLtJQ@mail.gmail.com>
<57a9895b-9357-17f1-8fb5-d0ede952eefc@gmail.com>
<20220819042614.bj5crtjkgszbnshh@grusum.dhaller.de> <YwaqEcWXOnPV+VmM@kern>
<289fe32e-2815-c361-ea80-73d8df539417@iinet.net.au>
From: Dale <rdalek1967@gmail.com>
Openpgp: preference=signencrypt
Autocrypt: addr=rdalek1967@gmail.com; prefer-encrypt=mutual; keydata=
mQINBGFSciYBEADcEGMyJBSuavKO/XKUVvgkxck7Nl8Iuu8N2lcnRji/rSKg5c1Acix1ll9i
oW8JBCHwvn0+Xy60BvEsqcup3YSHw5STl/bR1ePEehtnYrg8FdjdS91+B805RfnKMm69rFVI
wLSBHQrSG1yxHd8CloWoEdhmVtP24buajbh114bgXd9ahtpZrCVMrWdWYUg2mEXguGV5uNAh
Rf8SWxDNc79w24JxsV34a8niMUYMjzWr0rafIbzk732X38vGjVMLo/2mMpkbp9mPp++LHoY+
0Pet8zxxdXPJSCd475kza1AD+hhSyBZXB9yknYWgyY3cZe1rGmooJSi2KX4QxO7npwLThcO1
be6KKRkd35+Fi/a1BzVOHsZMiK/gcwxEFoMd27gir4ehaeHJfFXl+65w4hj0EsOZSxrJrm2C
R50g5By2czSKP1bADEygFNpIJj51AR+wM88NImG2RPtlT2maYBzazvF05g65cdHXGp1C7W5P
wwwKU2DgABB2t7N7z5A69LnryBRw4zUYDRRYLTYlBlYgg+xILm2c0OrBdxJgLJa7JE50Eo25
d3PFwt9J0gYvqy6sPFLl9So0sDg9zm0hKQtXOP5kgropUFGrNoJI+mjwF4rYLRBVzZwNAvlO
OhEvHubBo3mEllv4x+FeptwXZxlk7gUsdqI8AxnFB8K9wi6FVQARAQABtBtEYWxlIDxyZGFs
ZWsxOTY3QGdtYWlsLmNvbT6JAk4EEwEIADgCGyMFCwkIBwIGFQoJCAsCBBYCAwECHgECF4AW
IQQSG1h01ruv/WNXc3Q3RqOgiQH1GwUCYVJy8gAKCRA3RqOgiQH1G+waEACeTZCt77jnRAmQ
AV7otKuZekDWiLi3Eig8tj5ZJiCNSYA/hIxzmexRP0GMqjitcXK1iGwWcvMzzvIq30GAjIfB
4BR38cnXbtBa6fNewiT7QaZe/Hn6yBRldXNQypzbHy+/o27bUEy+oX4rE7etUgEHQAjuw7xz
XFWg4tH1/KJvsOVY5upnWc5LdxYhsuQ3dQD4b22GsK0pOBDfb9PiirYM8eGKvrVuq4E/c75z
lDDFhINl18lNZ9D0ZFL3IkTjHsAAqFH9uhnnEB8CWdHbBewPEfRaOhBUYWZ3Q8uTkmDgZT8q
D9jlvLEdw7Nh2ApdxoepnI/4D+ql2Gr4DtH7SEPydr5gcf1Qr/2bXRb1hAYnIVcbncs/Bm3Z
bkRKPVWMfE3Fusa+p5hMzixk0YysMaTHlc7mYRYAEZGnPMXnmcCbetwARU7A0yz1M1kCMOAQ
Lsz8KH5kv3cRenMB6SFfjND2JfAK61H5TtnPq3L8noS2ZykRYxq9Nm3X64O1tJojIKBoZFr8
AwYNCvqC6puUyGMuzHPh7jPof8glfrrEKIYUvNPGMDoVX3IGetxh/9l6NcxgFA4JGoR+LS3C
zmeNrwlllAe3OEUfKoWVQ+pagpSdM+8hHolaSda4Ys66Z3fCR4ZvcTqfhTAVskpqdXa4isAk
7vTcXu3L499ttywEp7rJTbkCDQRhUnImARAAncUdVhmtRr59zqpTUppKroQYlzR0jv8oa7DG
K4gakTAT2N7evnI9wpssmzyVk8VEiLzhnFQ/Ol3FRt6hZCXDJt0clyHOyTfvz/MNFttWuZTc
mLpSvmRR6VRjAH+Tz3Eam2xUw3PGuH97BcXQ3NnX3msv1UDxtxxBu6e2YrdeOhrCUSgzokcJ
98ChUNy934cgepPybAI12lSWqVFQ1aG7jExZfiUk+333fPSDbpKoZbTW5YJLXbycmW/C1IWL
qYQyNjRWKaGoJtUWFhhmNiOQct7n90aKivNVPavmN+UQ9LlMaINtf9T6XCzLfogCFsulDCDJ
0yNQLDTurHaB4E71xoctgXmLLq9z1RQ0W2XiVAAOZQj6K3+d0AOUjDhCQ2QW8dUSq0ckkZXV
DKVJOGS8Nhf2eIWIqRnP3AcUiiaiFGqUaVUmUAZ6h/oJmgghEu/1S+pcuUKU5i69+XCZ3hH2
Jzwzbf7K+FAIkOhCfHncF8i1N1pk00pOVykNnqHTfFo3qFusHt0ZWgXVnnn4pYdXqZNoDhvF
BRE5Vm4k/k96Pw8HRx6Os6eFSRrlqGzRgqsu86FekxusXB9UGv4lJhtU/J+8MRWsh22K718s
DbQnABicGKFz1qQlWvcf59oTByhLINJCBt1WXl+TzJDXepr3QSkqmK41dO9Hob97C9dMiK8A
EQEAAYkCNgQYAQgAIAIbDBYhBBIbWHTWu6/9Y1dzdDdGo6CJAfUbBQJhUnLyAAoJEDdGo6CJ
AfUbVHIQAKSWw620vPhR3A/njU2z77F3z/Jk+HTKdE3fIyWSWdkYN7CBFL0NguOMP30WZ+qE
sJhZu7T5hf251MwQUUt27xlfnKYOmQs7CqONlXuXlGZI6WufrUjxNcVz+5gJsqvUWuuJWsgg
sDmE92IBnfG/f81fPHWQyfr/SF4wYDMyoFp5xCCQpp1zB63iuFvvrhxBkEHzmbRtVDOhl0Xp
BVEDR1w3QRACw9QJD/KM05Czv9JNQYlwinWO/OaQ9cMlUpKLgswUPg9IZ5vucxScfuAUA5uC
B1jlAQ8ZPlVukBmbEv5RGOv+lpuEbA3YDMVtEeH4YMFbjt/+vH3Cr2vTbp5JlpByLburJEH0
WXZLUawEfUsZvVwpOuJK75vaa2HYXee+Cb3iCIzwfIfctdlqzUcbGRczlRNM59hpvj4z29Gh
3kAxVHItAYq54ikxQ9l4hQ8s9sLYPbX/WtcBxNX8crBSw0FLnmzGleVEtBHyqtt5CLzQNgrj
GYWl1vKDUmRPw1CdZ1c+fMN9CY11jOM5B5ZnqZWfDeVYO2iJ5SuvTycChexCb8WYn1bdCBIo
bBtga2RBXbVt4Mh9E4owsszefn51MwfjXxB20Fc5k3GU1AVpTCMs3ayYCzo0b2pvEvdjtDcA
CYLEFPWgaFX9iQAM/CDfKvTtvgGWpqtCL2raq/mQoJEU
Message-ID: <6f3feff2-eac9-f6ec-4a3c-c511cf469603@gmail.com>
Date: Thu, 25 Aug 2022 07:43:20 -0500
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101
Firefox/68.0 SeaMonkey/2.53.13
Precedence: bulk
List-Post: <mailto:gentoo-user@lists.gentoo.org>
List-Help: <mailto:gentoo-user+help@lists.gentoo.org>
List-Unsubscribe: <mailto:gentoo-user+unsubscribe@lists.gentoo.org>
List-Subscribe: <mailto:gentoo-user+subscribe@lists.gentoo.org>
List-Id: Gentoo Linux mail <gentoo-user.gentoo.org>
X-BeenThere: gentoo-user@lists.gentoo.org
Reply-to: gentoo-user@lists.gentoo.org
X-Auto-Response-Suppress: DR, RN, NRN, OOF, AutoReply
MIME-Version: 1.0
In-Reply-To: <289fe32e-2815-c361-ea80-73d8df539417@iinet.net.au>
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 8bit
X-Archives-Salt: ba3344c5-691a-4088-a2ec-f60ef358ecf5
X-Archives-Hash: da9675e2aa45c4384df41b3802621573
William Kenworthy wrote:
>
> On 25/8/22 06:45, Frank Steinmetzger wrote:
>>> [..]
>>> Also, if you're using ext2/3/4, there's the preset, i.e. if you're
>>> rather sure about what kind of data is going to be on there, you
>>> can tune it so that it reserves more or less place for metadata like
>>> inodes, which can be another bit.
>> When I format a partition (and I usually use ext4, with some f2fs
>> mingled in
>> on flash bashed devices), I always set the inode count myself,
>> because the
>> default was always much too high. Like 15 m on a 40 GiB partition or
>> so. My
>> arch root partition has 2 m inodes in total, 34 % of which are in use
>> for a
>> full-fledged KDE setup. That’s sufficient.
>>
>> On Gentoo, I might give it some more for the ever-growing portage
>> directory.
>> But even a few percent on a 10 TB drive amount to many gigabytes.
>>
> Keep in mind ext4 is created with a fixed number of inodes - you cant
> change it once its created so you have to deal with reformatting the
> filesystem and replacing the data. Just another reason to use
> something more modern - running out of inodes, especially on a large
> disk is not a minor matter as you have to find somewhere to copy/store
> the data so you can reformat the disk with more inodes and then put it
> back. I seem to remember the last time it happened to me (its not an
> uncommon event) I had to deal with mass corruption too.
>
> On the other hand, at one inode per file and Dale primarily storing
> large media files it may be safe to reduce them.
>
> BillK
I've already got data on the drive now with the default settings so it
is to late for the moment however, I expect to need to add drives
later. Keep in mind, I use LVM which means I grow file systems quite
often by adding drives. I don't know if that grows inodes or not. I
suspect it does somehow. This is my current inodes on drives inside my
puter. I removed the cruft from the list.
root@fireball / # df -i
Filesystem Inodes IUsed IFree IUse% Mounted on
/dev/sda6 1525920 18519 1507401 2% /
/dev/mapper/OS-usr 2564096 752882 1811214 30% /usr
/dev/sda1 98392 1219 97173 2% /boot
/dev/mapper/OS-var 3407872 322463 3085409 10% /var
/dev/mapper/home-home--lv 183144448 727910 182416538 1% /home
/dev/mapper/backup-backup 45793280 1359825 44433455 3% /backup
/dev/mapper/crypt 488378368 43027 488335341 1%
/home/dale/Desktop/Crypt
root@fireball / #
The portage tree is on /var on my system. The ones I am most curious
about is the /home and the crypt one. As you can see, /home and crypt
is using only a tiny fraction of inodes. Here is the interesting bit:
root@fireball / # df -h
Filesystem Size Used Avail Use% Mounted on
/dev/sda6 23G 2.2G 20G 10% /
/dev/mapper/OS-usr 39G 22G 15G 61% /usr
/dev/sda1 373M 187M 167M 53% /boot
/dev/mapper/OS-var 52G 23G 26G 47% /var
/dev/mapper/home-home--lv 5.5T 2.6T 2.9T 48% /home
/dev/mapper/backup-backup 688G 369G 319G 54% /backup
/dev/mapper/crypt 15T 12T 3.1T 79% /home/dale/Desktop/Crypt
root@fireball / #
As you can see, /home is about half full, crypt however is pushing 80%
pretty hard. On /home, I have my documents directory and it has lots of
smaller files compared to crypt. While /home does have some videos, it
also contains my camera picture directory and the directories for my
trail cameras. Also, it has small documents such as recipes and such
which can be anywhere from a few kilobytes to maybe 1MB or so, not many
much larger than that. While I may not want to reduce /home much, I
could likely reduce crypt by 90% and still have a lot left over,
provided that changes when I grow the file system as I add drives etc.
Yes, I'm already on the hunt for another hard drive to add onto crypt.
Is there a tool to tell the average size of files in a directory? Tools
that would help us to know how many inodes one actually needs? As it
is, I'm doing a lot of updating of old files with larger files, due to
higher resolution of videos. Example, some videos are going from a
little below 720p to 720p or 1080p. The difference in file size is
pretty large. Sometimes double or more.
This is interesting to consider here. One doesn't want to run out of
inodes but at the same time, even if I only had 10% of the number I have
now for crypt I'd still have 10 times more than I need with the thing
almost full. This is also true for my backup drives as well. Two of
them at least. One that has documents I'd likely leave as is.
I'm going to have to work on better storage somehow. All of this is
going to crop up again eventually, likely sooner rather than later.
Dale
:-) :-)
P. S. I have to close my VPN to check emails still. Pardon the time
lag in replies compared to the past.