From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by finch.gentoo.org (Postfix) with ESMTPS id 9C1F4158011 for ; Sun, 21 Aug 2022 16:47:49 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 69BE6E0A03; Sun, 21 Aug 2022 16:47:44 +0000 (UTC) Received: from mail-qt1-x831.google.com (mail-qt1-x831.google.com [IPv6:2607:f8b0:4864:20::831]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id 98F15E0971 for ; Sun, 21 Aug 2022 16:47:43 +0000 (UTC) Received: by mail-qt1-x831.google.com with SMTP id l5so6443210qtv.4 for ; Sun, 21 Aug 2022 09:47:43 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=content-transfer-encoding:in-reply-to:mime-version:user-agent:date :message-id:autocrypt:openpgp:references:to:from:subject:from:to:cc; bh=1GDGLh2it9UaVMzmrQ/KsM/dhjRl7dWvfBxp7ZTRyTQ=; b=EfJNb0wCufApNxc3Hv2Ei8O2/E754KQi3GQh7JCZ/uwUUvlgPhzBghPr9i5y//qWXN fVjr3hG/CaU3IaTwirdTk0IjofhhOAqS5ccCuLPw3D1F8tbwrWa/+Uk9LYJFx/3XfU2Q 8HrM1hVUi5lrSJfz2tqWFjWwfjsoJt0mLys/eZDDCUBSkRhAL6hWdDY7ONqWryz9T8sZ 44/WeiyOvITlksvg/Z2iOvXbNB5Do4H0SqsWtg/2ZeMgX3ZplfNwMsew4Koew/XFspCp /zZDspx8lUAy3Us0gL0S0jaB5CrAcwA9vtZlnpcbW7DOGiAX71l+1LINHvrf+BdGGRC9 h35w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=content-transfer-encoding:in-reply-to:mime-version:user-agent:date :message-id:autocrypt:openpgp:references:to:from:subject :x-gm-message-state:from:to:cc; bh=1GDGLh2it9UaVMzmrQ/KsM/dhjRl7dWvfBxp7ZTRyTQ=; b=eRios21L3Rm8JSUqHh8/cLqTjLtzRXa3qD91k8uNPE8/ElaiSnnO+WZHzbNtzjowFH r24l/H+Vq+MmpzLEajQJmNiGWcAv/PP/kuztKaIh9wb8mkvbCfVtORhvEc9eeZYFG2vb voXXnzKad54JDA63EEhTsHQAvGvHqgfig68XzHYpYmmVyiasQRGESgEA6ifpAxVndmm2 Im0k70ekvAdsFcSIPT49yxjf6KLjwd7uzLwuRVHPU5OxqrJMGQdgfFamkE0zmAdONBRe IJiqUXK5kTeD2OcHkWaN1ZHos0Ue5qtBvXneQe5sM9Xf7dFhzBdNDE8GHUUy8c9GNqKQ a8gQ== X-Gm-Message-State: ACgBeo0cG60NpNNVBVj86fSHCpTOKG77S5UN33rwxZgbmgefKTzikxXJ DL4wz3keoXWfj2watbeJr0sVhV7nfCA= X-Google-Smtp-Source: AA6agR56yP6RNuuyTrtB78MCXPiiK6q5o2KDWd6CjK26mziaLIzvbBcNdcLTLSDry+eUUXO/SgZT3A== X-Received: by 2002:a05:622a:13c7:b0:343:7907:b42c with SMTP id p7-20020a05622a13c700b003437907b42cmr12562002qtk.435.1661100462708; Sun, 21 Aug 2022 09:47:42 -0700 (PDT) Received: from [10.0.0.2] ([207.244.201.197]) by smtp.gmail.com with ESMTPSA id m1-20020a05620a290100b006b95f832aebsm8850516qkp.96.2022.08.21.09.47.42 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sun, 21 Aug 2022 09:47:42 -0700 (PDT) Subject: Re: [gentoo-user] Getting maximum space out of a hard drive From: Dale To: gentoo-user@lists.gentoo.org References: <7f23ce9f-7871-c76f-8f50-212e2ff637cf@gmail.com> <4c28eb9f-2285-5580-aba3-eca051db3ca5@iinet.net.au> <65f89527-60ce-3800-b723-a0e1305eabf2@gmail.com> Openpgp: preference=signencrypt Autocrypt: addr=rdalek1967@gmail.com; prefer-encrypt=mutual; keydata= mQINBGFSciYBEADcEGMyJBSuavKO/XKUVvgkxck7Nl8Iuu8N2lcnRji/rSKg5c1Acix1ll9i oW8JBCHwvn0+Xy60BvEsqcup3YSHw5STl/bR1ePEehtnYrg8FdjdS91+B805RfnKMm69rFVI wLSBHQrSG1yxHd8CloWoEdhmVtP24buajbh114bgXd9ahtpZrCVMrWdWYUg2mEXguGV5uNAh Rf8SWxDNc79w24JxsV34a8niMUYMjzWr0rafIbzk732X38vGjVMLo/2mMpkbp9mPp++LHoY+ 0Pet8zxxdXPJSCd475kza1AD+hhSyBZXB9yknYWgyY3cZe1rGmooJSi2KX4QxO7npwLThcO1 be6KKRkd35+Fi/a1BzVOHsZMiK/gcwxEFoMd27gir4ehaeHJfFXl+65w4hj0EsOZSxrJrm2C R50g5By2czSKP1bADEygFNpIJj51AR+wM88NImG2RPtlT2maYBzazvF05g65cdHXGp1C7W5P wwwKU2DgABB2t7N7z5A69LnryBRw4zUYDRRYLTYlBlYgg+xILm2c0OrBdxJgLJa7JE50Eo25 d3PFwt9J0gYvqy6sPFLl9So0sDg9zm0hKQtXOP5kgropUFGrNoJI+mjwF4rYLRBVzZwNAvlO OhEvHubBo3mEllv4x+FeptwXZxlk7gUsdqI8AxnFB8K9wi6FVQARAQABtBtEYWxlIDxyZGFs ZWsxOTY3QGdtYWlsLmNvbT6JAk4EEwEIADgCGyMFCwkIBwIGFQoJCAsCBBYCAwECHgECF4AW IQQSG1h01ruv/WNXc3Q3RqOgiQH1GwUCYVJy8gAKCRA3RqOgiQH1G+waEACeTZCt77jnRAmQ AV7otKuZekDWiLi3Eig8tj5ZJiCNSYA/hIxzmexRP0GMqjitcXK1iGwWcvMzzvIq30GAjIfB 4BR38cnXbtBa6fNewiT7QaZe/Hn6yBRldXNQypzbHy+/o27bUEy+oX4rE7etUgEHQAjuw7xz XFWg4tH1/KJvsOVY5upnWc5LdxYhsuQ3dQD4b22GsK0pOBDfb9PiirYM8eGKvrVuq4E/c75z lDDFhINl18lNZ9D0ZFL3IkTjHsAAqFH9uhnnEB8CWdHbBewPEfRaOhBUYWZ3Q8uTkmDgZT8q D9jlvLEdw7Nh2ApdxoepnI/4D+ql2Gr4DtH7SEPydr5gcf1Qr/2bXRb1hAYnIVcbncs/Bm3Z bkRKPVWMfE3Fusa+p5hMzixk0YysMaTHlc7mYRYAEZGnPMXnmcCbetwARU7A0yz1M1kCMOAQ Lsz8KH5kv3cRenMB6SFfjND2JfAK61H5TtnPq3L8noS2ZykRYxq9Nm3X64O1tJojIKBoZFr8 AwYNCvqC6puUyGMuzHPh7jPof8glfrrEKIYUvNPGMDoVX3IGetxh/9l6NcxgFA4JGoR+LS3C zmeNrwlllAe3OEUfKoWVQ+pagpSdM+8hHolaSda4Ys66Z3fCR4ZvcTqfhTAVskpqdXa4isAk 7vTcXu3L499ttywEp7rJTbkCDQRhUnImARAAncUdVhmtRr59zqpTUppKroQYlzR0jv8oa7DG K4gakTAT2N7evnI9wpssmzyVk8VEiLzhnFQ/Ol3FRt6hZCXDJt0clyHOyTfvz/MNFttWuZTc mLpSvmRR6VRjAH+Tz3Eam2xUw3PGuH97BcXQ3NnX3msv1UDxtxxBu6e2YrdeOhrCUSgzokcJ 98ChUNy934cgepPybAI12lSWqVFQ1aG7jExZfiUk+333fPSDbpKoZbTW5YJLXbycmW/C1IWL qYQyNjRWKaGoJtUWFhhmNiOQct7n90aKivNVPavmN+UQ9LlMaINtf9T6XCzLfogCFsulDCDJ 0yNQLDTurHaB4E71xoctgXmLLq9z1RQ0W2XiVAAOZQj6K3+d0AOUjDhCQ2QW8dUSq0ckkZXV DKVJOGS8Nhf2eIWIqRnP3AcUiiaiFGqUaVUmUAZ6h/oJmgghEu/1S+pcuUKU5i69+XCZ3hH2 Jzwzbf7K+FAIkOhCfHncF8i1N1pk00pOVykNnqHTfFo3qFusHt0ZWgXVnnn4pYdXqZNoDhvF BRE5Vm4k/k96Pw8HRx6Os6eFSRrlqGzRgqsu86FekxusXB9UGv4lJhtU/J+8MRWsh22K718s DbQnABicGKFz1qQlWvcf59oTByhLINJCBt1WXl+TzJDXepr3QSkqmK41dO9Hob97C9dMiK8A EQEAAYkCNgQYAQgAIAIbDBYhBBIbWHTWu6/9Y1dzdDdGo6CJAfUbBQJhUnLyAAoJEDdGo6CJ AfUbVHIQAKSWw620vPhR3A/njU2z77F3z/Jk+HTKdE3fIyWSWdkYN7CBFL0NguOMP30WZ+qE sJhZu7T5hf251MwQUUt27xlfnKYOmQs7CqONlXuXlGZI6WufrUjxNcVz+5gJsqvUWuuJWsgg sDmE92IBnfG/f81fPHWQyfr/SF4wYDMyoFp5xCCQpp1zB63iuFvvrhxBkEHzmbRtVDOhl0Xp BVEDR1w3QRACw9QJD/KM05Czv9JNQYlwinWO/OaQ9cMlUpKLgswUPg9IZ5vucxScfuAUA5uC B1jlAQ8ZPlVukBmbEv5RGOv+lpuEbA3YDMVtEeH4YMFbjt/+vH3Cr2vTbp5JlpByLburJEH0 WXZLUawEfUsZvVwpOuJK75vaa2HYXee+Cb3iCIzwfIfctdlqzUcbGRczlRNM59hpvj4z29Gh 3kAxVHItAYq54ikxQ9l4hQ8s9sLYPbX/WtcBxNX8crBSw0FLnmzGleVEtBHyqtt5CLzQNgrj GYWl1vKDUmRPw1CdZ1c+fMN9CY11jOM5B5ZnqZWfDeVYO2iJ5SuvTycChexCb8WYn1bdCBIo bBtga2RBXbVt4Mh9E4owsszefn51MwfjXxB20Fc5k3GU1AVpTCMs3ayYCzo0b2pvEvdjtDcA CYLEFPWgaFX9iQAM/CDfKvTtvgGWpqtCL2raq/mQoJEU Message-ID: Date: Sun, 21 Aug 2022 11:47:41 -0500 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Firefox/68.0 SeaMonkey/2.53.13 Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-user@lists.gentoo.org Reply-to: gentoo-user@lists.gentoo.org X-Auto-Response-Suppress: DR, RN, NRN, OOF, AutoReply MIME-Version: 1.0 In-Reply-To: <65f89527-60ce-3800-b723-a0e1305eabf2@gmail.com> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-Archives-Salt: 02b54c4e-8689-460c-8716-09dae36b26f1 X-Archives-Hash: 1e8bcfa3d8d0ceef8dba38c22091159d Dale wrote: > William Kenworthy wrote: >> What are you measuring the speed with - hdparm or rsync or ? >> >> hdparm is best for profiling just the harddisk (tallks to the >> interface and can bypass the cache depending on settings, rsync/cp/?? >> usually have the whole OS storage chain including encryption affecting >> throughput.  Encryption itself can be highly variable depending on >> what you use and usually though not always includes compression before >> encryption.  There are tools you can use to isolate where the slowdown >> occurs.  atop is another one that may help. >> >> [test using a USB3 shingled drive on a 32 it arm system] >> >> xu4 ~ # hdparm -Tt /dev/sda >> /dev/sda: >>  Timing cached reads:   1596 MB in  2.00 seconds = 798.93 MB/sec >>  Timing buffered disk reads: 526 MB in  3.01 seconds = 174.99 MB/sec >> xu4 ~ # >> >> BillK >> > I copied that from a fair sized file in rsync's progress output.  I just > picked one that was the highest in the last several files that were on > the screen, without scrolling back.  No file system with compression > since compressing video files doesn't help much.  Just ext4 on encrypted > LVM on a single partition.  > > I tell you tho, this new drive is filling up pretty darn fast.  I got to > build a NAS or something here.  Thing is, how to put it somewhere it is > protected and all.  A NAS won't exactly fit in my fire safe.  :/  Bigger > fire safe maybe????  o_O  > > Dale > > :-)  :-)  > > Well, 2.5 days later, first backup done.  Then I had to restart to update the changes made in the past couple days that rsync didn't catch.  When that got done, I wanted to close the drive and unhook it but I'm getting that 'device in use' message.  Well, after some digging, I found that extlazyinit process running and if memory serves me, that is the process that creates the file system in the background.  I ran into that before.  I think it was copying the files as fast as it was able to create the file system to put it on.  I'll know next time I do backups.  If this thing ever lets me disconnect the drive.  Oh. Filesystem                       Size  Used Avail Use% Mounted on /dev/mapper/10tb           9.1T  7.5T  1.6T  83% /mnt/10tb I don't see that lasting to long.  :/  Yup, gotta come up with a plan.  Dale :-)  :-)