From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by finch.gentoo.org (Postfix) with ESMTPS id 8AB4E158095 for ; Thu, 25 Aug 2022 03:44:37 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 80AB4E08FE; Thu, 25 Aug 2022 03:44:18 +0000 (UTC) Received: from mail-qk1-x734.google.com (mail-qk1-x734.google.com [IPv6:2607:f8b0:4864:20::734]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id D32CEE076B for ; Thu, 25 Aug 2022 03:44:12 +0000 (UTC) Received: by mail-qk1-x734.google.com with SMTP id f14so14287621qkm.0 for ; Wed, 24 Aug 2022 20:44:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=content-transfer-encoding:in-reply-to:mime-version:user-agent:date :message-id:autocrypt:openpgp:from:references:to:subject:from:to:cc; bh=oGmLqzKi8eq/tgI58InTik715nRsaVOF5XX8j9q3zkA=; b=lIawbztDmnLGY204XEPPyXCtTg1u6fL3k26Fj/N9y+kwJaLnQjLkkDiUG3khooH2QJ YAutVmG64nGgTXy6EWBEDvK7dgG59fGbNymXKkYDi2JmlLugCqIojtVFMg/IfAcjMR73 wLsyR4q1bU2K2R9snL6NOgRFBnWxzJ5sV/ZPZp7e2p5gZCUlz6RSGXQ0HA+hquuaGOBr odGMTgZpUMKyZTPZwH9Smy8L3dmapz3U4tHtF0hkrfOD8VPwKxJYD9BuTOV3zZmJ8HkG DPzoEFzyOo1CKyFjdz2c2ou16GnCNSOzX9sV6KhJT5UsAshykUSjcMxIhJPz4Lw6ccO+ nkzw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=content-transfer-encoding:in-reply-to:mime-version:user-agent:date :message-id:autocrypt:openpgp:from:references:to:subject :x-gm-message-state:from:to:cc; bh=oGmLqzKi8eq/tgI58InTik715nRsaVOF5XX8j9q3zkA=; b=uaHFDUw9hJ2mooHmTl1NXd+A9WZaVdIFV8hpxT1HcnCR/ufa6XL/xxv2DcMMRjSPoU zNe2ouDGipWWEw2lkvYI8NK8tN1LEnBm9Y+EWvfiV2nyKmcwZsGHwjV+uHylqLP8WCe4 LVe6p78pAsl+i3wsayk676OYrb/bygejpxTNYARA4gZZ26sLTE8fPkh5K8OwGL9pJlvX OYBF1RmCcAjjHXFE5s5Dn9ZaOySLJUQHd9dy84A97AewJtcbgL7ANgAZXVQ9p7ohthE9 j5hx9azX8jYAXrydpg53mstRrHQq+DYVbBxo/tdaDpm916qox7TfBpjOZ4rck8h/N9uz KWpg== X-Gm-Message-State: ACgBeo3MkBr3UrAjriuXVJcJNCsAIVfrQt2frTp0pYpQAFkJvxoLVURT pjvl4XSPypfw+GFVCTz6w8xy5LC8d4U= X-Google-Smtp-Source: AA6agR585j5OAGC/2Tk+jAIySJclnUput5BbCksQCiLhEzzKbtqp3EQOUN6IYVTcCE9zmhUuTVv/gA== X-Received: by 2002:a05:620a:d83:b0:6bc:254f:3cae with SMTP id q3-20020a05620a0d8300b006bc254f3caemr1761550qkl.620.1661399052002; Wed, 24 Aug 2022 20:44:12 -0700 (PDT) Received: from [10.0.0.2] ([207.244.201.197]) by smtp.gmail.com with ESMTPSA id x26-20020a05620a0b5a00b006b5e1aeb777sm16315619qkg.43.2022.08.24.20.44.11 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Wed, 24 Aug 2022 20:44:11 -0700 (PDT) Subject: Re: [gentoo-user] Getting maximum space out of a hard drive To: gentoo-user@lists.gentoo.org References: From: Dale Openpgp: preference=signencrypt Autocrypt: addr=rdalek1967@gmail.com; prefer-encrypt=mutual; keydata= mQINBGFSciYBEADcEGMyJBSuavKO/XKUVvgkxck7Nl8Iuu8N2lcnRji/rSKg5c1Acix1ll9i oW8JBCHwvn0+Xy60BvEsqcup3YSHw5STl/bR1ePEehtnYrg8FdjdS91+B805RfnKMm69rFVI wLSBHQrSG1yxHd8CloWoEdhmVtP24buajbh114bgXd9ahtpZrCVMrWdWYUg2mEXguGV5uNAh Rf8SWxDNc79w24JxsV34a8niMUYMjzWr0rafIbzk732X38vGjVMLo/2mMpkbp9mPp++LHoY+ 0Pet8zxxdXPJSCd475kza1AD+hhSyBZXB9yknYWgyY3cZe1rGmooJSi2KX4QxO7npwLThcO1 be6KKRkd35+Fi/a1BzVOHsZMiK/gcwxEFoMd27gir4ehaeHJfFXl+65w4hj0EsOZSxrJrm2C R50g5By2czSKP1bADEygFNpIJj51AR+wM88NImG2RPtlT2maYBzazvF05g65cdHXGp1C7W5P wwwKU2DgABB2t7N7z5A69LnryBRw4zUYDRRYLTYlBlYgg+xILm2c0OrBdxJgLJa7JE50Eo25 d3PFwt9J0gYvqy6sPFLl9So0sDg9zm0hKQtXOP5kgropUFGrNoJI+mjwF4rYLRBVzZwNAvlO OhEvHubBo3mEllv4x+FeptwXZxlk7gUsdqI8AxnFB8K9wi6FVQARAQABtBtEYWxlIDxyZGFs ZWsxOTY3QGdtYWlsLmNvbT6JAk4EEwEIADgCGyMFCwkIBwIGFQoJCAsCBBYCAwECHgECF4AW IQQSG1h01ruv/WNXc3Q3RqOgiQH1GwUCYVJy8gAKCRA3RqOgiQH1G+waEACeTZCt77jnRAmQ AV7otKuZekDWiLi3Eig8tj5ZJiCNSYA/hIxzmexRP0GMqjitcXK1iGwWcvMzzvIq30GAjIfB 4BR38cnXbtBa6fNewiT7QaZe/Hn6yBRldXNQypzbHy+/o27bUEy+oX4rE7etUgEHQAjuw7xz XFWg4tH1/KJvsOVY5upnWc5LdxYhsuQ3dQD4b22GsK0pOBDfb9PiirYM8eGKvrVuq4E/c75z lDDFhINl18lNZ9D0ZFL3IkTjHsAAqFH9uhnnEB8CWdHbBewPEfRaOhBUYWZ3Q8uTkmDgZT8q D9jlvLEdw7Nh2ApdxoepnI/4D+ql2Gr4DtH7SEPydr5gcf1Qr/2bXRb1hAYnIVcbncs/Bm3Z bkRKPVWMfE3Fusa+p5hMzixk0YysMaTHlc7mYRYAEZGnPMXnmcCbetwARU7A0yz1M1kCMOAQ Lsz8KH5kv3cRenMB6SFfjND2JfAK61H5TtnPq3L8noS2ZykRYxq9Nm3X64O1tJojIKBoZFr8 AwYNCvqC6puUyGMuzHPh7jPof8glfrrEKIYUvNPGMDoVX3IGetxh/9l6NcxgFA4JGoR+LS3C zmeNrwlllAe3OEUfKoWVQ+pagpSdM+8hHolaSda4Ys66Z3fCR4ZvcTqfhTAVskpqdXa4isAk 7vTcXu3L499ttywEp7rJTbkCDQRhUnImARAAncUdVhmtRr59zqpTUppKroQYlzR0jv8oa7DG K4gakTAT2N7evnI9wpssmzyVk8VEiLzhnFQ/Ol3FRt6hZCXDJt0clyHOyTfvz/MNFttWuZTc mLpSvmRR6VRjAH+Tz3Eam2xUw3PGuH97BcXQ3NnX3msv1UDxtxxBu6e2YrdeOhrCUSgzokcJ 98ChUNy934cgepPybAI12lSWqVFQ1aG7jExZfiUk+333fPSDbpKoZbTW5YJLXbycmW/C1IWL qYQyNjRWKaGoJtUWFhhmNiOQct7n90aKivNVPavmN+UQ9LlMaINtf9T6XCzLfogCFsulDCDJ 0yNQLDTurHaB4E71xoctgXmLLq9z1RQ0W2XiVAAOZQj6K3+d0AOUjDhCQ2QW8dUSq0ckkZXV DKVJOGS8Nhf2eIWIqRnP3AcUiiaiFGqUaVUmUAZ6h/oJmgghEu/1S+pcuUKU5i69+XCZ3hH2 Jzwzbf7K+FAIkOhCfHncF8i1N1pk00pOVykNnqHTfFo3qFusHt0ZWgXVnnn4pYdXqZNoDhvF BRE5Vm4k/k96Pw8HRx6Os6eFSRrlqGzRgqsu86FekxusXB9UGv4lJhtU/J+8MRWsh22K718s DbQnABicGKFz1qQlWvcf59oTByhLINJCBt1WXl+TzJDXepr3QSkqmK41dO9Hob97C9dMiK8A EQEAAYkCNgQYAQgAIAIbDBYhBBIbWHTWu6/9Y1dzdDdGo6CJAfUbBQJhUnLyAAoJEDdGo6CJ AfUbVHIQAKSWw620vPhR3A/njU2z77F3z/Jk+HTKdE3fIyWSWdkYN7CBFL0NguOMP30WZ+qE sJhZu7T5hf251MwQUUt27xlfnKYOmQs7CqONlXuXlGZI6WufrUjxNcVz+5gJsqvUWuuJWsgg sDmE92IBnfG/f81fPHWQyfr/SF4wYDMyoFp5xCCQpp1zB63iuFvvrhxBkEHzmbRtVDOhl0Xp BVEDR1w3QRACw9QJD/KM05Czv9JNQYlwinWO/OaQ9cMlUpKLgswUPg9IZ5vucxScfuAUA5uC B1jlAQ8ZPlVukBmbEv5RGOv+lpuEbA3YDMVtEeH4YMFbjt/+vH3Cr2vTbp5JlpByLburJEH0 WXZLUawEfUsZvVwpOuJK75vaa2HYXee+Cb3iCIzwfIfctdlqzUcbGRczlRNM59hpvj4z29Gh 3kAxVHItAYq54ikxQ9l4hQ8s9sLYPbX/WtcBxNX8crBSw0FLnmzGleVEtBHyqtt5CLzQNgrj GYWl1vKDUmRPw1CdZ1c+fMN9CY11jOM5B5ZnqZWfDeVYO2iJ5SuvTycChexCb8WYn1bdCBIo bBtga2RBXbVt4Mh9E4owsszefn51MwfjXxB20Fc5k3GU1AVpTCMs3ayYCzo0b2pvEvdjtDcA CYLEFPWgaFX9iQAM/CDfKvTtvgGWpqtCL2raq/mQoJEU Message-ID: <3096074b-e278-cafd-37d8-ecc645a594c2@gmail.com> Date: Wed, 24 Aug 2022 22:44:10 -0500 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Firefox/68.0 SeaMonkey/2.53.13 Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-user@lists.gentoo.org Reply-to: gentoo-user@lists.gentoo.org X-Auto-Response-Suppress: DR, RN, NRN, OOF, AutoReply MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-Archives-Salt: d4581213-8b04-4f1d-b5a4-16aab956146c X-Archives-Hash: c5fb54d3254c3f667ccb819313ef11e8 Rich Freeman wrote: > On Sat, Aug 20, 2022 at 3:15 PM Dale wrote: >> Related question. Does encryption slow the read/write speeds of a drive >> down a fair amount? This new 10TB drive is maxing out at about >> 49.51MB/s or so. > Encryption won't impact the write speeds themselves of course, but it > could introduce a CPU bottleneck. If you don't have any cores pegged > at 100% though I'd say this isn't happening. On x86 encrypting a hard > drive shouldn't be a problem. I have seen it become a bottleneck on > something like a Pi4 if the encryption isn't directly supported in > hardware by the CPU. > > 50MB/s is reasonable if you have an IOPS-limited workload. It is of > course a bit low for something that is bandwidth-limited. If you want > to test that I'm not sure rsync is a great way to go. I'd pause that > (ctrl-z is fine), then verify that all disk IO goes to zero (might > take 30s to clear out the cache). Then I'd use "time dd bs=1M > count=20000 if=/dev/zero of=/path/to/drive/test" to measure how long > it takes to create a 20GB file. Oh, this assumes you're not using a > filesystem that can detect all-zeros and compress or make the file > sparse. If you get crazy-fast results then I'd do a test like copying > a single large file with cp and timing that. > > Make sure your disk has no IO before testing. If you have two > processes accessing at once then you're going to get a huge drop in > performance on a spinning disk. That includes one writing process and > one reading one, unless the reads all hit the cache. > Kinda picking random reply.  I finally got the full backups done and have updated a couple times, new drive and old drives.  Someone mentioned atop and I gave it a try.  I noticed the drive parts that is either being read from or written to show up in red and a high amount of use.  After doing some google searching, red means really, really busy.  Makes sense.  So, the drives are apparently just maxing out.  I also noticed something else.  Given that my internet is so much faster now, that also puts a load on disk I/O.  Heck, the internet alone can almost max out the drive I/O.  On top of that I'm watching a video on my TV.  So, doing backups, watching TV and downloading stuff over a really fast internet connection, no wonder things were a little slow.  I also ran this on the new 10TB drive and a older SMR 8TB drive.  This is about normal, ish.  sdl is the 8TB and sdm is the 10TB.  root@fireball / # hdparm -tT /dev/sdl /dev/sdl:  Timing cached reads:   8814 MB in  2.00 seconds = 4410.88 MB/sec  Timing buffered disk reads: 558 MB in  3.00 seconds = 185.76 MB/sec root@fireball / # hdparm -tT /dev/sdm /dev/sdm:  Timing cached reads:   8992 MB in  2.00 seconds = 4499.72 MB/sec  Timing buffered disk reads: 612 MB in  3.01 seconds = 203.47 MB/sec root@fireball / # I have some other drives that are slower and a couple that are faster.  So, I guess it about averages out.  I have another question.  I notice that the drive activity light stays on a lot more, downloading/uploading faster etc etc.  Will that cause my drives to age faster or is that designed in?  I try to get the higher grade of drives, avoid those built for light duty stuff.  Of course, they not designed to be used by NASA either.  :/ By the way, that new backup drive, filling up fast.  My storage partition is too.  This fast internet is causing, issues.  ROFL  Time to hunt up a deal on another 8TB or 10TB drive to add on.  Dang, my case is about full.  I really need a NAS or something.  :-D Dale :-)  :-)