From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by finch.gentoo.org (Postfix) with ESMTPS id 0F593158003 for ; Sun, 18 Dec 2022 18:59:24 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 2D78AE0951; Sun, 18 Dec 2022 18:59:20 +0000 (UTC) Received: from mail-qt1-x82e.google.com (mail-qt1-x82e.google.com [IPv6:2607:f8b0:4864:20::82e]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id D00A9E092A for ; Sun, 18 Dec 2022 18:59:19 +0000 (UTC) Received: by mail-qt1-x82e.google.com with SMTP id jr11so6769568qtb.7 for ; Sun, 18 Dec 2022 10:59:19 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=content-transfer-encoding:in-reply-to:mime-version:user-agent:date :message-id:autocrypt:openpgp:from:references:to:subject:from:to:cc :subject:date:message-id:reply-to; bh=fQmA4JhM95QGQ8mnHgUdCKE1dFsoMU2ubPFXw1cgKJE=; b=Bmqh94wpEkJD+YTV62O2E2rnPxzyqsDPX+N0bU9qnni2MmW4zQ9WYBZvevjWeltbDz 0ntxRRzf1asvRjW6B4HODj/nIuWphjddBNvMCM1h4KC6m+OWr3Ld0MIGWMaFMtLW8Mjp I3i2HFROk4p/5C2F1wtum2PO3SE6fatgFDMTNQcCKhphtnvoP2Fm0nVlGCUHEkhYA1DA xDTDSawIijkDsCsEQTE/6en51ufpPV8K0pByoqn51PSaAU+UwM/swxOvVeJeKGBOWMKy Z/nCbhdb+3lHk+DDfB7YbUmrCATURRDMhWmXhrGtJoOQasURBDmoZ0doum1VNZE8oTz/ QF4Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=content-transfer-encoding:in-reply-to:mime-version:user-agent:date :message-id:autocrypt:openpgp:from:references:to:subject :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=fQmA4JhM95QGQ8mnHgUdCKE1dFsoMU2ubPFXw1cgKJE=; b=Ea9AM3TqoNrE3ncUwlc5+MCGQOw8GHvCDys9zqLml/aGTVgQBeUR2xEO4UoN5AFMDf HFHrtMzh+Q8R0sK40V/vU7eqHx1aYjQROhItP+Do9Pe52V4VL9FlGsUfQJHCQNdHi2Iv GX1w58i2MJPF1kqRpnsr7jQATMN65UzX+d0xPNe39vvdD5kz0kE/+2x6V/k5uIdgkcIc XVdZwB3IcoCAAzf2AaSB60D+zQwUSU/r5QYO/Teu6oc9mSULB/ZTAkqAu/RTCPKDtH00 pk4dgSJnZ9YeASsGejXbnEnQgCBdj8PAke9FumTijziDxyuCZa/HD3peqDc+skkvYvtN 99RA== X-Gm-Message-State: ANoB5pnLMP/8mJUWpFDCLuLImamNnBDYX+CQ2m+j41lNj+g2JnZI6ktt eXlCik62fXXInNUraRYf83AGWRkC4QI= X-Google-Smtp-Source: AA0mqf5ODZPWg0ZkrAskJ6qJH+Te3188ST2z9RkpC1w1yTlc1tpYYkn5AisGB3i4dB7xClkh+Cb9ZQ== X-Received: by 2002:ac8:765a:0:b0:3a7:e0ba:7c23 with SMTP id i26-20020ac8765a000000b003a7e0ba7c23mr51583153qtr.60.1671389959065; Sun, 18 Dec 2022 10:59:19 -0800 (PST) Received: from [10.8.8.2] ([107.179.20.156]) by smtp.gmail.com with ESMTPSA id do25-20020a05620a2b1900b006ff8c632259sm5629534qkb.42.2022.12.18.10.59.18 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sun, 18 Dec 2022 10:59:18 -0800 (PST) Subject: Re: [gentoo-user] NAS and replacing with larger drives To: gentoo-user@lists.gentoo.org References: <0a10c428-94f1-6112-4d88-c97143f9564d@gmail.com> <7a8384d4-4213-b2df-df28-2b56a8b2d030@youngman.org.uk> From: Dale Openpgp: preference=signencrypt Autocrypt: addr=rdalek1967@gmail.com; prefer-encrypt=mutual; keydata= mQINBGFSciYBEADcEGMyJBSuavKO/XKUVvgkxck7Nl8Iuu8N2lcnRji/rSKg5c1Acix1ll9i oW8JBCHwvn0+Xy60BvEsqcup3YSHw5STl/bR1ePEehtnYrg8FdjdS91+B805RfnKMm69rFVI wLSBHQrSG1yxHd8CloWoEdhmVtP24buajbh114bgXd9ahtpZrCVMrWdWYUg2mEXguGV5uNAh Rf8SWxDNc79w24JxsV34a8niMUYMjzWr0rafIbzk732X38vGjVMLo/2mMpkbp9mPp++LHoY+ 0Pet8zxxdXPJSCd475kza1AD+hhSyBZXB9yknYWgyY3cZe1rGmooJSi2KX4QxO7npwLThcO1 be6KKRkd35+Fi/a1BzVOHsZMiK/gcwxEFoMd27gir4ehaeHJfFXl+65w4hj0EsOZSxrJrm2C R50g5By2czSKP1bADEygFNpIJj51AR+wM88NImG2RPtlT2maYBzazvF05g65cdHXGp1C7W5P wwwKU2DgABB2t7N7z5A69LnryBRw4zUYDRRYLTYlBlYgg+xILm2c0OrBdxJgLJa7JE50Eo25 d3PFwt9J0gYvqy6sPFLl9So0sDg9zm0hKQtXOP5kgropUFGrNoJI+mjwF4rYLRBVzZwNAvlO OhEvHubBo3mEllv4x+FeptwXZxlk7gUsdqI8AxnFB8K9wi6FVQARAQABtBtEYWxlIDxyZGFs ZWsxOTY3QGdtYWlsLmNvbT6JAk4EEwEIADgCGyMFCwkIBwIGFQoJCAsCBBYCAwECHgECF4AW IQQSG1h01ruv/WNXc3Q3RqOgiQH1GwUCYVJy8gAKCRA3RqOgiQH1G+waEACeTZCt77jnRAmQ AV7otKuZekDWiLi3Eig8tj5ZJiCNSYA/hIxzmexRP0GMqjitcXK1iGwWcvMzzvIq30GAjIfB 4BR38cnXbtBa6fNewiT7QaZe/Hn6yBRldXNQypzbHy+/o27bUEy+oX4rE7etUgEHQAjuw7xz XFWg4tH1/KJvsOVY5upnWc5LdxYhsuQ3dQD4b22GsK0pOBDfb9PiirYM8eGKvrVuq4E/c75z lDDFhINl18lNZ9D0ZFL3IkTjHsAAqFH9uhnnEB8CWdHbBewPEfRaOhBUYWZ3Q8uTkmDgZT8q D9jlvLEdw7Nh2ApdxoepnI/4D+ql2Gr4DtH7SEPydr5gcf1Qr/2bXRb1hAYnIVcbncs/Bm3Z bkRKPVWMfE3Fusa+p5hMzixk0YysMaTHlc7mYRYAEZGnPMXnmcCbetwARU7A0yz1M1kCMOAQ Lsz8KH5kv3cRenMB6SFfjND2JfAK61H5TtnPq3L8noS2ZykRYxq9Nm3X64O1tJojIKBoZFr8 AwYNCvqC6puUyGMuzHPh7jPof8glfrrEKIYUvNPGMDoVX3IGetxh/9l6NcxgFA4JGoR+LS3C zmeNrwlllAe3OEUfKoWVQ+pagpSdM+8hHolaSda4Ys66Z3fCR4ZvcTqfhTAVskpqdXa4isAk 7vTcXu3L499ttywEp7rJTbkCDQRhUnImARAAncUdVhmtRr59zqpTUppKroQYlzR0jv8oa7DG K4gakTAT2N7evnI9wpssmzyVk8VEiLzhnFQ/Ol3FRt6hZCXDJt0clyHOyTfvz/MNFttWuZTc mLpSvmRR6VRjAH+Tz3Eam2xUw3PGuH97BcXQ3NnX3msv1UDxtxxBu6e2YrdeOhrCUSgzokcJ 98ChUNy934cgepPybAI12lSWqVFQ1aG7jExZfiUk+333fPSDbpKoZbTW5YJLXbycmW/C1IWL qYQyNjRWKaGoJtUWFhhmNiOQct7n90aKivNVPavmN+UQ9LlMaINtf9T6XCzLfogCFsulDCDJ 0yNQLDTurHaB4E71xoctgXmLLq9z1RQ0W2XiVAAOZQj6K3+d0AOUjDhCQ2QW8dUSq0ckkZXV DKVJOGS8Nhf2eIWIqRnP3AcUiiaiFGqUaVUmUAZ6h/oJmgghEu/1S+pcuUKU5i69+XCZ3hH2 Jzwzbf7K+FAIkOhCfHncF8i1N1pk00pOVykNnqHTfFo3qFusHt0ZWgXVnnn4pYdXqZNoDhvF BRE5Vm4k/k96Pw8HRx6Os6eFSRrlqGzRgqsu86FekxusXB9UGv4lJhtU/J+8MRWsh22K718s DbQnABicGKFz1qQlWvcf59oTByhLINJCBt1WXl+TzJDXepr3QSkqmK41dO9Hob97C9dMiK8A EQEAAYkCNgQYAQgAIAIbDBYhBBIbWHTWu6/9Y1dzdDdGo6CJAfUbBQJhUnLyAAoJEDdGo6CJ AfUbVHIQAKSWw620vPhR3A/njU2z77F3z/Jk+HTKdE3fIyWSWdkYN7CBFL0NguOMP30WZ+qE sJhZu7T5hf251MwQUUt27xlfnKYOmQs7CqONlXuXlGZI6WufrUjxNcVz+5gJsqvUWuuJWsgg sDmE92IBnfG/f81fPHWQyfr/SF4wYDMyoFp5xCCQpp1zB63iuFvvrhxBkEHzmbRtVDOhl0Xp BVEDR1w3QRACw9QJD/KM05Czv9JNQYlwinWO/OaQ9cMlUpKLgswUPg9IZ5vucxScfuAUA5uC B1jlAQ8ZPlVukBmbEv5RGOv+lpuEbA3YDMVtEeH4YMFbjt/+vH3Cr2vTbp5JlpByLburJEH0 WXZLUawEfUsZvVwpOuJK75vaa2HYXee+Cb3iCIzwfIfctdlqzUcbGRczlRNM59hpvj4z29Gh 3kAxVHItAYq54ikxQ9l4hQ8s9sLYPbX/WtcBxNX8crBSw0FLnmzGleVEtBHyqtt5CLzQNgrj GYWl1vKDUmRPw1CdZ1c+fMN9CY11jOM5B5ZnqZWfDeVYO2iJ5SuvTycChexCb8WYn1bdCBIo bBtga2RBXbVt4Mh9E4owsszefn51MwfjXxB20Fc5k3GU1AVpTCMs3ayYCzo0b2pvEvdjtDcA CYLEFPWgaFX9iQAM/CDfKvTtvgGWpqtCL2raq/mQoJEU Message-ID: <8d058bd7-6c91-aa1a-6e2f-133cf0642f81@gmail.com> Date: Sun, 18 Dec 2022 12:59:17 -0600 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Firefox/68.0 SeaMonkey/2.53.14 Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-user@lists.gentoo.org Reply-to: gentoo-user@lists.gentoo.org X-Auto-Response-Suppress: DR, RN, NRN, OOF, AutoReply MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-Archives-Salt: aca8dc2a-d146-4f05-820c-5fc01b9f37b6 X-Archives-Hash: 0751f8a6122e82a070acbcf0f46dd01f Frank Steinmetzger wrote: > Am Sun, Dec 18, 2022 at 09:12:37AM -0600 schrieb Dale: > >>> On Sat, Dec 17, 2022 at 4:42 PM Dale >> > wrote: >>> >>>> My reasoning is simple, I'm already familiar with LVM and how to >>> manage it.   >>> >>> […] >>> Wipe the machine. You'll be happier. >>> >>> Best wishes, >>> Mark >> Well, I finally got it so I could do a backup.  I didn't need a hammer >> but the thought crossed my mind.  lol  Even tho I now have a 1GB network >> card, it's still really slow.  It shows up as a 1GB connection on both >> my Gentoo machine and the NAS machine.  This is a example of the speeds >> I'm seeing.  Just snippets.  >> >> >> 277,193,507 100%   16.18MB/s    0:00:16 >> 519,216,571 100%   18.86MB/s    0:00:26 >> 738,078,565 100%   23.54MB/s    0:00:29 >> >> >> As you can see, the files sizes are large enough it should do better.  > Gbit nets at around 116..117 MB/s. > >> When I use iftop, it shows it isn't doing anywhere near the speed it >> should, maybe 1/4th or so.  I'd expect at least double or triple that >> speed.  In all honesty, I'd think the hard drive would be the limiting >> factor.  Even on my Gentoo rig I only get about 50 to 60MBs/sec for >> encrypted drives.  I think the encryption slows that down.  When copying >> from a plain drive to a plain drive, I get 100MBs/sec or so.  >> >> I can't figure out why it is so slow tho.  The NAS rig is a 4 core CPU >> and 8GBs of memory. > OK, so you already noticed that encryption slows you down. This won’t happen > with a CPU that has AES instructions (well, and if the encryption you chose > actually uses AES, and not something else like Blowfish). So I guess your > CPU is too old, given your earlier descriptions. > > When I built my NAS in November 2016, I installed a Celeron G1840 at first. > A very affordable (33 €) and frugal CPU (2 cores, 53 W, which were never > actually drawn). I knew it didn’t have AES back then (Intel removed that > limit from Celerons in architectures after Haswell), but from experiments I > knew it would achieve around 150..160 MB/s with LUKS, which was enough for > Gbit ethernet. But not for scrubs, when all HDDs were worked in parallel. So > after a year I did an upgrade after all and bought the smallest and cheapest > CPU that had AES, an i3-41xx. > >> It should have enough horsepower under the hood.  >> Maybe it is something I'm not aware of.  It is a older rig so maybe it >> isn't SATA's fastest version, maybe even the original or something.  I > SATA 2 is 3 Gbit/s, so still not saturated by a single HDD. This could be a SATA 1.  I don't recall the speed of that.  Thing is, when I go to a console and use htop, it shows the CPU is maxed out most of the time.  It kinda gets busy for a good bit, idle for a short time then back to close to 100%.  It has plenty of memory even tho it is caching a lot in memory.  It shows less than 1GB actually used by the system itself, not including cache tho.  With that info, I suspect the CPU is the bottleneck.  It's the only thing that is showing heavy usage.  This may have nothing to do with SATA.  I suspect it is the encryption that really hits the CPU hard.  Also, the CPU temp is good too.  I replaced the stock cooler with a larger model.  I think it is running around 100F or so. I don't think temps are a issue.  > > Network transfers are single-core work. If it is really such an old machine, > I guess the CPU is the bottleneck again. Do you transfer via ssh? If so, use > something else that doesn’t encrypt the transport stream. When I am bound by > CPU in such cases (like with my ancient netbook with an Atom N450), and I > don’t want to set up a file server (that is nowhere near as flexible as ssh > anyways), I use netcat: > > On the receiving end, start a netcat listener and extract from it: > nc -l -p $Portnumber | tar xf - > The portnumber must be any number above 1024, if you’re not root. > > And on the sender, pack all your stuff into a tar (uncompressed!, since > videos aren’t compressible further and it will bog down the CPU again) and > pipe it to the receiver: > tar cf - * | nc $Destination_IP $Portnumber > > Once the client is done, press Ctrl+C on the receiver. > > Or maybe use rsync with the rsync-protocol instead of ssh. That’ll be more > flexible, because the tar-and-nc method doesn’t know about existing files on > the receiving end. (But I’ve never tested that approach.) > Since this is local, I just use rsync to do my backups.  I did have to change the options a bit.  It seems TrueNAS doesn't like some of the permissions or something.  Anyway, I found a way that works.  As I mentioned above, I think this is a CPU issue.  It does show that I need to see how encryption will work with the CPU on a Raspberry Pi tho.  Maybe the newer ones will have the needed support and not cause problems.  While at it, the dashboard CPU info doesn't really show the CPU maxing out as well as htop does.  If someone thinks their TrueNAS box is slow, may want to use htop or similar tools to check things. The memory is pretty accurate tho.  Thing about htop, it shows how busy each core is and that is usually most helpful.  Some processes only use one core, even tho some have left the single core CPUs behind long ago.  lol  This is gonna take a while.  :/ Dale :-)  :-)