From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by finch.gentoo.org (Postfix) with ESMTPS id 94408158020 for ; Sun, 18 Dec 2022 15:29:56 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 92652E0893; Sun, 18 Dec 2022 15:29:52 +0000 (UTC) Received: from mout.gmx.net (mout.gmx.net [212.227.17.22]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id EA083E086E for ; Sun, 18 Dec 2022 15:29:51 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.de; s=s31663417; t=1671377385; bh=uxiTuMzSzRaOcCwJWMIMQ30pDbzV0pN1vaeY8yNUJZs=; h=X-UI-Sender-Class:Date:From:To:Subject:References:In-Reply-To; b=PygIegfiQrvBfPNIuaS/9yLBXJzmOm0ZzUFVOIkaxzuVpEc5829RCWgiAatWd0/M+ eLv0PSVN6HsXFwoL/d3FQFNDgCcb1cLgF8HBfsZGez+JlZbGfi80ld0kMxLk0Zqn3b dn3rZ4IitJV75eG42UzohQwIK2DJLPNIzpjo6lTauKa29AHLO3D8P3ytK4pjT17G8r 8MWM35apfOWxENjc24LpU7OMnGzj2GZUmiuxSduNYVFc45Xp/IR+dON0uFXx0TVmbf JUB+mO0TTAQdI/8JBazTX3Opzi1xzt93VGlXUaq/J1hG0I1U+dERg6FdQx2FyPHvbK Y8vfCPwyel9Ew== X-UI-Sender-Class: 724b4f7f-cbec-4199-ad4e-598c01a50d3a Received: from kern ([92.117.54.81]) by mail.gmx.net (mrgmx104 [212.227.17.168]) with ESMTPSA (Nemesis) id 1MtfNf-1olQLW0I2B-00v6fJ for ; Sun, 18 Dec 2022 16:29:45 +0100 Date: Sun, 18 Dec 2022 16:29:43 +0100 From: Frank Steinmetzger To: gentoo-user@lists.gentoo.org Subject: Re: [gentoo-user] NAS and replacing with larger drives Message-ID: Mail-Followup-To: gentoo-user@lists.gentoo.org References: <0a10c428-94f1-6112-4d88-c97143f9564d@gmail.com> <7a8384d4-4213-b2df-df28-2b56a8b2d030@youngman.org.uk> Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-user@lists.gentoo.org Reply-to: gentoo-user@lists.gentoo.org X-Auto-Response-Suppress: DR, RN, NRN, OOF, AutoReply MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="FP1ZWU66QMi28Zfl" Content-Disposition: inline In-Reply-To: User-Agent: Mutt 2.2.9; VIM - Vi IMproved 9.0 X-Provags-ID: V03:K1:k6DmJtfaEoco9WLaYs6QdCt96iJGmlm22jAwTCguOWoB8EdJPVR 81l9BiPxKF3QPR/P7xkFYPrgNDMK2WxqPn4dUFV3yl7DjZjR2chHg5j+jpM6gFK1s2FxJUi ZpjZ4BU4PUGZDh2AKN8DBZ7dod20/2QIpwisSD6soXxbW4+ApVkiT7EKdQURdD7yL5mBo7a lLJJGqs02MSSUalvGYIRw== X-Spam-Flag: NO UI-OutboundReport: notjunk:1;M01:P0:G+4iegUyhJI=;TedZzij+5S5Ee8xalamV7Ymz3al XETwkVx40LcanNQbuNYhkdUrILz8uSmlP7KalxUZ6pYJQIQ8AUeOjUhWjV6i5fnGcCL/i89Ur PsuoMRoONJAPqEKKr63zjY6Xq9d5Lea3eYVkl4wZi7AxRFDOkOvmmSq+cPLkSxVvM04tNxpaT tXpMuwsv0Tt2FRxiShIkPOj5dzszSLimDVDONiKetrrP6RItVQkgUT750iJKaT0V99hadxb5u 5qVVosDHL0yS3HRIaRIX9cq5mxXkLAzLLnDP1hWzi5VwLRvJbVMJ5xMb4C8mIud1h3MIToplU F17++eo6bwg30BuX1HAguRGrf/m/kj49lpPtWj+eeuh/qFsNDmXTSs2oiXlMXd9mRXZXf1+Vz XXSDpC/mR3TJa136rcsxKgDzBNrJxErL0SEknY5+BPI7QHNHmpaRCCnsMBZ+rzclkCfdkFvBX bKJ65kuHwhll5U6xjzIldTkyFgC1P7LYuxQElqMbTp6qiwhVRi6nDQNTdw09vA7FBi7myBr37 OzgFa1Cc3TUER1HFMu0UT7pLndmFO5Bq0BfQdUhytYxlOc808J44qn8J22X5CaVowfY4m4prB bvMtxl57HIWsSzaAAyr/SjZholJls/pidPf2YFWnZwOSFWPvEC658Hb+rHs6G/1NYWOaDEPnU t3hlZSgBygs0loMjfQUdc3bCAg/GJGLNdp9N1t9U4MdwtYxnuAP/vUbHdzxQAileLP0oCkuEO v77sMzHW0vcXbZLnccU/etscjSfwqzdjvFLUInBMiz/tv2eQVTGMge+3PYzBudys4IIWMp/Ku AtUwM43DGQokkmuguCyrnc4beilMTLc6Hu6PGRBTB6I4mlXosn3O6m1xPDqODbUL/qrMomIE7 +b8z1N/bST1hvSp9u20iZiD0Yngrv6QHumBYcU/jEH9s+fy1+KTqfYagF2P8knhwKeiWQ4AYw k1PMWg== X-Archives-Salt: 04af0dea-0c92-4d7f-ba24-164ad3a62949 X-Archives-Hash: 0f5a000c32f870e0b3baf76576728ea2 --FP1ZWU66QMi28Zfl Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Am Sun, Dec 18, 2022 at 09:12:37AM -0600 schrieb Dale: > > On Sat, Dec 17, 2022 at 4:42 PM Dale > > wrote: > > > > > > > > My reasoning is simple, I'm already familiar with LVM and how to > > manage it. =C2=A0 > > > > [=E2=80=A6] > > Wipe the machine. You'll be happier. > > > > Best wishes, > > Mark > > Well, I finally got it so I could do a backup.=C2=A0 I didn't need a hamm= er > but the thought crossed my mind.=C2=A0 lol=C2=A0 Even tho I now have a 1G= B network > card, it's still really slow.=C2=A0 It shows up as a 1GB connection on bo= th > my Gentoo machine and the NAS machine.=C2=A0 This is a example of the spe= eds > I'm seeing.=C2=A0 Just snippets.=C2=A0 >=20 >=20 > 277,193,507 100%=C2=A0=C2=A0 16.18MB/s=C2=A0=C2=A0=C2=A0 0:00:16 > 519,216,571 100%=C2=A0=C2=A0 18.86MB/s=C2=A0=C2=A0=C2=A0 0:00:26 > 738,078,565 100%=C2=A0=C2=A0 23.54MB/s=C2=A0=C2=A0=C2=A0 0:00:29 >=20 >=20 > As you can see, the files sizes are large enough it should do better.=C2= =A0 Gbit nets at around 116..117 MB/s. > When I use iftop, it shows it isn't doing anywhere near the speed it > should, maybe 1/4th or so.=C2=A0 I'd expect at least double or triple that > speed.=C2=A0 In all honesty, I'd think the hard drive would be the limiti= ng > factor.=C2=A0 Even on my Gentoo rig I only get about 50 to 60MBs/sec for > encrypted drives.=C2=A0 I think the encryption slows that down.=C2=A0 Whe= n copying > from a plain drive to a plain drive, I get 100MBs/sec or so.=C2=A0 > > I can't figure out why it is so slow tho.=C2=A0 The NAS rig is a 4 core C= PU > and 8GBs of memory. OK, so you already noticed that encryption slows you down. This won=E2=80= =99t happen with a CPU that has AES instructions (well, and if the encryption you chose actually uses AES, and not something else like Blowfish). So I guess your CPU is too old, given your earlier descriptions. When I built my NAS in November 2016, I installed a Celeron G1840 at first. A very affordable (33 =E2=82=AC) and frugal CPU (2 cores, 53 W, which were = never actually drawn). I knew it didn=E2=80=99t have AES back then (Intel removed= that limit from Celerons in architectures after Haswell), but from experiments I knew it would achieve around 150..160 MB/s with LUKS, which was enough for Gbit ethernet. But not for scrubs, when all HDDs were worked in parallel. So after a year I did an upgrade after all and bought the smallest and cheapest CPU that had AES, an i3-41xx. > It should have enough horsepower under the hood.=C2=A0 > Maybe it is something I'm not aware of.=C2=A0 It is a older rig so maybe = it > isn't SATA's fastest version, maybe even the original or something.=C2=A0= I SATA 2 is 3 Gbit/s, so still not saturated by a single HDD. Network transfers are single-core work. If it is really such an old machine, I guess the CPU is the bottleneck again. Do you transfer via ssh? If so, use something else that doesn=E2=80=99t encrypt the transport stream. When I am= bound by CPU in such cases (like with my ancient netbook with an Atom N450), and I don=E2=80=99t want to set up a file server (that is nowhere near as flexibl= e as ssh anyways), I use netcat: On the receiving end, start a netcat listener and extract from it: nc -l -p $Portnumber | tar xf - The portnumber must be any number above 1024, if you=E2=80=99re not root. And on the sender, pack all your stuff into a tar (uncompressed!, since videos aren=E2=80=99t compressible further and it will bog down the CPU aga= in) and pipe it to the receiver: tar cf - * | nc $Destination_IP $Portnumber Once the client is done, press Ctrl+C on the receiver. Or maybe use rsync with the rsync-protocol instead of ssh. That=E2=80=99ll = be more flexible, because the tar-and-nc method doesn=E2=80=99t know about existing= files on the receiving end. (But I=E2=80=99ve never tested that approach.) --=20 Gr=C3=BC=C3=9Fe | Greetings | Salut | Qapla=E2=80=99 Please do not share anything from, with or about me on any social network. You sould borrow money only from pessimists, because they don=E2=80=99t exp= ect it back. --FP1ZWU66QMi28Zfl Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCgAdFiEEVbE9o2D2lE5fhoVsizG+tUDUMMoFAmOfMeUACgkQizG+tUDU MMofLQ/6A/n8Ae8F+4+UEstoVGW6AMFHv7/Qesl9TL6gYRNFed6kXELDt44VdqLY hkePySLI2Byl53N2OCUCzzKcx6SmMME35z2Bdnkfan2SMuDjRZXvpvpJCxdOn6ob qBN0Jww5QumPvVBXTxWSz6qM5sqI9M9y+aOwrW8Mr6SeWLtjepS61B3VweuHYEb9 lYExR+TiCRQ/k8u8++GLUN+bZvj7kEK8Z/6nBdJAyjzeJ/TWOguDN+VXXrPd0YHO ZnVwG0nsZcGLsH3jin7VINCxUBCJEnL/zroWYoeBKveqgHy5o18nIlPvW/ro70A2 rI1KbmyPHG5IeK8E43w80vHjDhOulSw1QbFRtZhhMZPa8uK71z2wL916CtD6fe0R 5c5nHaLxu1LLTiCw80rez6h1LJ7P1b0sqInxQELHH2PNzdyCtF94L4AL2vIp2dZH mtIz9Z5UBDO74ZnAlv6Ph58D/AiMUSFIEF82fLJkjphdBx9pV55D7JXffiJNwoUM QWv8FBlljoTrCJIaFO1iehkELi6Kh91zfKBEXLBCFbTCBAjA8DkkJaMakeeNgodw NMTz6BOK0e8+tLU8QRFNRiiUICn0rHwKQqaxOjcix84VCQNRgVweisRbUWKm02Lo Dw1Q84kV5bStkYIH5ZY4KhtfhlUq1np2j2+Ze+lNc+nBdtTr7nU= =HXbM -----END PGP SIGNATURE----- --FP1ZWU66QMi28Zfl--