From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by finch.gentoo.org (Postfix) with ESMTPS id 4C72A158020 for ; Sun, 18 Dec 2022 15:39:13 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 74AA9E08EC; Sun, 18 Dec 2022 15:39:08 +0000 (UTC) Received: from mail-lj1-x229.google.com (mail-lj1-x229.google.com [IPv6:2a00:1450:4864:20::229]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id 10E15E087E for ; Sun, 18 Dec 2022 15:39:07 +0000 (UTC) Received: by mail-lj1-x229.google.com with SMTP id b9so6863125ljr.5 for ; Sun, 18 Dec 2022 07:39:07 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=to:subject:message-id:date:from:in-reply-to:references:mime-version :from:to:cc:subject:date:message-id:reply-to; bh=x54iHX9AiXEXZJCnQozRQHUatRfs1cDDNoR3jjV32pw=; b=Si/+ezi8KGUPDusVApJOkZnHMelgElM+0E1nYryepYzLudmO/EELILnl6DY2ezbnMP Om3mMNgMmgR/5XKABipKOpc8RPYWox0yEX47YtDF501V8oERAlt8pok67PBmhgjbOhz8 J1RSv0HDcr9Lrary0TFC4waxDFLZ1FPavhoT1PtkEZ4YuJXGq5m8deymaDyDmy6BIr26 j8SQhJ84GevSA2BglnQi+bcZY5AyTgQaWYhbhua4e3EQx4TyDHGVugNtzOTW2csUxjJ+ cVgY6g1nqD7+x35pRrAciehFaEOnxgBP3P6lzBql3DsT+aIAmqlUwxAr4S9e0UPZIXUS bSwA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=to:subject:message-id:date:from:in-reply-to:references:mime-version :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=x54iHX9AiXEXZJCnQozRQHUatRfs1cDDNoR3jjV32pw=; b=uKPgEvDXFIz0xJvM/qG1ap3p9rfHspmwak/wkqn4FHN7yB53QKqVQC8+TV/1fv6azS L7UHu6jkfPVg6Lzj2+D7Wi6xD87aGVW7trEOzL2YRVmuagLlE/Jz/9NwYbnbZl7o22aE pOA9/bx3VOTWzlx5ZDwnIBYtHdj/6iZl3qnSBQNWORvuedRsaJBGtAdNbCS/DLSMU67d cr+6ISXsZwXYmAzirrCu/cs96dtzAFhNUF/hslv2Uazrkj3PbPiVmFVHF0rGxO105lx6 BO6Vn/dLInU3+IKRl4ZR17yvKeT0FYkhS4KgWg8R2oaKz5acpLaSVtYZ/+nYDA/MVFlj B47Q== X-Gm-Message-State: ANoB5plhvhzytrrMyQy6n92OXyv6mvxPIaRWPGAPxoI8Da3aH0nqOMjQ KJz3xxuOya0WKUf3nlQlX0NI1OqN2eoe6rIhwYXXM2tKnIU= X-Google-Smtp-Source: AA0mqf7e8yNmnwhKkuCbU6qGlzxDPvTYfId2Xe7gbcz53M2L8EZ9Bscd4WybQU+nL8y9csp6QERjvIuKXUJd7v9TGMY= X-Received: by 2002:a2e:a80a:0:b0:277:2600:9cc0 with SMTP id l10-20020a2ea80a000000b0027726009cc0mr31808653ljq.437.1671377946047; Sun, 18 Dec 2022 07:39:06 -0800 (PST) Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-user@lists.gentoo.org Reply-to: gentoo-user@lists.gentoo.org X-Auto-Response-Suppress: DR, RN, NRN, OOF, AutoReply MIME-Version: 1.0 References: <9407e524-2226-6ba9-dd7f-bac635d083e3@gmail.com> <10b30d8a-5c5d-a80a-e659-b5624e2848e4@gmail.com> <78c2c83f-fdd8-5c9b-3ac3-7c22bc4b5d64@gmail.com> <0a10c428-94f1-6112-4d88-c97143f9564d@gmail.com> <7a8384d4-4213-b2df-df28-2b56a8b2d030@youngman.org.uk> In-Reply-To: From: Mark Knecht Date: Sun, 18 Dec 2022 08:38:54 -0700 Message-ID: Subject: Re: [gentoo-user] NAS and replacing with larger drives To: gentoo-user@lists.gentoo.org Content-Type: multipart/alternative; boundary="000000000000c27de005f01c0072" X-Archives-Salt: 17219d9f-f1eb-437a-8b11-6b003622b5ef X-Archives-Hash: f6751e5815e199a1c8863bb18e7cf7c9 --000000000000c27de005f01c0072 Content-Type: text/plain; charset="UTF-8" On Sun, Dec 18, 2022 at 8:29 AM Mark Knecht wrote: > > > > On Sun, Dec 18, 2022 at 8:13 AM Dale wrote: > > > > Well, I finally got it so I could do a backup. I didn't need a hammer but the thought crossed my mind. lol Even tho I now have a 1GB network card, it's still really slow. It shows up as a 1GB connection on both my Gentoo machine and the NAS machine. This is a example of the speeds I'm seeing. Just snippets. > > > > > > 277,193,507 100% 16.18MB/s 0:00:16 > > 519,216,571 100% 18.86MB/s 0:00:26 > > 738,078,565 100% 23.54MB/s 0:00:29 > > > > > > As you can see, the files sizes are large enough it should do better. When I use iftop, it shows it isn't doing anywhere near the speed it should, maybe 1/4th or so. I'd expect at least double or triple that speed. In all honesty, I'd think the hard drive would be the limiting factor. Even on my Gentoo rig I only get about 50 to 60MBs/sec for encrypted drives. I think the encryption slows that down. When copying from a plain drive to a plain drive, I get 100MBs/sec or so. > > > > I can't figure out why it is so slow tho. The NAS rig is a 4 core CPU and 8GBs of memory. It should have enough horsepower under the hood. Maybe it is something I'm not aware of. It is a older rig so maybe it isn't SATA's fastest version, maybe even the original or something. I can't find anything in lspci or dmesg so not real sure where to look on BSD. > > > > Anyway, it's progress for now at least. ;-) At this rate, it'll be done in about a week, maybe. o_O > > > > Dale > > > > To what end Dale? Aren't you painting yourself into a corner with a system you don't really want to run? Wipe the machine and start over from scratch with Gentoo. > > From my vantage point you don't provide enough information for me to make an educated guess. > > 1) Is your data coming off the host machine able to transfer to other machines at 1Gb/S type speeds? > > 2) Can data coming off of your NAS transfer to other machines at 1G/S type speeds? > > 3) How are the two machines connected? If they are going through a router or hub, do you know that hub doesn't limit throughput? > > 4) Is anything else happening on the network? Video flowing around while people are watching TV or something? > > 5) CPU horsepower isn't the only potential bottleneck. Are your disks in the NAS operating slowly? Are you running out of memory? > > Have you considered running something like iperf? > > Mark Run iperf -s in the TrueNAS shell service in the GUI >From you Gentoo Land box run mark@science2:~$ iperf -c truenas1 ------------------------------------------------------------ Client connecting to truenas1, TCP port 5001 TCP window size: 85.0 KByte (default) ------------------------------------------------------------ [ 1] local 192.168.86.43 port 50710 connected with 192.168.86.92 port 5001 [ ID] Interval Transfer Bandwidth [ 1] 0.0000-10.0418 sec 1.07 GBytes 918 Mbits/sec mark@science2:~$ Then immediately wipe the machine and start over with Gentoo, or at least start over with the Linux version of TrueNAS. I would have used the Linux version if it had existed when I built the machine. I don't love BSD, but not because it doesn't work but because certain CLI tools have slightly different options. Wipe the machine and start over with Gentoo from scratch... Wipe the machine and start over with Gentoo from scratch... Humm, I think you should... Wipe the machine and start over with Gentoo from scratch... --000000000000c27de005f01c0072 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


On Sun, Dec 18, 2022 at 8:29 AM Mark Knecht <markknecht@gmail.com> wrote:>
>
>
> On Sun, Dec 18, 2022 at 8:13 AM Dale <rdalek1967@gmail.com> wrote:> >
> > Well, I finally got it so I could do a backup.=C2= =A0 I didn't need a hammer but the thought crossed my mind. =C2=A0lol = =C2=A0Even tho I now have a 1GB network card, it's still really slow.= =C2=A0 It shows up as a 1GB connection on both my Gentoo machine and the NA= S machine.=C2=A0 This is a example of the speeds I'm seeing.=C2=A0 Just= snippets.
> >
> >
> > 277,193,507 100% =C2=A0 1= 6.18MB/s =C2=A0 =C2=A00:00:16
> > 519,216,571 100% =C2=A0 18.86MB/= s =C2=A0 =C2=A00:00:26
> > 738,078,565 100% =C2=A0 23.54MB/s =C2= =A0 =C2=A00:00:29
> >
> >
> > As you can see, th= e files sizes are large enough it should do better.=C2=A0 When I use iftop,= it shows it isn't doing anywhere near the speed it should, maybe 1/4th= or so.=C2=A0 I'd expect at least double or triple that speed.=C2=A0 In= all honesty, I'd think the hard drive would be the limiting factor.=C2= =A0 Even on my Gentoo rig I only get about 50 to 60MBs/sec for encrypted dr= ives.=C2=A0 I think the encryption slows that down.=C2=A0 When copying from= a plain drive to a plain drive, I get 100MBs/sec or so.
> >
&g= t; > I can't figure out why it is so slow tho.=C2=A0 The NAS rig is = a 4 core CPU and 8GBs of memory.=C2=A0 It should have enough horsepower und= er the hood.=C2=A0 Maybe it is something I'm not aware of.=C2=A0 It is = a older rig so maybe it isn't SATA's fastest version, maybe even th= e original or something.=C2=A0 I can't find anything in lspci or dmesg = so not real sure where to look on BSD.
> >
> > Anyway, it= 's progress for now at least. =C2=A0;-) =C2=A0At this rate, it'll b= e done in about a week, maybe. =C2=A0o_O
> >
> > Dale
= > >
>
> To what end Dale? Aren't you painting yoursel= f into a corner with a system you don't really want to run? Wipe the ma= chine and start over from scratch with Gentoo.
>
> From my vant= age point you don't provide enough information for me to make an educat= ed guess.
>
> 1) Is your data coming off the host machine able = to transfer to other machines at 1Gb/S type speeds?
>
> 2) Can = data coming off of your NAS transfer to other machines at 1G/S type speeds?=
>
> 3) How are the two machines connected? If they are going t= hrough a router or hub, do you know that hub doesn't limit throughput?<= br>>
> 4) Is anything else happening on the network? Video flowing= around while people are watching TV or something?
>
> 5) CPU h= orsepower isn't the only potential bottleneck. Are your disks in the NA= S operating slowly? Are you running out of memory?
>
> =C2=A0 = =C2=A0Have you considered running something like iperf?
>
> Mar= k

Run iperf -s in the TrueNAS shell service in the GUI

From you Gentoo Land box run

mark@science2:~$ iperf -c truenas1
----------------------------------= --------------------------
Client connecting to truenas1, TCP port 5001<= br>TCP window size: 85.0 KByte (default)
-------------------------------= -----------------------------
[ =C2=A01] local 192.168.86.43 port 50710 = connected with 192.168.86.92 port 5001
[ ID] Interval =C2=A0 =C2=A0 =C2= =A0 Transfer =C2=A0 =C2=A0 Bandwidth
[ =C2=A01] 0.0000-10.0418 sec =C2= =A01.07 GBytes =C2=A0 918 Mbits/sec
mark@science2:~$

<= /div>
Then immediately wipe the machine and start over with Gentoo, or = at least start over with the Linux version of TrueNAS.

=
I would have used the Linux version if it had existed when I built the= machine. I don't love BSD, but not because=C2=A0it doesn't work bu= t because certain CLI tools have slightly different options.

=
Wipe the machine and start over with Gentoo from scratch...
Wipe the machine and start over with Gentoo from scratch...
Humm, I think you should...
Wipe the machine and start over with= Gentoo from scratch...
--000000000000c27de005f01c0072--