From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by finch.gentoo.org (Postfix) with ESMTPS id 4A51F139337 for ; Sat, 31 Jul 2021 12:22:03 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id BCBA7E08EF; Sat, 31 Jul 2021 12:21:57 +0000 (UTC) Received: from mail-oi1-f173.google.com (mail-oi1-f173.google.com [209.85.167.173]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id 618DDE0882 for ; Sat, 31 Jul 2021 12:21:57 +0000 (UTC) Received: by mail-oi1-f173.google.com with SMTP id t128so17392230oig.1 for ; Sat, 31 Jul 2021 05:21:57 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=ry6bFx3rIGzWeXTk2V9NQDvXCbOO03DDrLRB3uZzqZk=; b=sfqGIV674xynynxlOTvsExAt99EDe5ayI88wKbuzSklnlkW55aEdgSMZJyAFMulVnB g9H2nyymuTag3BSfaF1jACfUORmIuqSbbIAhSBP6vWdpxIaru6/f1SN0xRdem2HdvLnn /0I/XDUZToYLiPuUR4yToZektCkAPq+gP9JK8r3rzo3P1f0ei2WbMqtipQkOTCY1q3Rh aF/xIz0pgBc8zqFBXsnjMilnsTXoCuq5II1aaavm5mnkT4O/qTEPfYrxNzZM6LMjOlWL O6Ror53D2N91CoT/de2V4t6pDYUJo8P4P/P6CGj5c/sUcDebyp9wUmQbwIKfy9/ciehW OGbQ== X-Gm-Message-State: AOAM531bmYaiwZmc17XzoRe1VVGp7B5/00E4bYZh2uNt7mMJLFG9vJWL TmqlJBl7VRDgBucwuV9eRbj2dNO3PHEl52v00z/97qOS X-Google-Smtp-Source: ABdhPJxO3ovRlm0zfNiO+6S3Fqxd+9IFo/WkcXL6Gzr+jMo/7CiBy9vR3rxmqZLabyGKKw7rkKdGy5kgsvxgLnDcuzI= X-Received: by 2002:a54:4690:: with SMTP id k16mr4972243oic.49.1627734116562; Sat, 31 Jul 2021 05:21:56 -0700 (PDT) Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-user@lists.gentoo.org Reply-to: gentoo-user@lists.gentoo.org X-Auto-Response-Suppress: DR, RN, NRN, OOF, AutoReply MIME-Version: 1.0 References: <9946c2eb-bb5c-a9c0-ced9-1ac269cd69a0@gmail.com> <6ecbf2d6-2c6f-3f66-5eee-f4766d5e5254@gmail.com> <24805.48814.331408.860941@tux.local> <5483630c-3cd1-bca2-0a6d-62bb85a5adc6@gmail.com> <96fc901a-2ce4-0ea0-0ed1-1c529145c0e9@gmail.com> <6102DB58.7040103@youngman.org.uk> <56d64f52-1b9a-1309-c720-06bb63c9f80a@iinet.net.au> <7a8c52c3-4c96-89ac-ace0-6eb4b8f1401f@iinet.net.au> <6104C897.5010505@youngman.org.uk> In-Reply-To: <6104C897.5010505@youngman.org.uk> From: Rich Freeman Date: Sat, 31 Jul 2021 08:21:44 -0400 Message-ID: Subject: Re: [gentoo-user] [OT] SMR drives (WAS: cryptsetup close and device in use when it is not) To: gentoo-user@lists.gentoo.org Content-Type: text/plain; charset="UTF-8" X-Archives-Salt: 5b293311-e274-4a84-918c-9c16fba34ff3 X-Archives-Hash: bf92d7c0c4965550473449df405c77f8 On Fri, Jul 30, 2021 at 11:50 PM Wols Lists wrote: > > btw, you're scrubbing over USB? Are you running a raid over USB? Bad > things are likely to happen ... So, USB hosts vary in quality I'm sure, but I've been running USB3 drives on lizardfs for a while now with zero issues. At first I was shucking them and using LSI HBAs. That was a pain for a bunch of reasons, and I would have issues probably due to the HBAs being old or maybe cheap cable issues (and new SAS hardware carries a hefty price tag). Then I decided to just try running a drive on USB3 and it worked fine. This isn't for heavy use, but it basically performs identically to SATA. I did the math and for spinning disks you can get 2 drives per host before the data rate starts to become a concern. This is for a distributed filesystem and I'm just using gigabit ethernet, and the cluster is needed more for capacity than IOPS, so USB3 isn't the bottleneck anyway. I have yet to have a USB drive have any sort of issue, or drop a connection. And they're running on cheap Pi4s for the most part (which have two USB3 hosts). If for some reason a drive or host dropped the filesystem is redundant at the host level, and it also gracefully recovers data if a host shows back up, but I have yet to see that even happen due to a USB issue. I've had far more issues when I was trying to use LSI HBAs on RockPro64 SBCs (which have a PCIe slot - I had to also use a powered riser). Now, if you want to do something where you're going to be pulling closer to max bandwidth out of all your disks at once and you have more than a few disks and you have it on 10GbE or faster, then USB3 could be a bottleneck unless you have a lot of hosts (though even then adding USB3 hosts to the motherboard might not be any harder than adding SATA hosts). -- Rich