From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (unknown [208.92.234.80]) by finch.gentoo.org (Postfix) with ESMTP id DC6F81381FA for ; Tue, 27 May 2014 22:58:46 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 1AA1EE088A; Tue, 27 May 2014 22:58:45 +0000 (UTC) Received: from mail-qg0-f50.google.com (mail-qg0-f50.google.com [209.85.192.50]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id 67D10E0864 for ; Tue, 27 May 2014 22:58:44 +0000 (UTC) Received: by mail-qg0-f50.google.com with SMTP id z60so15526693qgd.9 for ; Tue, 27 May 2014 15:58:43 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=PnyBQbDKE/4p57IqaVZHeoJUruyWqn/QmN1vKoq6CGM=; b=WqwyEmddWzhjw0x4B28bNn8GkJhVPbV65sFhVxJdPmRdJEqhkJ5OLhmLkFJPqwTpU4 1lxo5Ed4c7rVEAfBdCiQHUCHV1nwfMTGaGOAMErfI8lre9w8RrpZpMp0ECxxylbOfxxY zAFAckxGMWyJMs8dBVGHcG58ZEP6zD0eOhAHEEEQQKyeEzOWNs3hKbBA6IVg2kl5y2m9 Q5dS6smYEGLgnxDOR0pXGFiF9jW9hUUzzswwWjqE8PtEVjOS1WKKt60Cdhrs/Nhc1hun iQvpJ86uNORy6uzMgY1TLHi9kAJsK+QBvcJdJ+cNPbb5l3T1ZguMV2odEJHHht/UjLyx Ui5A== Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-amd64@lists.gentoo.org Reply-to: gentoo-amd64@lists.gentoo.org MIME-Version: 1.0 X-Received: by 10.140.100.198 with SMTP id s64mr45231454qge.106.1401231523444; Tue, 27 May 2014 15:58:43 -0700 (PDT) Received: by 10.96.126.197 with HTTP; Tue, 27 May 2014 15:58:43 -0700 (PDT) Received: by 10.96.126.197 with HTTP; Tue, 27 May 2014 15:58:43 -0700 (PDT) In-Reply-To: <20140527223938.GA3701@sgi.com> References: <20140527223938.GA3701@sgi.com> Date: Tue, 27 May 2014 18:58:43 -0400 Message-ID: Subject: Re: [gentoo-amd64] Soliciting new RAID ideas From: Harry Holt To: gentoo-amd64@lists.gentoo.org Content-Type: multipart/alternative; boundary=001a11c16ba834011f04fa69a355 X-Archives-Salt: 86d200af-0977-45c1-a025-b0b6df1fb03e X-Archives-Hash: 85270818ce499193955df79c64d57a86 --001a11c16ba834011f04fa69a355 Content-Type: text/plain; charset=ISO-8859-1 On May 27, 2014 6:39 PM, "Bob Sanders" wrote: > > Mark Knecht, mused, then expounded: > > Hi all, > > The list is quiet. Please excuse me waking it up. (Or trying to...) ;-) > > > > I'm at the point where I'm a few months from running out of disk > > space on my RAID6 so I'm considering how to move forward. I thought > > I'd check in here and get any ideas folks have. Thanks in advance. > > > > Beware - if Adobe acroread is used, and you opt for a 3TB home > directory, there is a chance it will not work. Or more specifically, > acroread is still 32-bit. It's only something I've seen with the xfs > filesystem. And Adobe has ignored it for approx. 3yrs now. > > > The system is a Gentoo 64-bit, mostly stable, using a i7-980x > > Extreme Edition processor with 24GB DRAM. Large chassis, 6 removable > > HD bays, room for 6 other drives, a large power supply. > > > > The disk subsystem is a 1.4TB RAID6 built from five SATA2 500GB WD > > RAID-Edition 3 drives. The RAID has not had a single glitch in the 4+ > > years I've used this machine. > > > > Generally there are 4 classes of data on the RAID: > > > > 1) Gentoo (obviously), configs backed up every weekend. I plan to > > rebuild from scratch using existing configs if there's a failure. > > Being down for a couple of days is not an issue. > > 2) VMs - about 300GB. Loaded every morning, stopped & saved every > > night, backed up every weekend. > > 3) Financial data - lots of it - stocks, futures, options, etc. > > Performance requirements are pretty low. Backed up every weekend. > > 4) Video files - backed up to a different location than items 1/2/3 > > whenever there are changes > > > > After eclean-dist/eclean-pkg I'm down to about 80GB free and this > > will fill up in 3-6 months so it's time to make some changes. > > > > My thoughts: > > > > 1) Buy three (or even just two) 5400 RPM 3TB WD Red drives and go with > > RAID1. This would use the internal SATA2 ports so it wouldn't be the > > highest performance but likely a lot better than my SATA2 RAID6. > > > > 2) Buy two 7200 RPM 3TB WD Red drives and an LSI logic hardware RAID > > controller. This would be SATA3 so probably way more performance than > > I have now. MUCH more expensive though. > > > > RAID 1 is fine, RAID 10 is better, but comsumes 4 drives and SATA ports. > > > 3) #1 + an SSD. I have an unused 120GB SSD so I could get another, > > make a 2-disk RAID1, put Gentoo on that and everything else on the > > newer 3TB drives. More complex, probably lower reliability and I'm not > > sure I gain much. > > > > Beyond this I need to talk file system types. I'm fat dumb and > > happy with Ext4 and don't really relish dealing with new stuff but > > now's the time to at least look. > > > > If you change, do not use ZFS and possibly BTRFS if the system does not > have ECC DRAM. A single, unnoticed, ECC error can corrupt the data pool > and be written to the file system, which effectively renders it corrupt > without a way to recover. > > FWIW - a Synology DS414slim can hold 4 x 1TB WD Red NAS 2.5" drives and > provide a boot of nfs or iSCSI to your VMs. The downside is the NAS box > and drives would go for a bit north of $636. The upside is all your > movies and VM files could move off your workstation and the workstation > would still host the VMs via a mount of the NAS box. +1 for the Synology NAS boxes, those things are awesome, fast, reliable, upgradable (if you buy a larger one), and the best value available for iSCSI attached VMs. > > > Anyway, that's the basic outline. Any thoughts, ideas, corrections, > > expansions, etc., I'm very interested in talking about. > > > > Cheers, > > Mark > > > > -- > - > > --001a11c16ba834011f04fa69a355 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable


On May 27, 2014 6:39 PM, "Bob Sanders" <rsanders@sgi.com> wrote:
>
> Mark Knecht, mused, then expounded:
> > Hi all,
> > =A0 =A0The list is quiet. Please excuse me waking it up. (Or tryi= ng to...) ;-)
> >
> > =A0 =A0I'm at the point where I'm a few months from runni= ng out of disk
> > space on my RAID6 so I'm considering how to move forward. I t= hought
> > I'd check in here and get any ideas folks have. Thanks in adv= ance.
> >
>
> Beware - if Adobe acroread is used, and you opt for a 3TB home
> directory, there is a chance it will not work. =A0Or more specifically= ,
> acroread is still 32-bit. =A0It's only something I've seen wit= h the xfs
> filesystem. =A0And Adobe has ignored it for approx. 3yrs now.
>
> > =A0 =A0The system is a Gentoo 64-bit, mostly stable, using a i7-9= 80x
> > Extreme Edition processor with 24GB DRAM. Large chassis, 6 remova= ble
> > HD bays, room for 6 other drives, a large power supply.
> >
> > =A0 =A0The disk subsystem is a 1.4TB RAID6 built from five SATA2 = 500GB WD
> > RAID-Edition 3 drives. The RAID has not had a single glitch in th= e 4+
> > years I've used this machine.
> >
> > =A0 =A0Generally there are 4 classes of data on the RAID:
> >
> > 1) Gentoo (obviously), configs backed up every weekend. I plan to=
> > rebuild from scratch using existing configs if there's a fail= ure.
> > Being down for a couple of days is not an issue.
> > 2) VMs - about 300GB. Loaded every morning, stopped & saved e= very
> > night, backed up every weekend.
> > 3) Financial data - lots of it - stocks, futures, options, etc. > > Performance requirements are pretty low. Backed up every weekend.=
> > 4) Video files - backed up to a different location than items 1/2= /3
> > whenever there are changes
> >
> > =A0 =A0After eclean-dist/eclean-pkg I'm down to about 80GB fr= ee and this
> > will fill up in 3-6 months so it's time to make some changes.=
> >
> > =A0 =A0My thoughts:
> >
> > 1) Buy three (or even just two) 5400 RPM 3TB WD Red drives and go= with
> > RAID1. This would use the internal SATA2 ports so it wouldn't= be the
> > highest performance but likely a lot better than my SATA2 RAID6.<= br> > >
> > 2) Buy two 7200 RPM 3TB WD Red drives and an LSI logic hardware R= AID
> > controller. This would be SATA3 so probably way more performance = than
> > I have now. MUCH more expensive though.
> >
>
> RAID 1 is fine, RAID 10 is better, but comsumes 4 drives and SATA port= s.
>
> > 3) #1 + an SSD. I have an unused 120GB SSD so I could get another= ,
> > make a 2-disk RAID1, put Gentoo on that and everything else on th= e
> > newer 3TB drives. More complex, probably lower reliability and I&= #39;m not
> > sure I gain much.
> >
> > =A0 =A0Beyond this I need to talk file system types. I'm fat = dumb and
> > happy with Ext4 and don't really relish dealing with new stuf= f but
> > now's the time to at least look.
> >
>
> If you change, do not use ZFS and possibly BTRFS if the system does no= t
> have ECC DRAM. =A0A single, unnoticed, ECC error can corrupt the data = pool
> and be written to the file system, which effectively renders it corrup= t
> without a way to recover.
>
> FWIW - a Synology DS414slim can hold 4 x 1TB WD Red NAS 2.5" driv= es and
> provide a boot of nfs or iSCSI to your VMs. =A0The downside is the NAS= box
> and drives would go for a bit north of $636. =A0The upside is all your=
> movies and VM files could move off your workstation and the workstatio= n
> would still host the VMs via a mount of the NAS box.

+1 for the Synology NAS boxes, those things are awesome, fast, reliable,= upgradable (if you buy a larger one), and the best value available for iSC= SI attached VMs.

>
> > =A0 =A0Anyway, that's the basic outline. Any thoughts, ideas,= corrections,
> > expansions, etc., I'm very interested in talking about.
> >
> > Cheers,
> > Mark
> >
>
> --
> -
>
>

--001a11c16ba834011f04fa69a355--