public inbox for gentoo-user@lists.gentoo.org
 help / color / mirror / Atom feed
From: Mike Kazantsev <mk.fraggod@gmail.com>
To: gentoo-user@lists.gentoo.org
Subject: Re: [gentoo-user] [OT] RAID 1 over network
Date: Tue, 16 Jun 2009 18:58:56 +0600	[thread overview]
Message-ID: <20090616185856.61bd4ee3@coercion> (raw)
In-Reply-To: <20090616124046.7e484352@symbox>

[-- Attachment #1: Type: text/plain, Size: 1631 bytes --]

On Tue, 16 Jun 2009 12:40:46 +0200
Renat Golubchyk <ragermany@gmx.net> wrote:

> Hi all!
> 
> Short:
> What is the best way to setup something similar to RAID 1 over a WAN?

...

> One purpose of the setup is to have data redundancy. Thus we have to
> ensure that the data is replicated in a timely manner. Replicating MySQL
> data is not difficult. The problem is the file system data like uploaded
> documents and pictures. We can monitor changes in the file system and
> initiate rsync to copy files over the network, but I think it's not a
> good solution. What we are after is a network equivalent of RAID 1.
> Are there any viable solutions that could work over a WAN?

If replication after file is completely hit the disk is not acceptable
either because files are quite large or have to be really synchronous
then I'll second DRBD-with-HA-cluster-fs suggestion.

Otherwise, if it's acceptable to have each file replicated as soon as
it's fully stored on one node and link between nodes isn't good enough
clustered fs High-Availability features might play against you, but I
don't think rsync (via some sort of cron) is a good idea here, anyway.

You'd be better off using in-kernel dnotify / inotify reactors and
a simple script to track IN_MODIFY and IN_CREATE events, replicating
path in question (possibly via some sort of delta-transfer) as soon as
it hits the fs.
I even remember seeing inotify-tracking binary to use with common shell
scripts, although I believe any dedicated non-bash-hack implementation
should be better suited for such task.

-- 
Mike Kazantsev // fraggod.net

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 198 bytes --]

  parent reply	other threads:[~2009-06-16 13:01 UTC|newest]

Thread overview: 9+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2009-06-16 10:40 [gentoo-user] [OT] RAID 1 over network Renat Golubchyk
2009-06-16 11:26 ` [gentoo-user] " james
2009-06-16 11:37 ` [gentoo-user] " Philipp Riegger
2009-06-16 12:58 ` Mike Kazantsev [this message]
2009-06-16 13:45   ` Daniel Iliev
2009-06-16 13:58     ` Philipp Riegger
2009-06-16 15:54       ` Dirk Heinrichs
2009-06-16 16:32         ` Daniel Iliev
2009-06-16 16:30       ` Daniel Iliev

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20090616185856.61bd4ee3@coercion \
    --to=mk.fraggod@gmail.com \
    --cc=gentoo-user@lists.gentoo.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox