From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from pigeon.gentoo.org ([208.92.234.80] helo=lists.gentoo.org) by finch.gentoo.org with esmtp (Exim 4.60) (envelope-from ) id 1MGYIM-00070M-8i for garchives@archives.gentoo.org; Tue, 16 Jun 2009 13:01:46 +0000 Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 9E4B1E03DB; Tue, 16 Jun 2009 13:01:44 +0000 (UTC) Received: from mail-bw0-f223.google.com (mail-bw0-f223.google.com [209.85.218.223]) by pigeon.gentoo.org (Postfix) with ESMTP id 599ECE03DB for ; Tue, 16 Jun 2009 13:01:44 +0000 (UTC) Received: by bwz23 with SMTP id 23so3587182bwz.34 for ; Tue, 16 Jun 2009 06:01:43 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:date:from:to:subject :message-id:in-reply-to:references:x-mailer:mime-version :content-type; bh=9Rq3uSADssGfGxb4XGCCHHAnvo5P8aqGHXmzOsc+Rpg=; b=r5bXr0LmvtiGTdKd9OVNqO0sNL9sPWnesy4gSUbGS71OPFoiFhNN+v2a2Wcc8nYs+w nlv21JSTdxbMhTKZUY5Hz1W/Hx1mYJzNU5+M5uOilZ3QjEgAZMQxSB3YsJ9o2ruAAERz 4/BcBhrwK2zGA9fKGQNxYnVfA9xUN+mqj6d5k= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=date:from:to:subject:message-id:in-reply-to:references:x-mailer :mime-version:content-type; b=WHAR1PMusD67uiWD/N9y12ACVO5wmGC52oH1bI7WLtvOz6EerCyhA/+xXJtA6Axubl HROa4vp4447Iu5iW8coy1DIsVfV+T7i/cu61fVCxyb3oVJ9CEw2VxEhHfz9agXAZ3J7S TY38fcRncLWfix2S/nwKzvIqU/Hs5+uBx5hPA= Received: by 10.103.231.16 with SMTP id i16mr4465600mur.7.1245157303451; Tue, 16 Jun 2009 06:01:43 -0700 (PDT) Received: from coercion ([91.191.238.58]) by mx.google.com with ESMTPS id y6sm2127856mug.40.2009.06.16.06.01.42 (version=TLSv1/SSLv3 cipher=RC4-MD5); Tue, 16 Jun 2009 06:01:42 -0700 (PDT) Date: Tue, 16 Jun 2009 18:58:56 +0600 From: Mike Kazantsev To: gentoo-user@lists.gentoo.org Subject: Re: [gentoo-user] [OT] RAID 1 over network Message-ID: <20090616185856.61bd4ee3@coercion> In-Reply-To: <20090616124046.7e484352@symbox> References: <20090616124046.7e484352@symbox> X-Mailer: Claws Mail 3.7.1 (GTK+ 2.16.1; i686-pc-linux-gnu) Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-user@lists.gentoo.org Reply-to: gentoo-user@lists.gentoo.org Mime-Version: 1.0 Content-Type: multipart/signed; micalg=PGP-SHA1; boundary="Sig_/MXpyHBlOYNoFtJgiQ7pe3KE"; protocol="application/pgp-signature" X-Archives-Salt: a29f3652-16e5-4ead-9c31-4fe8d7dd86aa X-Archives-Hash: 35a4b4c6713ee28781d7b3db1216b572 --Sig_/MXpyHBlOYNoFtJgiQ7pe3KE Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: quoted-printable On Tue, 16 Jun 2009 12:40:46 +0200 Renat Golubchyk wrote: > Hi all! >=20 > Short: > What is the best way to setup something similar to RAID 1 over a WAN? ... > One purpose of the setup is to have data redundancy. Thus we have to > ensure that the data is replicated in a timely manner. Replicating MySQL > data is not difficult. The problem is the file system data like uploaded > documents and pictures. We can monitor changes in the file system and > initiate rsync to copy files over the network, but I think it's not a > good solution. What we are after is a network equivalent of RAID 1. > Are there any viable solutions that could work over a WAN? If replication after file is completely hit the disk is not acceptable either because files are quite large or have to be really synchronous then I'll second DRBD-with-HA-cluster-fs suggestion. Otherwise, if it's acceptable to have each file replicated as soon as it's fully stored on one node and link between nodes isn't good enough clustered fs High-Availability features might play against you, but I don't think rsync (via some sort of cron) is a good idea here, anyway. You'd be better off using in-kernel dnotify / inotify reactors and a simple script to track IN_MODIFY and IN_CREATE events, replicating path in question (possibly via some sort of delta-transfer) as soon as it hits the fs. I even remember seeing inotify-tracking binary to use with common shell scripts, although I believe any dedicated non-bash-hack implementation should be better suited for such task. --=20 Mike Kazantsev // fraggod.net --Sig_/MXpyHBlOYNoFtJgiQ7pe3KE Content-Type: application/pgp-signature; name=signature.asc Content-Disposition: attachment; filename=signature.asc -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.11 (GNU/Linux) iEYEARECAAYFAko3lxsACgkQASbOZpzyXnHolQCg5Wy1gUlGjOQPIXjxdT5qEa8H iL8AnipQ1MSxC30SfSTGPONv05sOfR3V =wFQd -----END PGP SIGNATURE----- --Sig_/MXpyHBlOYNoFtJgiQ7pe3KE--