From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) by finch.gentoo.org (Postfix) with ESMTP id 638F21381F3 for ; Mon, 17 Jun 2013 07:42:42 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 227C5E093A; Mon, 17 Jun 2013 07:42:35 +0000 (UTC) Received: from nskntmtas04p.mx.bigpond.com (nskntmtas04p.mx.bigpond.com [61.9.168.146]) by pigeon.gentoo.org (Postfix) with ESMTP id 46743E086B for ; Mon, 17 Jun 2013 07:42:32 +0000 (UTC) Received: from nskntcmgw09p ([61.9.169.169]) by nskntmtas04p.mx.bigpond.com with ESMTP id <20130617074232.SYVA2025.nskntmtas04p.mx.bigpond.com@nskntcmgw09p> for ; Mon, 17 Jun 2013 07:42:32 +0000 Received: from bluering.localnet ([58.172.72.6]) by nskntcmgw09p with BigPond Outbound id pKiX1l0060884ze01KiX6i; Mon, 17 Jun 2013 07:42:32 +0000 X-Authority-Analysis: v=2.0 cv=APSpfbFe c=1 sm=1 a=/VC9VB1ZLbbbzpNmbdgIbw==:17 a=zieG70JHZR8A:10 a=KUAJHMLjxQwA:10 a=iVaGrk5S_GEA:10 a=vPtwz2tBAAAA:8 a=LXL8el5rAAAA:8 a=CpVJ2KfnM7AWYlnWq74A:9 a=CjuIK1q_8ugA:10 a=rpZbK-ZXKSkA:10 a=SSmOFEACAAAA:8 a=_W_S_7VecoQA:10 a=frz4AuCg-hUA:10 a=v8EC-gJAdCOYI_fw:21 a=/VC9VB1ZLbbbzpNmbdgIbw==:117 From: Paul Colquhoun To: gentoo-user@lists.gentoo.org Subject: Re: [gentoo-user] File system meta-data indexer / checker Date: Mon, 17 Jun 2013 17:42:25 +1000 Message-ID: <8986052.mQYZKkbyGk@bluering> User-Agent: KMail/4.10.4 (Linux/3.8.5-gentoo; KDE/4.10.4; x86_64; ; ) In-Reply-To: References: Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-user@lists.gentoo.org Reply-to: gentoo-user@lists.gentoo.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="nextPart7516584.qlKcd12kUm" Content-Transfer-Encoding: 7Bit X-Archives-Salt: 63ae2831-acfc-4ad1-a42f-bdf0b7526ee6 X-Archives-Hash: 15e203715a5cb58f4ce1a23c40f39a14 This is a multi-part message in MIME format. --nextPart7516584.qlKcd12kUm Content-Transfer-Encoding: 7Bit Content-Type: text/plain; charset="us-ascii" On Mon, 17 Jun 2013 00:14:17 Ciprian Dorin Craciun wrote: > Hello all! > > While struggling with managing various old backups --- just > imagine 10 or so copies of almost the same content, some with `rsync`, > some with `rdiff-backup`, yet some others on plain ISO's, all over a > range of a few years --- I stumbled upon the following missing piece > in the Linux tools ecosystem: a file-system crawler that records > **only** meta-data, like all the info available through `stat`, plus > an assortment of hashes of the files (at least MD5 and SHA-1,2 > family), and optionally ACL's and extended attributes. Thus I was > wondering if someone knows a tool that fits this description. > > > I must say I've tried to do my homework, and below are a few tools > that come close, but not quite... > > (A) `rdup` is probably the closest to what I'm searching. However > there are a few issues: > * it's output format is not very parsable, especially in cases > like symlinks, and a few other special cases; > * it doesn't escape the file names --- and from some reason I have > files containing escape sequences in them... > * it records only SHA-1; > * it doesn't handle ACL's or extended attributes; > > (B) `mtree` from FreeBSD. I found two ports of it for Linux, > however my main concern is how parsable is the output... > > (C) `md5deep` (or `sha*deep`), which only records the checksum not > other meta-data. > > > Thus, are there any other alternatives? (Just to be clear, I > don't need a "backup" solution, just something to record file-system > meta-data. Maybe a "meta-backup" solution... :) ) > > Ciprian. Have a look at 'tripwire'. It's primarily an intrusion detection tool, but it does the job by recording file meta-data and checksums, then checking to see if they have changed. I can't remember if it handles ACL's, as it's been a few years since I used it. -- Reverend Paul Colquhoun, ULC. http://andor.dropbear.id.au/ Asking for technical help in newsgroups? Read this first: http://catb.org/~esr/faqs/smart-questions.html#intro --nextPart7516584.qlKcd12kUm Content-Transfer-Encoding: 7Bit Content-Type: text/html; charset="us-ascii"

On Mon, 17 Jun 2013 00:14:17 Ciprian Dorin Craciun wrote:

> Hello all!

>

> While struggling with managing various old backups --- just

> imagine 10 or so copies of almost the same content, some with `rsync`,

> some with `rdiff-backup`, yet some others on plain ISO's, all over a

> range of a few years --- I stumbled upon the following missing piece

> in the Linux tools ecosystem: a file-system crawler that records

> **only** meta-data, like all the info available through `stat`, plus

> an assortment of hashes of the files (at least MD5 and SHA-1,2

> family), and optionally ACL's and extended attributes. Thus I was

> wondering if someone knows a tool that fits this description.

>

>

> I must say I've tried to do my homework, and below are a few tools

> that come close, but not quite...

>

> (A) `rdup` is probably the closest to what I'm searching. However

> there are a few issues:

> * it's output format is not very parsable, especially in cases

> like symlinks, and a few other special cases;

> * it doesn't escape the file names --- and from some reason I have

> files containing escape sequences in them...

> * it records only SHA-1;

> * it doesn't handle ACL's or extended attributes;

>

> (B) `mtree` from FreeBSD. I found two ports of it for Linux,

> however my main concern is how parsable is the output...

>

> (C) `md5deep` (or `sha*deep`), which only records the checksum not

> other meta-data.

>

>

> Thus, are there any other alternatives? (Just to be clear, I

> don't need a "backup" solution, just something to record file-system

> meta-data. Maybe a "meta-backup" solution... :) )

>

> Ciprian.

 

 

Have a look at 'tripwire'. It's primarily an intrusion detection tool, but it does the job by recording file meta-data and checksums, then checking to see if they have changed. I can't remember if it handles ACL's, as it's been a few years since I used it.

 

 

--

Reverend Paul Colquhoun, ULC. http://andor.dropbear.id.au/

Asking for technical help in newsgroups? Read this first:

http://catb.org/~esr/faqs/smart-questions.html#intro

 

--nextPart7516584.qlKcd12kUm--