[gentoo-user] Compressed Filesystem

[gentoo-user] Compressed Filesystem

[Helmut Jarausch]

Hi,

I'm looking for a working and maintained compressed filesystem.
I'd like to use it for backing up my root and my /usr filesystems,
so that I can use rsync to keep it up-to-date.

I've come across CompFused which seems to be just what I'm looking for,
but it's buggy not maintained anymore.

Similarly, fusecompress
http://bugs.gentoo.org/show_bug.cgi?id=127433
doesn't build on an up-to-date Gentoo system and doesn't
look maintained either.

There would be sys-fs/zfs-fuse but that sounds like overkill to me.

Are there any other packages?

Many thanks for a hint,
Helmut.

-- 
Helmut Jarausch

Lehrstuhl fuer Numerische Mathematik
RWTH - Aachen University
D 52056 Aachen, Germany

Re: [gentoo-user] Compressed Filesystem

[Mike Kazantsev]

On Mon, 28 Dec 2009 12:58:13 +0100 (CET)
Helmut Jarausch <jarausch@igpm.rwth-aachen.de> wrote:

> Hi,
> 
> I'm looking for a working and maintained compressed filesystem.
> I'd like to use it for backing up my root and my /usr filesystems,
> so that I can use rsync to keep it up-to-date.
> 
> I've come across CompFused which seems to be just what I'm looking
> for, but it's buggy not maintained anymore.
> 
> Similarly, fusecompress
> http://bugs.gentoo.org/show_bug.cgi?id=127433
> doesn't build on an up-to-date Gentoo system and doesn't
> look maintained either.
> 
> There would be sys-fs/zfs-fuse but that sounds like overkill to me.
> 
> Are there any other packages?

Although it might not be stable enough yet, btrfs has support for
compression.


-- 
Mike Kazantsev // fraggod.net

Re: [gentoo-user] Compressed Filesystem

[William Kenworthy]

On Mon, 2009-12-28 at 12:58 +0100, Helmut Jarausch wrote:
> Hi,
> 
> I'm looking for a working and maintained compressed filesystem.
> I'd like to use it for backing up my root and my /usr filesystems,
> so that I can use rsync to keep it up-to-date.
> 
> I've come across CompFused which seems to be just what I'm looking for,
> but it's buggy not maintained anymore.
> 
> Similarly, fusecompress
> http://bugs.gentoo.org/show_bug.cgi?id=127433
> doesn't build on an up-to-date Gentoo system and doesn't
> look maintained either.
> 
> There would be sys-fs/zfs-fuse but that sounds like overkill to me.
> 
> Are there any other packages?
> 
> Many thanks for a hint,
> Helmut.

Tried a few for this and besides the unmaintained part, they dont stand
up to the battering that rsync dishes out - regular corruption.

If you have space, look at dirvish (its in portage) on reiserfs.  Tried
it on ext2 and ext3 - more corruption but reiserfs3 with data=journal is
rock solid.  The devs reccomend not using a journaled FS for
performance, but I found it essential for my setup.

Dirvish takes the full size for the first backup.  Subsequent backups
create hard links to existing files so only differences show up as using
space.  After a number of backups, total size stabilises around 2x
original space unless you add some large files, or do an "emerge -ep
world" :)

Can be easily managed by cron and ssh keys including how many backups to
keep etc.  Can use on a local system, or more usually to a remote
machine.  Restore is as simple as copying the files back (though special
files an permissions need to be maintained so a simple copy isnt viable
for a full system restore.)

BillK

Re: [gentoo-user] Compressed Filesystem

[Volker Armin Hemmann]

On Montag 28 Dezember 2009, Helmut Jarausch wrote:
> Hi,
> 
> I'm looking for a working and maintained compressed filesystem.
> I'd like to use it for backing up my root and my /usr filesystems,
> so that I can use rsync to keep it up-to-date.
> 
> I've come across CompFused which seems to be just what I'm looking for,
> but it's buggy not maintained anymore.
> 
> Similarly, fusecompress
> http://bugs.gentoo.org/show_bug.cgi?id=127433
> doesn't build on an up-to-date Gentoo system and doesn't
> look maintained either.
> 
> There would be sys-fs/zfs-fuse but that sounds like overkill to me.
> 
> Are there any other packages?
> 
> Many thanks for a hint,
> Helmut.
> 

reiser4. Bonus, it only tries to compress stuff that can be compressed (the 
test is quick&dirty and sometimes wrong, but most of the time good enough).

Re: [gentoo-user] Compressed Filesystem

[Helmut Jarausch]

On 28 Dec, Volker Armin Hemmann wrote:
> On Montag 28 Dezember 2009, Helmut Jarausch wrote:
>> Hi,
>> 
>> I'm looking for a working and maintained compressed filesystem.
>> I'd like to use it for backing up my root and my /usr filesystems,
>> so that I can use rsync to keep it up-to-date.
>> 
>> I've come across CompFused which seems to be just what I'm looking for,
>> but it's buggy not maintained anymore.
>> 
>> Similarly, fusecompress
>> http://bugs.gentoo.org/show_bug.cgi?id=127433
>> doesn't build on an up-to-date Gentoo system and doesn't
>> look maintained either.
>> 
>> There would be sys-fs/zfs-fuse but that sounds like overkill to me.
>> 
>> Are there any other packages?
>> 
>> Many thanks for a hint,
>> Helmut.
>> 
> 
> reiser4. Bonus, it only tries to compress stuff that can be compressed (the 
> test is quick&dirty and sometimes wrong, but most of the time good enough).
> 

Thanks!
But what's the future of reiser4 FS ? What are the advantages compared
to btrfs ?

Many thanks,
Helmut.

-- 
Helmut Jarausch

Lehrstuhl fuer Numerische Mathematik
RWTH - Aachen University
D 52056 Aachen, Germany

Re: [gentoo-user] Compressed Filesystem

[Volker Armin Hemmann]

On Dienstag 29 Dezember 2009, Helmut Jarausch wrote:
> On 28 Dec, Volker Armin Hemmann wrote:
> > On Montag 28 Dezember 2009, Helmut Jarausch wrote:
> >> Hi,
> >>
> >> I'm looking for a working and maintained compressed filesystem.
> >> I'd like to use it for backing up my root and my /usr filesystems,
> >> so that I can use rsync to keep it up-to-date.
> >>
> >> I've come across CompFused which seems to be just what I'm looking for,
> >> but it's buggy not maintained anymore.
> >>
> >> Similarly, fusecompress
> >> http://bugs.gentoo.org/show_bug.cgi?id=127433
> >> doesn't build on an up-to-date Gentoo system and doesn't
> >> look maintained either.
> >>
> >> There would be sys-fs/zfs-fuse but that sounds like overkill to me.
> >>
> >> Are there any other packages?
> >>
> >> Many thanks for a hint,
> >> Helmut.
> >
> > reiser4. Bonus, it only tries to compress stuff that can be compressed
> > (the test is quick&dirty and sometimes wrong, but most of the time good
> > enough).
> 
> Thanks!
> But what's the future of reiser4 FS ? What are the advantages compared
> to btrfs ?

reiser4 was denied for 'layer violation'.
btrfs violates those layers even more.

I do no know btrfs. But there are two nice things about reiser4:
it takes your data seriously. It tries everything to make sure your data hit 
the platter. Device does not support barriers? Reiser4 detects that and goes 
into sync mode.
Second, reiser4 is really, really really fast (except mounting).

Re: [gentoo-user] Compressed Filesystem

[Stefan G. Weichinger]

Am 29.12.2009 14:04, schrieb Volker Armin Hemmann:

> I do no know btrfs. But there are two nice things about reiser4:
> it takes your data seriously. It tries everything to make sure your data hit 
> the platter. Device does not support barriers? Reiser4 detects that and goes 
> into sync mode.
> Second, reiser4 is really, really really fast (except mounting).

thinking "ricer" here (ricer vs. reiser ;-) ):

would you recommend it over ext4 for a productive root-fs, considering
speed and safety .... ?

Personally I avoided reiserfs for years after having some really bad
crashes back then .... but sure, things developed since then.

S

Re: [gentoo-user] Compressed Filesystem

[Volker Armin Hemmann]

On Mittwoch 30 Dezember 2009, Stefan G. Weichinger wrote:
> Am 29.12.2009 14:04, schrieb Volker Armin Hemmann:
> > I do no know btrfs. But there are two nice things about reiser4:
> > it takes your data seriously. It tries everything to make sure your data
> > hit the platter. Device does not support barriers? Reiser4 detects that
> > and goes into sync mode.
> > Second, reiser4 is really, really really fast (except mounting).
> 
> thinking "ricer" here (ricer vs. reiser ;-) ):
> 
> would you recommend it over ext4 for a productive root-fs, considering
> speed and safety .... ?

just think a moment of the tons of bug fixes constantly going into ext4. That 
crap is not stable. Pre-alpha maybe.

Re: [gentoo-user] Compressed Filesystem

[Albert Hopkins]

On Wed, 2009-12-30 at 00:08 +0100, Volker Armin Hemmann wrote:
> just think a moment of the tons of bug fixes constantly going into
> ext4. That 
> crap is not stable. Pre-alpha maybe.

People say this from time to time, yet I have been running ext4 on my
root directory of my laptop since July 2008.  The only problem I've had
since then is one time it would not mount on boot.  I merely had to fsck
it from a live media an then it was ok (nothing lost or currupted).  But
that was a long time ago when it was still ext4dev.  And I've had
numerous crashes and battery depletions on the laptop without incident.
So the pre-alpha FUD that some people are spreading is either not true
or I just happen to be the luckiest ext4 user in the world :-).

Re: [gentoo-user] Compressed Filesystem

[Volker Armin Hemmann]

On Mittwoch 30 Dezember 2009, Albert Hopkins wrote:
> On Wed, 2009-12-30 at 00:08 +0100, Volker Armin Hemmann wrote:
> > just think a moment of the tons of bug fixes constantly going into
> > ext4. That
> > crap is not stable. Pre-alpha maybe.
> 
> People say this from time to time, yet I have been running ext4 on my
> root directory of my laptop since July 2008.  The only problem I've had
> since then is one time it would not mount on boot.  I merely had to fsck
> it from a live media an then it was ok (nothing lost or currupted).  But
> that was a long time ago when it was still ext4dev.  And I've had
> numerous crashes and battery depletions on the laptop without incident.
> So the pre-alpha FUD that some people are spreading is either not true
> or I just happen to be the luckiest ext4 user in the world :-).
> 

tell that to the people who got their configs zeroed because extX devs value 
benchmarks at default settings as more important than your data.

Re: [gentoo-user] Compressed Filesystem

[Stroller]

On 30 Dec 2009, at 00:17, Albert Hopkins wrote:
> ... The only problem I've had
> since then is one time it would not mount on boot.  I merely had to  
> fsck
> it from a live media an then it was ok (nothing SEEMED lost or  
> currupted).

Fixed this for you.

Stroller.

Re: [gentoo-user] Compressed Filesystem

[Marcus Wanner]

On 12/29/2009 7:17 PM, Albert Hopkins wrote:
> On Wed, 2009-12-30 at 00:08 +0100, Volker Armin Hemmann wrote:
>    
>> just think a moment of the tons of bug fixes constantly going into
>> ext4. That
>> crap is not stable. Pre-alpha maybe.
>>      
> People say this from time to time, yet I have been running ext4 on my
> root directory of my laptop since July 2008.  The only problem I've had
> since then is one time it would not mount on boot.  I merely had to fsck
> it from a live media an then it was ok (nothing lost or currupted).  But
> that was a long time ago when it was still ext4dev.  And I've had
> numerous crashes and battery depletions on the laptop without incident.
> So the pre-alpha FUD that some people are spreading is either not true
> or I just happen to be the luckiest ext4 user in the world :-).
>    
For my two cents, a while back I was on ext4 and was trying to get xorg 
working. My problem was that the input drivers were not working (because 
they had not been recompiled after an update), so once I ran startx, no 
keyboard or mouse input was registered. This meant that every time I 
tried something which I thought would fix it, I had to hard reset the 
system and look at the logs. The only problem was that the logs had the 
wrong contents because they had been "written to" but not actually 
flushed to the disk, and it took me about 10 hard resets to figure that 
out. Even though I was running ext4, I never lost a thing (except the 
logs :p).

For the curious, I eventually got good logs by running shutdown -h 1 in 
one tty right before running startx in the other, and that shutdown the 
system correctly.

Marcus

Re: [gentoo-user] Compressed Filesystem

[Volker Armin Hemmann]

On Mittwoch 30 Dezember 2009, Marcus Wanner wrote:
> On 12/29/2009 7:17 PM, Albert Hopkins wrote:
> > On Wed, 2009-12-30 at 00:08 +0100, Volker Armin Hemmann wrote:
> >> just think a moment of the tons of bug fixes constantly going into
> >> ext4. That
> >> crap is not stable. Pre-alpha maybe.
> >
> > People say this from time to time, yet I have been running ext4 on my
> > root directory of my laptop since July 2008.  The only problem I've had
> > since then is one time it would not mount on boot.  I merely had to fsck
> > it from a live media an then it was ok (nothing lost or currupted).  But
> > that was a long time ago when it was still ext4dev.  And I've had
> > numerous crashes and battery depletions on the laptop without incident.
> > So the pre-alpha FUD that some people are spreading is either not true
> > or I just happen to be the luckiest ext4 user in the world :-).
> 
> For my two cents, a while back I was on ext4 and was trying to get xorg
> working. My problem was that the input drivers were not working (because
> they had not been recompiled after an update), so once I ran startx, no
> keyboard or mouse input was registered. This meant that every time I
> tried something which I thought would fix it, I had to hard reset the
> system and look at the logs. The only problem was that the logs had the
> wrong contents because they had been "written to" but not actually
> flushed to the disk, and it took me about 10 hard resets to figure that
> out. Even though I was running ext4, I never lost a thing (except the
> logs :p).
> 
> For the curious, I eventually got good logs by running shutdown -h 1 in
> one tty right before running startx in the other, and that shutdown the
> system correctly.
> 
> Marcus
> 

you could have set up acpid to switch to vt1 when the power button is pressed.

This is a nice safeguard against a misbehaving X.

Re: [gentoo-user] Compressed Filesystem

[Neil Bothwick]

[-- Attachment #1: Type: text/plain, Size: 504 bytes --]

On Wed, 30 Dec 2009 09:12:29 -0500, Marcus Wanner wrote:

> I had to hard reset the 
> system and look at the logs. The only problem was that the logs had the 
> wrong contents because they had been "written to" but not actually 
> flushed to the disk, and it took me about 10 hard resets to figure that 
> out.

Another reason to you the magic sysrq keys instead of the reset button.
S syncs your filesystems.


-- 
Neil Bothwick

Get your copy at http://www.geekthing.com/~robf/gensig/

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 198 bytes --]

Re: [gentoo-user] Compressed Filesystem

[Marcus Wanner]

On 12/30/2009 8:04 PM, Neil Bothwick wrote:
> On Wed, 30 Dec 2009 09:12:29 -0500, Marcus Wanner wrote:
>
>    
>> I had to hard reset the
>> system and look at the logs. The only problem was that the logs had the
>> wrong contents because they had been "written to" but not actually
>> flushed to the disk, and it took me about 10 hard resets to figure that
>> out.
>>      
> Another reason to you the magic sysrq keys instead of the reset button.
> S syncs your filesystems.
>    
sysrq syncs the filesystem? I always wondered what that key actually did...

Wait, to get sysrq is Shift+printscreen, right?

Marcus

Re: [gentoo-user] Compressed Filesystem

[Dale]

Marcus Wanner wrote:
> On 12/30/2009 8:04 PM, Neil Bothwick wrote:
>> On Wed, 30 Dec 2009 09:12:29 -0500, Marcus Wanner wrote:
>>
>>   
>>> I had to hard reset the
>>> system and look at the logs. The only problem was that the logs had the
>>> wrong contents because they had been "written to" but not actually
>>> flushed to the disk, and it took me about 10 hard resets to figure that
>>> out.
>>>      
>> Another reason to you the magic sysrq keys instead of the reset button.
>> S syncs your filesystems.
>>    
> sysrq syncs the filesystem? I always wondered what that key actually 
> did...
>
> Wait, to get sysrq is Shift+printscreen, right?
>
> Marcus
>
>

This is from a post by Neil a good long while back:

Hold down Atl, hold down SysRq, press each of the keys in turn. The usual
full sequence is R-E-I-S-U-B

Reboot
Even
If
System
Utterly
Broken


I usually only get to the second or third key and I am back at a console. 

That help?

Dale

:-)  :-) 

Re: [gentoo-user] Compressed Filesystem

[Volker Armin Hemmann]

On Donnerstag 31 Dezember 2009, Dale wrote:
> Marcus Wanner wrote:
> > On 12/30/2009 8:04 PM, Neil Bothwick wrote:
> >> On Wed, 30 Dec 2009 09:12:29 -0500, Marcus Wanner wrote:
> >>> I had to hard reset the
> >>> system and look at the logs. The only problem was that the logs had the
> >>> wrong contents because they had been "written to" but not actually
> >>> flushed to the disk, and it took me about 10 hard resets to figure that
> >>> out.
> >>
> >> Another reason to you the magic sysrq keys instead of the reset button.
> >> S syncs your filesystems.
> >
> > sysrq syncs the filesystem? I always wondered what that key actually
> > did...
> >
> > Wait, to get sysrq is Shift+printscreen, right?
> >
> > Marcus
> 
> This is from a post by Neil a good long while back:
> 
> Hold down Atl, hold down SysRq, press each of the keys in turn. The usual
> full sequence is R-E-I-S-U-B
> 
> Reboot
> Even
> If
> System
> Utterly
> Broken
> 
> 
> I usually only get to the second or third key and I am back at a console.
> 

and sometimes K is all you need.

Thank god for /usr/src/linux/Documentation

Re: [gentoo-user] Compressed Filesystem

[Marcus Wanner]

Volker Armin Hemmann wrote:
> On Donnerstag 31 Dezember 2009, Dale wrote:
>   
>> Marcus Wanner wrote:
>>     
>>> On 12/30/2009 8:04 PM, Neil Bothwick wrote:
>>>       
>>>> On Wed, 30 Dec 2009 09:12:29 -0500, Marcus Wanner wrote:
>>>>         
>>>>> I had to hard reset the
>>>>> system and look at the logs. The only problem was that the logs had the
>>>>> wrong contents because they had been "written to" but not actually
>>>>> flushed to the disk, and it took me about 10 hard resets to figure that
>>>>> out.
>>>>>           
>>>> Another reason to you the magic sysrq keys instead of the reset button.
>>>> S syncs your filesystems.
>>>>         
>>> sysrq syncs the filesystem? I always wondered what that key actually
>>> did...
>>>
>>> Wait, to get sysrq is Shift+printscreen, right?
>>>
>>> Marcus
>>>       
>> This is from a post by Neil a good long while back:
>>
>> Hold down Atl, hold down SysRq, press each of the keys in turn. The usual
>> full sequence is R-E-I-S-U-B
>>
>> Reboot
>> Even
>> If
>> System
>> Utterly
>> Broken
>>
>>
>> I usually only get to the second or third key and I am back at a console.
>>
>>     
>
> and sometimes K is all you need.
>
> Thank god for /usr/src/linux/Documentation
>   
Thanks for the info!

Marcus

Re: [gentoo-user] Compressed Filesystem

[Dale]

Volker Armin Hemmann wrote:
> On Donnerstag 31 Dezember 2009, Dale wrote:
>   
>> Marcus Wanner wrote:
>>     
>>> On 12/30/2009 8:04 PM, Neil Bothwick wrote:
>>>       
>>>> On Wed, 30 Dec 2009 09:12:29 -0500, Marcus Wanner wrote:
>>>>         
>>>>> I had to hard reset the
>>>>> system and look at the logs. The only problem was that the logs had the
>>>>> wrong contents because they had been "written to" but not actually
>>>>> flushed to the disk, and it took me about 10 hard resets to figure that
>>>>> out.
>>>>>           
>>>> Another reason to you the magic sysrq keys instead of the reset button.
>>>> S syncs your filesystems.
>>>>         
>>> sysrq syncs the filesystem? I always wondered what that key actually
>>> did...
>>>
>>> Wait, to get sysrq is Shift+printscreen, right?
>>>
>>> Marcus
>>>       
>> This is from a post by Neil a good long while back:
>>
>> Hold down Atl, hold down SysRq, press each of the keys in turn. The usual
>> full sequence is R-E-I-S-U-B
>>
>> Reboot
>> Even
>> If
>> System
>> Utterly
>> Broken
>>
>>
>> I usually only get to the second or third key and I am back at a console.
>>
>>     
>
> and sometimes K is all you need.
>
> Thank god for /usr/src/linux/Documentation
>
>   

This was posted by Volker a while back. 

e sends TERM to all processes (except init)
i kills all processes (except init)
s syncs partitions
u remounts everything ro
b boots a box
o turns off a box
k saks a box - kills all processes on that vt

That tells what each key does.  I'm still not sure which one took me back to a console.  It may be the E key that does it.

Dale

:-)  :-)  
r unraws the keyboars - takes it away from X.

Re: [gentoo-user] Compressed Filesystem

[Stefan G. Weichinger]

Am 30.12.2009 00:08, schrieb Volker Armin Hemmann:

>> would you recommend it over ext4 for a productive root-fs, considering
>> speed and safety .... ?
> 
> just think a moment of the tons of bug fixes constantly going into ext4. That 
> crap is not stable. Pre-alpha maybe.

hmm, thanks for that thought ...

Re: [gentoo-user] Compressed Filesystem

[Enrico Weigelt]

Helmut Jarausch wrote:
> Hi,
> 
> I'm looking for a working and maintained compressed filesystem.
> I'd like to use it for backing up my root and my /usr filesystems,
> so that I can use rsync to keep it up-to-date.

Perhaps you could try venti+fossil or git.

cu
-- 
----------------------------------------------------------------------
 Enrico Weigelt, metux IT service -- http://www.metux.de/

 cellphone: +49 174 7066481   email: info@metux.de   skype: nekrad666
----------------------------------------------------------------------
 Embedded-Linux / Portierung / Opensource-QM / Verteilte Systeme
----------------------------------------------------------------------

Re: [gentoo-user] Compressed Filesystem

[Helmut Jarausch]

On  3 Jan, Enrico Weigelt wrote:
> Helmut Jarausch wrote:
>> Hi,
>> 
>> I'm looking for a working and maintained compressed filesystem.
>> I'd like to use it for backing up my root and my /usr filesystems,
>> so that I can use rsync to keep it up-to-date.
> 
> Perhaps you could try venti+fossil or git.
> 
Thanks, but I haven't found venti or fossil in Gentoo's tree.
Are there any ebuilds around?

Helmut.

-- 
Helmut Jarausch

Lehrstuhl fuer Numerische Mathematik
RWTH - Aachen University
D 52056 Aachen, Germany

Re: [gentoo-user] Compressed Filesystem

[Mike Kazantsev]

[-- Attachment #1: Type: text/plain, Size: 366 bytes --]

On Sun, 03 Jan 2010 12:53:07 +0100 (CET)
Helmut Jarausch <jarausch@igpm.rwth-aachen.de> wrote:

> On  3 Jan, Enrico Weigelt wrote:
> > 
> > Perhaps you could try venti+fossil or git.
> > 
> Thanks, but I haven't found venti or fossil in Gentoo's tree.
> Are there any ebuilds around?

You'd need plan9 for these ;)


-- 
Mike Kazantsev // fraggod.net

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 198 bytes --]

Re: [gentoo-user] Compressed Filesystem

[Enrico Weigelt]

Helmut Jarausch wrote:
> On  3 Jan, Enrico Weigelt wrote:
>> Helmut Jarausch wrote:
>>> Hi,
>>>
>>> I'm looking for a working and maintained compressed filesystem.
>>> I'd like to use it for backing up my root and my /usr filesystems,
>>> so that I can use rsync to keep it up-to-date.
>> Perhaps you could try venti+fossil or git.
>>
> Thanks, but I haven't found venti or fossil in Gentoo's tree.
> Are there any ebuilds around?

plan9port


> 
> Helmut.
> 


-- 
----------------------------------------------------------------------
 Enrico Weigelt, metux IT service -- http://www.metux.de/

 cellphone: +49 174 7066481   email: info@metux.de   skype: nekrad666
----------------------------------------------------------------------
 Embedded-Linux / Portierung / Opensource-QM / Verteilte Systeme
----------------------------------------------------------------------

[gentoo-user] compressed filesystem

[Space Cake]

Hi,

Is there any way to create some kind of "on the fly" compressed
filesystem for backup purposes? My files are getting bigger and bigger
but my external drive stays the same :)

Thanks
Laszlo

Re: [gentoo-user] compressed filesystem

[Nilesh Govindarajan]

On 08/31/2011 09:20 PM, Space Cake wrote:
> Hi,
> 
> Is there any way to create some kind of "on the fly" compressed
> filesystem for backup purposes? My files are getting bigger and bigger
> but my external drive stays the same :)

Btrfs supports on the fly compression

-- 
Nilesh Govindarajan
http://nileshgr.com

Re: [gentoo-user] compressed filesystem

[Nilesh Govindarajan]

On 08/31/2011 09:51 PM, Nilesh Govindarajan wrote:
> On 08/31/2011 09:20 PM, Space Cake wrote:
>> Hi,
>>
>> Is there any way to create some kind of "on the fly" compressed
>> filesystem for backup purposes? My files are getting bigger and bigger
>> but my external drive stays the same :)
> 
> Btrfs supports on the fly compression
> 

Another option is, you can use the squashfs trick, described here-
http://forums.gentoo.org/viewtopic-t-646289-start-25.html

-- 
Nilesh Govindarajan
http://nileshgr.com

Re: [gentoo-user] compressed filesystem

[Adam Carter]

> Btrfs supports on the fly compression

Yes it supports two types, lzo and zlib, zlib compresses more densely,
and the mount option for that is compress=zlib.

Re: [gentoo-user] compressed filesystem

[Bill Kenworthy]

On Thu, 2011-09-01 at 09:37 +1000, Adam Carter wrote:
> > Btrfs supports on the fly compression
> 
> Yes it supports two types, lzo and zlib, zlib compresses more densely,
> and the mount option for that is compress=zlib.
> 

Is it reliable?

A month ago I returned all my BTRFS partitions to reiserfs because of
unfixable errors.  Initially I was quite impressed,  but until the tools
catch up with real world problems I'll watch from the sidelines.  Errors
will happen, but fixing them is important too.

BillK

Re: [gentoo-user] compressed filesystem

[Adam Carter]

> Is it reliable?

So far so go for me. I'm using lzo on my main partition and zlib on
/home and on an external drive i use for backup.

> A month ago I returned all my BTRFS partitions to reiserfs because of
> unfixable errors.  Initially I was quite impressed,  but until the tools
> catch up with real world problems I'll watch from the sidelines.  Errors
> will happen, but fixing them is important too.

Which kernel was that with? Was the issue caused by a power loss or
normal running? The lack of tools is why Fedora are sticking with ext4
for 16.

Re: [gentoo-user] compressed filesystem

[Bill Kenworthy]

2.6.37 on one machine, and 2.6.39 on the other - those two corrupted
during bad shutdowns whilst writing to the FS (well, I am bad for
triggering the remote power OFF :)

Its not the corruption that was the issue, but that a wipe, reformat and
reload was the only fix.  Cant remember the exact error - its been known
for awhile, but wasn't all that common  when i searched for it.

If they get a set of usable tools, especially online fsck I'd go back to
it as having a drive offline for hours whilst checking reiserfs isn't
great (though at least it doesnt happen often)

BillK



On Thu, 2011-09-01 at 17:13 +1000, Adam Carter wrote:
> > Is it reliable?
> 
> So far so go for me. I'm using lzo on my main partition and zlib on
> /home and on an external drive i use for backup.
> 
> > A month ago I returned all my BTRFS partitions to reiserfs because of
> > unfixable errors.  Initially I was quite impressed,  but until the tools
> > catch up with real world problems I'll watch from the sidelines.  Errors
> > will happen, but fixing them is important too.
> 
> Which kernel was that with? Was the issue caused by a power loss or
> normal running? The lack of tools is why Fedora are sticking with ext4
> for 16.
>