* [gentoo-user] Back up a server in real-time
@ 2008-11-15 19:45 Mick
2008-11-15 20:13 ` Volker Armin Hemmann
` (7 more replies)
0 siblings, 8 replies; 27+ messages in thread
From: Mick @ 2008-11-15 19:45 UTC (permalink / raw
To: gentoo-user
[-- Attachment #1: Type: text/plain, Size: 177 bytes --]
Without gentoo-wiki my knowledge level is rather poor (just like my memory!)
What would you use to back up a running server without taking it off line?
--
Regards,
Mick
[-- Attachment #2: This is a digitally signed message part. --]
[-- Type: application/pgp-signature, Size: 197 bytes --]
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: [gentoo-user] Back up a server in real-time
2008-11-15 19:45 [gentoo-user] Back up a server in real-time Mick
@ 2008-11-15 20:13 ` Volker Armin Hemmann
2008-11-15 20:23 ` Alan McKinnon
` (6 subsequent siblings)
7 siblings, 0 replies; 27+ messages in thread
From: Volker Armin Hemmann @ 2008-11-15 20:13 UTC (permalink / raw
To: gentoo-user
On Samstag 15 November 2008, Mick wrote:
> Without gentoo-wiki my knowledge level is rather poor (just like my
> memory!)
>
> What would you use to back up a running server without taking it off line?
tar
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: [gentoo-user] Back up a server in real-time
2008-11-15 19:45 [gentoo-user] Back up a server in real-time Mick
2008-11-15 20:13 ` Volker Armin Hemmann
@ 2008-11-15 20:23 ` Alan McKinnon
2008-11-15 20:29 ` Jerry McBride
` (5 subsequent siblings)
7 siblings, 0 replies; 27+ messages in thread
From: Alan McKinnon @ 2008-11-15 20:23 UTC (permalink / raw
To: gentoo-user
On Saturday 15 November 2008 21:45:04 Mick wrote:
> Without gentoo-wiki my knowledge level is rather poor (just like my
> memory!)
>
> What would you use to back up a running server without taking it off line?
rsync
--
alan dot mckinnon at gmail dot com
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: [gentoo-user] Back up a server in real-time
2008-11-15 19:45 [gentoo-user] Back up a server in real-time Mick
2008-11-15 20:13 ` Volker Armin Hemmann
2008-11-15 20:23 ` Alan McKinnon
@ 2008-11-15 20:29 ` Jerry McBride
2008-11-15 20:38 ` Dale
` (4 subsequent siblings)
7 siblings, 0 replies; 27+ messages in thread
From: Jerry McBride @ 2008-11-15 20:29 UTC (permalink / raw
To: gentoo-user
On Saturday 15 November 2008 02:45:04 pm Mick wrote:
> Without gentoo-wiki my knowledge level is rather poor (just like my
> memory!)
>
> What would you use to back up a running server without taking it off line?
What's wrong with gentoo-wiki.info?
As for backup.... yes tar is good, but how about rsync?
--
*****************************************************************************
From the desk of:
Jerome D. McBride
15:28:45 up 20 days, 4:03, 2 users, load average: 1.18, 1.05, 1.03
*****************************************************************************
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: [gentoo-user] Back up a server in real-time
2008-11-15 19:45 [gentoo-user] Back up a server in real-time Mick
` (2 preceding siblings ...)
2008-11-15 20:29 ` Jerry McBride
@ 2008-11-15 20:38 ` Dale
2008-11-16 0:08 ` Mick
2008-11-16 5:16 ` jaeyoung lee
` (3 subsequent siblings)
7 siblings, 1 reply; 27+ messages in thread
From: Dale @ 2008-11-15 20:38 UTC (permalink / raw
To: gentoo-user
Mick wrote:
> Without gentoo-wiki my knowledge level is rather poor (just like my memory!)
>
> What would you use to back up a running server without taking it off line?
>
I keep mine simple, cp -auv paths/you/want/to/backup back/up/to It has
works so far. Thought about doing a cron job but that complicates
things. :/
Dale
:-) :-)
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: [gentoo-user] Back up a server in real-time
2008-11-15 20:38 ` Dale
@ 2008-11-16 0:08 ` Mick
2008-11-16 0:42 ` Dale
` (3 more replies)
0 siblings, 4 replies; 27+ messages in thread
From: Mick @ 2008-11-16 0:08 UTC (permalink / raw
To: gentoo-user
[-- Attachment #1: Type: text/plain, Size: 884 bytes --]
On Saturday 15 November 2008, Dale wrote:
> Mick wrote:
> > Without gentoo-wiki my knowledge level is rather poor (just like my
> > memory!)
> >
> > What would you use to back up a running server without taking it off
> > line?
>
> I keep mine simple, cp -auv paths/you/want/to/backup back/up/to It has
> works so far. Thought about doing a cron job but that complicates
> things. :/
Thank you all for the suggestions and for the link to the wiki! I've got some
reading to do. ;-)
Whenever I have used tar to back up a whole OS I used it with a LiveCD. This
was to make sure that files and their metadata were not being changed while I
was tar'ing them.
Are you saying that I can actually fire up tar/rsync and back up in real time?
I was gravitating towards using LVM snapshot and then tar'ing that to an
external USB drive.
--
Regards,
Mick
[-- Attachment #2: This is a digitally signed message part. --]
[-- Type: application/pgp-signature, Size: 197 bytes --]
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: [gentoo-user] Back up a server in real-time
2008-11-16 0:08 ` Mick
@ 2008-11-16 0:42 ` Dale
2008-11-16 2:58 ` Jerry McBride
` (2 subsequent siblings)
3 siblings, 0 replies; 27+ messages in thread
From: Dale @ 2008-11-16 0:42 UTC (permalink / raw
To: gentoo-user
Mick wrote:
> On Saturday 15 November 2008, Dale wrote:
>
>> Mick wrote:
>>
>>> Without gentoo-wiki my knowledge level is rather poor (just like my
>>> memory!)
>>>
>>> What would you use to back up a running server without taking it off
>>> line?
>>>
>> I keep mine simple, cp -auv paths/you/want/to/backup back/up/to It has
>> works so far. Thought about doing a cron job but that complicates
>> things. :/
>>
>
> Thank you all for the suggestions and for the link to the wiki! I've got some
> reading to do. ;-)
>
> Whenever I have used tar to back up a whole OS I used it with a LiveCD. This
> was to make sure that files and their metadata were not being changed while I
> was tar'ing them.
>
> Are you saying that I can actually fire up tar/rsync and back up in real time?
>
> I was gravitating towards using LVM snapshot and then tar'ing that to an
> external USB drive.
>
I have read that you can use tar while the system is running. I
wouldn't do that during say a emerge or something tho. I would try to
keep the system somewhat idle as far as changing files.
My cp command works fine on a running system with the same advice as
above on the system being idle tho.
Dale
:-) :-)
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: [gentoo-user] Back up a server in real-time
2008-11-16 0:08 ` Mick
2008-11-16 0:42 ` Dale
@ 2008-11-16 2:58 ` Jerry McBride
2008-11-16 9:54 ` Alan McKinnon
2008-11-16 17:12 ` Jorge Peixoto de Morais Neto
3 siblings, 0 replies; 27+ messages in thread
From: Jerry McBride @ 2008-11-16 2:58 UTC (permalink / raw
To: gentoo-user
On Saturday 15 November 2008 07:08:42 pm Mick wrote:
> On Saturday 15 November 2008, Dale wrote:
> > Mick wrote:
> > > Without gentoo-wiki my knowledge level is rather poor (just like my
> > > memory!)
> > >
> > > What would you use to back up a running server without taking it off
> > > line?
> >
> > I keep mine simple, cp -auv paths/you/want/to/backup back/up/to It has
> > works so far. Thought about doing a cron job but that complicates
> > things. :/
>
> Thank you all for the suggestions and for the link to the wiki! I've got
> some reading to do. ;-)
>
> Whenever I have used tar to back up a whole OS I used it with a LiveCD.
> This was to make sure that files and their metadata were not being changed
> while I was tar'ing them.
>
> Are you saying that I can actually fire up tar/rsync and back up in real
> time?
>
> I was gravitating towards using LVM snapshot and then tar'ing that to an
> external USB drive.
If you need to guarantee a backup without the data being changed during the
process... you gotta take the server down. The easiest way is to init 1 to
single user mode , make your backup, then init x back to what ever runlevel
you were in...
--
*****************************************************************************
From the desk of:
Jerome D. McBride
21:54:45 up 5:40, 4 users, load average: 0.00, 0.01, 0.00
*****************************************************************************
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: [gentoo-user] Back up a server in real-time
2008-11-15 19:45 [gentoo-user] Back up a server in real-time Mick
` (3 preceding siblings ...)
2008-11-15 20:38 ` Dale
@ 2008-11-16 5:16 ` jaeyoung lee
2008-11-16 9:04 ` William Kenworthy
` (2 subsequent siblings)
7 siblings, 0 replies; 27+ messages in thread
From: jaeyoung lee @ 2008-11-16 5:16 UTC (permalink / raw
To: gentoo-user
[-- Attachment #1: Type: text/plain, Size: 331 bytes --]
rsync is nice way
On Sun, Nov 16, 2008 at 3:45 AM, Mick <michaelkintzios@gmail.com> wrote:
> Without gentoo-wiki my knowledge level is rather poor (just like my
> memory!)
>
> What would you use to back up a running server without taking it off line?
> --
> Regards,
> Mick
>
--
Only freebsd openbsd gentoo-linux windows2008
[-- Attachment #2: Type: text/html, Size: 636 bytes --]
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: [gentoo-user] Back up a server in real-time
2008-11-15 19:45 [gentoo-user] Back up a server in real-time Mick
` (4 preceding siblings ...)
2008-11-16 5:16 ` jaeyoung lee
@ 2008-11-16 9:04 ` William Kenworthy
2008-11-16 9:36 ` Volker Armin Hemmann
` (2 more replies)
2008-11-16 10:35 ` Dirk Heinrichs
2008-11-19 16:59 ` Mark Somerville
7 siblings, 3 replies; 27+ messages in thread
From: William Kenworthy @ 2008-11-16 9:04 UTC (permalink / raw
To: gentoo-user
dirvish is in portage.
tar/rsync/cp are not really backups but manual copies. If you want true
backup you need scripts to handle the extra functionality for things
like versioning, archive management and the all important restore.
Dirvish is excellent on all but restore.
BillK
On Sat, 2008-11-15 at 19:45 +0000, Mick wrote:
> Without gentoo-wiki my knowledge level is rather poor (just like my memory!)
>
> What would you use to back up a running server without taking it off line?
--
William Kenworthy <billk@iinet.net.au>
Home in Perth!
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: [gentoo-user] Back up a server in real-time
2008-11-16 9:04 ` William Kenworthy
@ 2008-11-16 9:36 ` Volker Armin Hemmann
2008-11-16 9:58 ` Alan McKinnon
2008-11-17 16:07 ` Joerg Schilling
2 siblings, 0 replies; 27+ messages in thread
From: Volker Armin Hemmann @ 2008-11-16 9:36 UTC (permalink / raw
To: gentoo-user
On Sonntag 16 November 2008, William Kenworthy wrote:
> dirvish is in portage.
>
> tar/rsync/cp are not really backups but manual copies. If you want true
> backup you need scripts to handle the extra functionality for things
> like versioning, archive management and the all important restore.
archives are managed by my tapelib, thank you very much. Restore is as easy as
backup with tar.
And if you start depending on something complex, you will be screwed at some
point. Every system and every livecd has tar. amanda? mondo? devilish? not.
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: [gentoo-user] Back up a server in real-time
2008-11-16 0:08 ` Mick
2008-11-16 0:42 ` Dale
2008-11-16 2:58 ` Jerry McBride
@ 2008-11-16 9:54 ` Alan McKinnon
2008-11-16 11:51 ` Mick
2008-11-16 17:12 ` Jorge Peixoto de Morais Neto
3 siblings, 1 reply; 27+ messages in thread
From: Alan McKinnon @ 2008-11-16 9:54 UTC (permalink / raw
To: gentoo-user
On Sunday 16 November 2008 02:08:42 Mick wrote:
> On Saturday 15 November 2008, Dale wrote:
> > Mick wrote:
> > > Without gentoo-wiki my knowledge level is rather poor (just like my
> > > memory!)
> > >
> > > What would you use to back up a running server without taking it off
> > > line?
> >
> > I keep mine simple, cp -auv paths/you/want/to/backup back/up/to It has
> > works so far. Thought about doing a cron job but that complicates
> > things. :/
>
> Thank you all for the suggestions and for the link to the wiki! I've got
> some reading to do. ;-)
>
> Whenever I have used tar to back up a whole OS I used it with a LiveCD.
> This was to make sure that files and their metadata were not being changed
> while I was tar'ing them.
>
> Are you saying that I can actually fire up tar/rsync and back up in real
> time?
Yes. Unix does some RealSmartThings(tm) when using files. The name is just a
pointer to the actual file, represented by an inode. Once you have an inode
open, it stays open until everything using it closes it. So you can
add/delete/copy/move files by name with impunity as you then just move names
around. Contrast this with other inferior systems, like say Windows for
example, which has a built-in self-destruct button when you try this...
> I was gravitating towards using LVM snapshot and then tar'ing that to an
> external USB drive.
This is the preferred way, as you get a consistent snapshot frozen at a point
in time. This deals nicely with inconsistencies caused by files changing
while you are backing up other ones.
--
alan dot mckinnon at gmail dot com
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: [gentoo-user] Back up a server in real-time
2008-11-16 9:04 ` William Kenworthy
2008-11-16 9:36 ` Volker Armin Hemmann
@ 2008-11-16 9:58 ` Alan McKinnon
2008-11-16 10:31 ` William Kenworthy
2008-11-17 16:07 ` Joerg Schilling
2 siblings, 1 reply; 27+ messages in thread
From: Alan McKinnon @ 2008-11-16 9:58 UTC (permalink / raw
To: gentoo-user
On Sunday 16 November 2008 11:04:41 William Kenworthy wrote:
> dirvish is in portage.
>
> tar/rsync/cp are not really backups but manual copies. If you want true
> backup you need scripts to handle the extra functionality for things
> like versioning, archive management and the all important restore.
>
> Dirvish is excellent on all but restore.
Which raises the question:
What's the point of it then?
OTOH, it has to be better than legato. Nothing could be worse than legato.
--
alan dot mckinnon at gmail dot com
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: [gentoo-user] Back up a server in real-time
2008-11-16 9:58 ` Alan McKinnon
@ 2008-11-16 10:31 ` William Kenworthy
2008-11-16 10:39 ` Alan McKinnon
0 siblings, 1 reply; 27+ messages in thread
From: William Kenworthy @ 2008-11-16 10:31 UTC (permalink / raw
To: gentoo-user
It actually does a very fast, space efficient backup management.
As for restore, each backup is effectively an uncompressed fully
accessible mirror image so you can manually copy/tar/... etc back for
the full system, or individual files. The developers basically say we
have a working backup system where you can restore using standard tools
if needed, but we'll make it easier when we can get around to it.
Having versioned backups can be REALLY handy at times. Space efficiency
typically stabilises at 2x archive size depending on delta.
Downside it can hammer a disk - reiserfs is fine but ext2/3 was flaky.
moriah ~ # esearch dirvish
[ Results for search key : dirvish ]
[ Applications found : 1 ]
* app-backup/dirvish
Latest version available: 1.2.1
Latest version installed: 1.2.1
Size of downloaded files: [no/bad digest]
Homepage: http://www.dirvish.org/
Description: Dirvish is a fast, disk based, rotating network
backup system.
License: OSL-2.0
Its worth a read on how its done - using smarts rather than brute force!
BillK
On Sun, 2008-11-16 at 11:58 +0200, Alan McKinnon wrote:
> On Sunday 16 November 2008 11:04:41 William Kenworthy wrote:
> > dirvish is in portage.
> >
> > tar/rsync/cp are not really backups but manual copies. If you want true
> > backup you need scripts to handle the extra functionality for things
> > like versioning, archive management and the all important restore.
> >
> > Dirvish is excellent on all but restore.
>
> Which raises the question:
>
> What's the point of it then?
>
> OTOH, it has to be better than legato. Nothing could be worse than legato.
>
>
--
William Kenworthy <billk@iinet.net.au>
Home in Perth!
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: [gentoo-user] Back up a server in real-time
2008-11-15 19:45 [gentoo-user] Back up a server in real-time Mick
` (5 preceding siblings ...)
2008-11-16 9:04 ` William Kenworthy
@ 2008-11-16 10:35 ` Dirk Heinrichs
2008-11-19 16:59 ` Mark Somerville
7 siblings, 0 replies; 27+ messages in thread
From: Dirk Heinrichs @ 2008-11-16 10:35 UTC (permalink / raw
To: gentoo-user
Am Samstag, 15. November 2008 20:45:04 schrieb Mick:
> Without gentoo-wiki my knowledge level is rather poor (just like my
> memory!)
>
> What would you use to back up a running server without taking it off line?
I guess I would use rsnapshot to backup to another disk/machine if I had only
a small number of machines to backup.
If the server is rather critical, or there more than a handfull of machines to
backup, I would think about a full featured backup suite like bacula.
Both can eventually combined with using LVM snapshots.
Bye...
Dirk
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: [gentoo-user] Back up a server in real-time
2008-11-16 10:31 ` William Kenworthy
@ 2008-11-16 10:39 ` Alan McKinnon
2008-11-16 12:36 ` William Kenworthy
0 siblings, 1 reply; 27+ messages in thread
From: Alan McKinnon @ 2008-11-16 10:39 UTC (permalink / raw
To: gentoo-user
On Sunday 16 November 2008 12:31:16 William Kenworthy wrote:
> * app-backup/dirvish
> Latest version available: 1.2.1
> Latest version installed: 1.2.1
> Size of downloaded files: [no/bad digest]
> Homepage: http://www.dirvish.org/
> Description: Dirvish is a fast, disk based, rotating network
> backup system.
> License: OSL-2.0
>
> Its worth a read on how its done - using smarts rather than brute force!
So the basic premise is that backups are done frequently and need to be
efficient, whereas restores are only done in the event of a mistake. Less
efficient restores is then a fair trade?
I see people get this wrong all the time at work. They assume that backups are
some sort of rapid shared storage system. Which of course it isn't.
--
alan dot mckinnon at gmail dot com
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: [gentoo-user] Back up a server in real-time
2008-11-16 9:54 ` Alan McKinnon
@ 2008-11-16 11:51 ` Mick
2008-11-16 13:08 ` Alan McKinnon
0 siblings, 1 reply; 27+ messages in thread
From: Mick @ 2008-11-16 11:51 UTC (permalink / raw
To: gentoo-user
[-- Attachment #1: Type: text/plain, Size: 1963 bytes --]
On Sunday 16 November 2008, Alan McKinnon wrote:
> On Sunday 16 November 2008 02:08:42 Mick wrote:
> > On Saturday 15 November 2008, Dale wrote:
> > > Mick wrote:
> > > > Without gentoo-wiki my knowledge level is rather poor (just like my
> > > > memory!)
> > > >
> > > > What would you use to back up a running server without taking it off
> > > > line?
> > >
> > > I keep mine simple, cp -auv paths/you/want/to/backup back/up/to It has
> > > works so far. Thought about doing a cron job but that complicates
> > > things. :/
> >
> > Thank you all for the suggestions and for the link to the wiki! I've got
> > some reading to do. ;-)
> >
> > Whenever I have used tar to back up a whole OS I used it with a LiveCD.
> > This was to make sure that files and their metadata were not being
> > changed while I was tar'ing them.
> >
> > Are you saying that I can actually fire up tar/rsync and back up in real
> > time?
>
> Yes. Unix does some RealSmartThings(tm) when using files. The name is just
> a pointer to the actual file, represented by an inode. Once you have an
> inode open, it stays open until everything using it closes it. So you can
> add/delete/copy/move files by name with impunity as you then just move
> names around. Contrast this with other inferior systems, like say Windows
> for example, which has a built-in self-destruct button when you try this...
Sure, but isn't there a problem with atime mtime metadata when you carry out a
backup in real time and then restore from it?
> > I was gravitating towards using LVM snapshot and then tar'ing that to an
> > external USB drive.
>
> This is the preferred way, as you get a consistent snapshot frozen at a
> point in time. This deals nicely with inconsistencies caused by files
> changing while you are backing up other ones.
Right, that's what I was thinking too. What does restoring from a backed up
snapshot involve?
--
Regards,
Mick
[-- Attachment #2: This is a digitally signed message part. --]
[-- Type: application/pgp-signature, Size: 197 bytes --]
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: [gentoo-user] Back up a server in real-time
2008-11-16 10:39 ` Alan McKinnon
@ 2008-11-16 12:36 ` William Kenworthy
2008-11-16 13:15 ` Alan McKinnon
0 siblings, 1 reply; 27+ messages in thread
From: William Kenworthy @ 2008-11-16 12:36 UTC (permalink / raw
To: gentoo-user
On Sun, 2008-11-16 at 12:39 +0200, Alan McKinnon wrote:
> On Sunday 16 November 2008 12:31:16 William Kenworthy wrote:
> > * app-backup/dirvish
> > Latest version available: 1.2.1
> > Latest version installed: 1.2.1
> > Size of downloaded files: [no/bad digest]
> > Homepage: http://www.dirvish.org/
> > Description: Dirvish is a fast, disk based, rotating network
> > backup system.
> > License: OSL-2.0
> >
> > Its worth a read on how its done - using smarts rather than brute force!
>
> So the basic premise is that backups are done frequently and need to be
> efficient, whereas restores are only done in the event of a mistake. Less
> efficient restores is then a fair trade?
>
> I see people get this wrong all the time at work. They assume that backups are
> some sort of rapid shared storage system. Which of course it isn't.
I wouldnt call it fair trade, rather "its working now and we'll make it
better it eventually."
I agree, backups should be just that - protection from mistakes/lost
data. However this is from someone who has the archives mounted via nfs
and can browse via filemanager an retrieve files that way via a desktop.
Currently I have my freeruner mobile phone, mythtv critical files and a
number of systems such as laptops backed up this way and its been very
reliable and useful, both as automatic/unattended and manually run.
Its neat in that you only need rsync and ssh (though its possible to use
rsh and the like) on the client. You only need dirvish on the server.
Starting to sound like a salesman for it! - but I have been very happy
with it. I used to use custom rsync scripts, different backup managers
and even tivoli backup at work. Dirvish is best for my usage.
BillK
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: [gentoo-user] Back up a server in real-time
2008-11-16 11:51 ` Mick
@ 2008-11-16 13:08 ` Alan McKinnon
0 siblings, 0 replies; 27+ messages in thread
From: Alan McKinnon @ 2008-11-16 13:08 UTC (permalink / raw
To: gentoo-user
On Sunday 16 November 2008 13:51:23 Mick wrote:
> > Yes. Unix does some RealSmartThings(tm) when using files. The name is
> > just a pointer to the actual file, represented by an inode. Once you have
> > an inode open, it stays open until everything using it closes it. So you
> > can add/delete/copy/move files by name with impunity as you then just
> > move names around. Contrast this with other inferior systems, like say
> > Windows for example, which has a built-in self-destruct button when you
> > try this...
>
> Sure, but isn't there a problem with atime mtime metadata when you carry
> out a backup in real time and then restore from it?
With a restore, you have really just two options:
- consider the file being restored to be a new file and set the *time to now
- consider it a full restore and set them the same as what's in the backup
root or the file's owner is permitted to do the latter
There's a third option which makes little sense: set the *time of the restored
file to be the same as whatever file it is repalcing on disk. But this is
mostly silly as the file data is now inconsistent with the recorded times
> > > I was gravitating towards using LVM snapshot and then tar'ing that to
> > > an external USB drive.
> >
> > This is the preferred way, as you get a consistent snapshot frozen at a
> > point in time. This deals nicely with inconsistencies caused by files
> > changing while you are backing up other ones.
>
> Right, that's what I was thinking too. What does restoring from a backed
> up snapshot involve?
The backup is just a backup, the fact that it was made from a frozen disk
snapshot is irrelevant. So you would restore it in the usual manner for the
backup format/method in use
--
alan dot mckinnon at gmail dot com
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: [gentoo-user] Back up a server in real-time
2008-11-16 12:36 ` William Kenworthy
@ 2008-11-16 13:15 ` Alan McKinnon
0 siblings, 0 replies; 27+ messages in thread
From: Alan McKinnon @ 2008-11-16 13:15 UTC (permalink / raw
To: gentoo-user
On Sunday 16 November 2008 14:36:22 William Kenworthy wrote:
> I wouldnt call it fair trade, rather "its working now and we'll make it
> better it eventually."
>
> I agree, backups should be just that - protection from mistakes/lost
> data. However this is from someone who has the archives mounted via nfs
> and can browse via filemanager an retrieve files that way via a desktop.
> Currently I have my freeruner mobile phone, mythtv critical files and a
> number of systems such as laptops backed up this way and its been very
> reliable and useful, both as automatic/unattended and manually run.
OK I see where you are coming from.
When you say backup/restore to me, I think in terms of what I'm used to -
massive tape archives holding many multi-TB of data for thousands of hosts.
What you are describing is indeed a backup, but in my world I'd probably call
it something else.
Perhaps I should have been more explicit and said "Disaster Recovery Archival
Backup" instead of "backup"... :-)
--
alan dot mckinnon at gmail dot com
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: [gentoo-user] Back up a server in real-time
2008-11-16 0:08 ` Mick
` (2 preceding siblings ...)
2008-11-16 9:54 ` Alan McKinnon
@ 2008-11-16 17:12 ` Jorge Peixoto de Morais Neto
3 siblings, 0 replies; 27+ messages in thread
From: Jorge Peixoto de Morais Neto @ 2008-11-16 17:12 UTC (permalink / raw
To: gentoo-user
On Sat, Nov 15, 2008 at 10:08 PM, Mick <michaelkintzios@gmail.com> wrote:
> On Saturday 15 November 2008, Dale wrote:
>> Mick wrote:
>> > Without gentoo-wiki my knowledge level is rather poor (just like my
>> > memory!)
>> >
>> > What would you use to back up a running server without taking it off
>> > line?
>>
>> I keep mine simple, cp -auv paths/you/want/to/backup back/up/to It has
>> works so far. Thought about doing a cron job but that complicates
>> things. :/
>
> Thank you all for the suggestions and for the link to the wiki! I've got some
> reading to do. ;-)
>
> Whenever I have used tar to back up a whole OS I used it with a LiveCD. This
> was to make sure that files and their metadata were not being changed while I
> was tar'ing them.
>
> Are you saying that I can actually fire up tar/rsync and back up in real time?
>
Please read tar's texinfo manual, at least the section
5 Performing Backups and Restoring Files
It is short, and nicely divided in subsections making it is easy to
select you need/want to read. Not like a man page, which for me is
useful as a reference but horrible at teaching how to use the program
(unless the program is quite simple).
--
Software is like sex: it is better when it is free - Linus Torvalds
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: [gentoo-user] Back up a server in real-time
2008-11-16 9:04 ` William Kenworthy
2008-11-16 9:36 ` Volker Armin Hemmann
2008-11-16 9:58 ` Alan McKinnon
@ 2008-11-17 16:07 ` Joerg Schilling
2008-11-30 22:56 ` Mick
2 siblings, 1 reply; 27+ messages in thread
From: Joerg Schilling @ 2008-11-17 16:07 UTC (permalink / raw
To: gentoo-user
William Kenworthy <billk@iinet.net.au> wrote:
> dirvish is in portage.
>
> tar/rsync/cp are not really backups but manual copies. If you want true
> backup you need scripts to handle the extra functionality for things
> like versioning, archive management and the all important restore.
star has everything you need for backups and it is based on the standard
archive format.
Jörg
--
EMail:joerg@schily.isdn.cs.tu-berlin.de (home) Jörg Schilling D-13353 Berlin
js@cs.tu-berlin.de (uni)
schilling@fokus.fraunhofer.de (work) Blog: http://schily.blogspot.com/
URL: http://cdrecord.berlios.de/private/ ftp://ftp.berlios.de/pub/schily
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: [gentoo-user] Back up a server in real-time
2008-11-15 19:45 [gentoo-user] Back up a server in real-time Mick
` (6 preceding siblings ...)
2008-11-16 10:35 ` Dirk Heinrichs
@ 2008-11-19 16:59 ` Mark Somerville
2008-11-19 17:15 ` [gentoo-user] " Harry Putnam
7 siblings, 1 reply; 27+ messages in thread
From: Mark Somerville @ 2008-11-19 16:59 UTC (permalink / raw
To: gentoo-user
[-- Attachment #1: Type: text/plain, Size: 293 bytes --]
On Sat, Nov 15, 2008 at 07:45:04PM +0000, Mick wrote:
> Without gentoo-wiki my knowledge level is rather poor (just like my memory!)
>
> What would you use to back up a running server without taking it off line?
I like rdiff-backup, which gives incremental backups over rsync.
Mark
[-- Attachment #2: Type: application/pgp-signature, Size: 197 bytes --]
^ permalink raw reply [flat|nested] 27+ messages in thread
* [gentoo-user] Re: Back up a server in real-time
2008-11-19 16:59 ` Mark Somerville
@ 2008-11-19 17:15 ` Harry Putnam
2008-11-20 7:15 ` Dirk Heinrichs
0 siblings, 1 reply; 27+ messages in thread
From: Harry Putnam @ 2008-11-19 17:15 UTC (permalink / raw
To: gentoo-user
Mark Somerville <mark@scottishclimbs.com> writes:
> On Sat, Nov 15, 2008 at 07:45:04PM +0000, Mick wrote:
>> Without gentoo-wiki my knowledge level is rather poor (just like my memory!)
>>
>> What would you use to back up a running server without taking it off line?
>
> I like rdiff-backup, which gives incremental backups over rsync.
I just started playing with rdiff-backup. If you are familiar with
rsnapshot maybe you'll know if rdiff-backup is better in some way.
I've been using rsnapshot for quite a while but haven't had to do a
serious restore (knock on wood).
The small scale restores I've needed seemed to be something of a pita.
I guess you have to search the rsnapshot created hardlinks for the
version you want manually. At least that is what I ended up doing.
There may be better ways but rsnapshot doesn't supply any help in that
regard far as I know. Other than the biggest part of having created
the file you need that is.
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: [gentoo-user] Re: Back up a server in real-time
2008-11-19 17:15 ` [gentoo-user] " Harry Putnam
@ 2008-11-20 7:15 ` Dirk Heinrichs
0 siblings, 0 replies; 27+ messages in thread
From: Dirk Heinrichs @ 2008-11-20 7:15 UTC (permalink / raw
To: gentoo-user
[-- Attachment #1: Type: text/plain, Size: 1314 bytes --]
Am Mittwoch 19 November 2008 18:15:01 schrieb ext Harry Putnam:
> I guess you have to search the rsnapshot created hardlinks for the
> version you want manually. At least that is what I ended up doing.
Yes, that's true. But although it may be a pain to search through it, it's
already a good step forward to even have that capability. AFAIK no traditional
backup system has content search capabilities. One can usually only tell it to
restore a set of files as of a specific date. You have to restore first, then
check the content and iterate that until you finally found the version you
want.
Now, with those rsync based backup tools, you get a plain copy of your data
somewhere, so you can reverse that process. You can search through it using
find/grep/awk/whatever (or even use one of those desktop search engines to
index the whole backup like you would do for your home directory) and then
restore exactly the version you want.
Bye...
Dirk
--
Dirk Heinrichs | Tel: +49 (0)162 234 3408
Configuration Manager | Fax: +49 (0)211 47068 111
Capgemini Deutschland | Mail: dirk.heinrichs@capgemini.com
Wanheimerstraße 68 | Web: http://www.capgemini.com
D-40468 Düsseldorf | ICQ#: 110037733
GPG Public Key C2E467BB | Keyserver: wwwkeys.pgp.net
[-- Attachment #2: This is a digitally signed message part. --]
[-- Type: application/pgp-signature, Size: 189 bytes --]
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: [gentoo-user] Back up a server in real-time
2008-11-17 16:07 ` Joerg Schilling
@ 2008-11-30 22:56 ` Mick
2008-11-30 23:04 ` Joerg Schilling
0 siblings, 1 reply; 27+ messages in thread
From: Mick @ 2008-11-30 22:56 UTC (permalink / raw
To: gentoo-user; +Cc: Joerg Schilling
[-- Attachment #1: Type: text/plain, Size: 710 bytes --]
On Monday 17 November 2008, Joerg Schilling wrote:
> William Kenworthy <billk@iinet.net.au> wrote:
> > dirvish is in portage.
> >
> > tar/rsync/cp are not really backups but manual copies. If you want true
> > backup you need scripts to handle the extra functionality for things
> > like versioning, archive management and the all important restore.
>
> star has everything you need for backups and it is based on the standard
> archive format.
Thanks Joerg, I have just had a quick look at star. Would you know if there
is a LiveCD that has star - or will I be able to restore a fs from an archive
created with star, but using tar to do it as it comes in e.g. Knoppix?
--
Regards,
Mick
[-- Attachment #2: This is a digitally signed message part. --]
[-- Type: application/pgp-signature, Size: 197 bytes --]
^ permalink raw reply [flat|nested] 27+ messages in thread
* Re: [gentoo-user] Back up a server in real-time
2008-11-30 22:56 ` Mick
@ 2008-11-30 23:04 ` Joerg Schilling
0 siblings, 0 replies; 27+ messages in thread
From: Joerg Schilling @ 2008-11-30 23:04 UTC (permalink / raw
To: michaelkintzios, gentoo-user
Mick <michaelkintzios@gmail.com> wrote:
> On Monday 17 November 2008, Joerg Schilling wrote:
> > William Kenworthy <billk@iinet.net.au> wrote:
> > > dirvish is in portage.
> > >
> > > tar/rsync/cp are not really backups but manual copies. If you want true
> > > backup you need scripts to handle the extra functionality for things
> > > like versioning, archive management and the all important restore.
> >
> > star has everything you need for backups and it is based on the standard
> > archive format.
>
> Thanks Joerg, I have just had a quick look at star. Would you know if there
> is a LiveCD that has star - or will I be able to restore a fs from an archive
> created with star, but using tar to do it as it comes in e.g. Knoppix?
Did you check grml?
Jörg
--
EMail:joerg@schily.isdn.cs.tu-berlin.de (home) Jörg Schilling D-13353 Berlin
js@cs.tu-berlin.de (uni)
schilling@fokus.fraunhofer.de (work) Blog: http://schily.blogspot.com/
URL: http://cdrecord.berlios.de/private/ ftp://ftp.berlios.de/pub/schily
^ permalink raw reply [flat|nested] 27+ messages in thread
end of thread, other threads:[~2008-11-30 23:04 UTC | newest]
Thread overview: 27+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2008-11-15 19:45 [gentoo-user] Back up a server in real-time Mick
2008-11-15 20:13 ` Volker Armin Hemmann
2008-11-15 20:23 ` Alan McKinnon
2008-11-15 20:29 ` Jerry McBride
2008-11-15 20:38 ` Dale
2008-11-16 0:08 ` Mick
2008-11-16 0:42 ` Dale
2008-11-16 2:58 ` Jerry McBride
2008-11-16 9:54 ` Alan McKinnon
2008-11-16 11:51 ` Mick
2008-11-16 13:08 ` Alan McKinnon
2008-11-16 17:12 ` Jorge Peixoto de Morais Neto
2008-11-16 5:16 ` jaeyoung lee
2008-11-16 9:04 ` William Kenworthy
2008-11-16 9:36 ` Volker Armin Hemmann
2008-11-16 9:58 ` Alan McKinnon
2008-11-16 10:31 ` William Kenworthy
2008-11-16 10:39 ` Alan McKinnon
2008-11-16 12:36 ` William Kenworthy
2008-11-16 13:15 ` Alan McKinnon
2008-11-17 16:07 ` Joerg Schilling
2008-11-30 22:56 ` Mick
2008-11-30 23:04 ` Joerg Schilling
2008-11-16 10:35 ` Dirk Heinrichs
2008-11-19 16:59 ` Mark Somerville
2008-11-19 17:15 ` [gentoo-user] " Harry Putnam
2008-11-20 7:15 ` Dirk Heinrichs
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox