[gentoo-user] Backups

[gentoo-user] Backups

[Allan Spagnol Comar]

Good day Gentoo List !!!

Some one knows where I can find some good material about backuping linux boxes ?

thanks, Allan

--
An application asked:
"Requeires Windows 9x, NT4 or better",
so I´ve installed Linux

-- 
gentoo-user@gentoo.org mailing list

Re: [gentoo-user] Backups

[brettholcomb]

There is a book covering backups that is supposed to be the Bible for backups.  Unfortunately, I am not where I can lay hands on it and can't remember the title.

> 
> From: Allan Spagnol Comar <allan.comar@gmail.com>
> Date: 2005/12/15 Thu AM 08:03:34 EST
> To: gentoo-user@lists.gentoo.org
> Subject: [gentoo-user] Backups
> 
> Good day Gentoo List !!!
> 
> Some one knows where I can find some good material about backuping linux boxes ?
> 
> thanks, Allan
> 
> --
> An application asked:
> "Requeires Windows 9x, NT4 or better",
> so I´ve installed Linux
> 
> -- 
> gentoo-user@gentoo.org mailing list
> 
> 

-- 
gentoo-user@gentoo.org mailing list

Re: [gentoo-user] Backups

[Richard Fish]

On 12/15/05, Allan Spagnol Comar <allan.comar@gmail.com> wrote:
> Some one knows where I can find some good material about backuping linux boxes ?

If you can give us some more details about what you are looking for
(number of boxes, backup device you want to use, whether you want
simple backup or archiving, etc), you can probably get some better
answers.

My personal favorite for my desktop and laptop is using 'dar' with big
USB hard drives....but that's what works well for me.

-Richard

-- 
gentoo-user@gentoo.org mailing list

Re: [gentoo-user] Backups

[John J. Foster]

[-- Attachment #1: Type: text/plain, Size: 245 bytes --]

On Thu, Dec 15, 2005 at 09:53:27AM -0700, Richard Fish wrote:
> 
> My personal favorite for my desktop and laptop is using 'dar' with big
> USB hard drives....but that's what works well for me.
> 
ditto - very easy, very efficient

John

[-- Attachment #2: Type: application/pgp-signature, Size: 189 bytes --]

Re: [gentoo-user] Backups

[Neil Bothwick]

[-- Attachment #1: Type: text/plain, Size: 688 bytes --]

On Thu, 15 Dec 2005 09:53:27 -0700, Richard Fish wrote:

> My personal favorite for my desktop and laptop is using 'dar' with big
> USB hard drives....but that's what works well for me.

I use rdiff-backup, which is ideal for backing up automatically to a
hard drive. I run it from cron, hourly on critical directories, daily on
the rest. I then have a weekly cron script that compresses the backup
directories with squashfs and writes them to ISO images ready for writing
to bootable DVDs. It makes restoring individual files very easy, and a
completely hosed system can be fixed because the DVDs are bootable.


-- 
Neil Bothwick

A day without sunshine is like night.

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 189 bytes --]

Re: [gentoo-user] Backups

[Richard Fish]

On 12/15/05, Neil Bothwick <neil@digimed.co.uk> wrote:
> completely hosed system can be fixed because the DVDs are bootable.

So are my USB hard disks.  Nothing against DVD backups though...I just
find them too slow and small for my needs...

-Richard

-- 
gentoo-user@gentoo.org mailing list

Re: [gentoo-user] Backups

[Allan Spagnol Comar]

Thanks all for the answers until now;

What i am looking for is to backup 3 servers, and a critical issue workstation.

I have a storage working with samba, so my bakups will go to this
samba server. I would like to make some diff bakups to save storage
space ....

:)

thanks again all of you....

got interested on backups on large USB disks too ...

On 12/15/05, Richard Fish <bigfish@asmallpond.org> wrote:
> On 12/15/05, Neil Bothwick <neil@digimed.co.uk> wrote:
> > completely hosed system can be fixed because the DVDs are bootable.
>
> So are my USB hard disks.  Nothing against DVD backups though...I just
> find them too slow and small for my needs...
>
> -Richard
>
> --
> gentoo-user@gentoo.org mailing list
>
>


--
An application asked:
"Requeires Windows 9x, NT4 or better",
so I´ve installed Linux

-- 
gentoo-user@gentoo.org mailing list

Re: [gentoo-user] Backups

[Neil Bothwick]

[-- Attachment #1: Type: text/plain, Size: 496 bytes --]

On Thu, 15 Dec 2005 13:04:38 -0700, Richard Fish wrote:

> > completely hosed system can be fixed because the DVDs are bootable.
> 
> So are my USB hard disks.  Nothing against DVD backups though...I just
> find them too slow and small for my needs...

A fair point, although it does make keeping spare, off-site backups
rather expensive :(

rdiff-backup should be excellent with a USB hard disk, I may give it a go.


-- 
Neil Bothwick

Jimi Hendrix's modem was a Purple Hayes.

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 189 bytes --]

Re: [gentoo-user] Backups

[Paweł Madej]

Allan Spagnol Comar wrote:
> Thanks all for the answers until now;
> 
> What i am looking for is to backup 3 servers, and a critical issue workstation.
> 
I think that you should test Bacula. that is very scalable app to backup 
from different sources to different media.

http://www.bacula.org

Greets
Pawel
-- 
gentoo-user@gentoo.org mailing list

Re: [gentoo-user] Backups

[Allan Spagnol Comar]

thanks.


On 12/16/05, Paweł Madej <linux@quanteam.info> wrote:
> Allan Spagnol Comar wrote:
> > Thanks all for the answers until now;
> >
> > What i am looking for is to backup 3 servers, and a critical issue workstation.
> >
> I think that you should test Bacula. that is very scalable app to backup
> from different sources to different media.
>
> http://www.bacula.org
>
> Greets
> Pawel
> --
> gentoo-user@gentoo.org mailing list
>
>


--
An application asked:
"Requeires Windows 9x, NT4 or better",
so I´ve installed Linux

-- 
gentoo-user@gentoo.org mailing list

RE: [gentoo-user] Backups

[Michael Kintzios]

> -----Original Message-----
> From: Neil Bothwick [mailto:neil@digimed.co.uk] 
> Sent: 15 December 2005 19:16
> To: gentoo-user@lists.gentoo.org
> Subject: Re: [gentoo-user] Backups
> 
> 
> On Thu, 15 Dec 2005 09:53:27 -0700, Richard Fish wrote:
> 
> > My personal favorite for my desktop and laptop is using 
> 'dar' with big
> > USB hard drives....but that's what works well for me.
> 
> I use rdiff-backup, which is ideal for backing up automatically to a
> hard drive. I run it from cron, hourly on critical 
> directories, daily on
> the rest. I then have a weekly cron script that compresses the backup
> directories with squashfs and writes them to ISO images ready 
> for writing
> to bootable DVDs. It makes restoring individual files very easy, and a
> completely hosed system can be fixed because the DVDs are bootable.

If you get a minute, a detailed wiki howto would be useful for some of
us.  :-)
-- 
Regards,
Mick

-- 
gentoo-user@gentoo.org mailing list

Re: [gentoo-user] Backups

[Neil Bothwick]

[-- Attachment #1: Type: text/plain, Size: 304 bytes --]

On Thu, 22 Dec 2005 14:26:56 -0000, Michael Kintzios wrote:

> If you get a minute, a detailed wiki howto would be useful for some of
> us.  :-)

A minute, where can I get one of those? Is it in portage? :-(


-- 
Neil Bothwick

Eagles may soar, but Wombles don't get sucked into jet engines

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 189 bytes --]

[gentoo-user] Backups

[Grant]

Do you back up anything other than /etc and /home on a standard system?

- Grant
-- 
gentoo-user@gentoo.org mailing list

Re: [gentoo-user] Backups

[Volker Armin Hemmann]

On Sonntag, 30. September 2007, Grant wrote:
> Do you back up anything other than /etc and /home on a standard system?
>
> - Grant

/var because with /var gone its complete-reinstall time.
-- 
gentoo-user@gentoo.org mailing list

Re: [gentoo-user] Backups

[Grant]

> > Do you back up anything other than /etc and /home on a standard system?
> >
> > - Grant
>
> /var because with /var gone its complete-reinstall time.

Do you back up hidden files and directories in the home directory?
There seems to be a lot of junk in there.  Does something like
'--exclude "/home/user/.*"' work with tar?

- Grant
-- 
gentoo-user@gentoo.org mailing list

Re: [gentoo-user] Backups

[Grant]

> > Do you back up anything other than /etc and /home on a standard system?
> >
> > - Grant
>
> /var because with /var gone its complete-reinstall time.

What about splitting tar.gz files across multiple CDs?  Can that be done?

- Grant
-- 
gentoo-user@gentoo.org mailing list

Re: [gentoo-user] Backups

[Albert Hopkins]

On Sat, 2007-09-29 at 15:26 -0700, Grant wrote:
> Do you back up anything other than /etc and /home on a standard
> system?

I pretty much back up everything that's not ubiquitous on the Internet
on a on an external drive. Disk space is so cheap these days so I figure
why not.

--
Albert W. Hopkins

-- 
gentoo-user@gentoo.org mailing list

Re: [gentoo-user] Backups

[Volker Armin Hemmann]

On Sonntag, 30. September 2007, Grant wrote:
> > > Do you back up anything other than /etc and /home on a standard system?
> > >
> > > - Grant
> >
> > /var because with /var gone its complete-reinstall time.
>
> Do you back up hidden files and directories in the home directory?

yes, they contain settings, pw, all the juicy stuff. I tar everything onto 
tape. 
tar -c -b 128 /home/energyman | mbuffer -m 400M -p 95 -s 65536 > /dev/st0


> There seems to be a lot of junk in there.  Does something like
> '--exclude "/home/user/.*"' work with tar?

don't know, never tried.

-- 
gentoo-user@gentoo.org mailing list

Re: [gentoo-user] Backups

[Volker Armin Hemmann]

On Sonntag, 30. September 2007, Grant wrote:
> > > Do you back up anything other than /etc and /home on a standard system?
> > >
> > > - Grant
> >
> > /var because with /var gone its complete-reinstall time.
>
> What about splitting tar.gz files across multiple CDs?  Can that be done?
>
> - Grant
man tar:
 -M, --multi-volume
 -L, --tape-length=
        



-- 
gentoo-user@gentoo.org mailing list

Re: [gentoo-user] Backups

[Kenneth Prugh]

[-- Attachment #1: Type: text/plain, Size: 340 bytes --]

On Sat, 29 Sep 2007 16:28:36 -0700
Grant <emailgrant@gmail.com> wrote:
> Does something like
> '--exclude "/home/user/.*"' work with tar?
> 
> - Grant

Yes you may exclude files from being included. From the tar man page:

--exclude PATTERN	exclude files based upon PATTERN

-X, --exclude-from FILE	exclude files listed in FILE

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 189 bytes --]

Re: [gentoo-user] Backups

[Steen Eugen Poulsen]

[-- Attachment #1: Type: text/plain, Size: 946 bytes --]

Grant skrev:
> Do you back up anything other than /etc and /home on a standard system?

In a Gentoo system nothing is really standard, so I backup everything
from / and then have a small exclude list with things like:

/dev, /proc, /sys, /exports, /var/cache/squid, /srv/BackupPC.


/var contains the most important files on a Gentoo system, if you loss
the portage installed software information your in a heap of trouble.
Goes both ways though backup of portages var information is less useful
without backup of everything installed.


I'm undecided about /usr/portage, I could save some time backing up
/usr/portage/distfiles, but it is easily generated content.



Minimal backup - if your willing to spend the hours on getting thing
back up and running.

/etc /root /home /usr/local /var

It's possible to make an exclude list for /var as it contains both
variable data thats important to save and dynamic data that will be
generated again.

[-- Attachment #2: S/MIME Cryptographic Signature --]
[-- Type: application/x-pkcs7-signature, Size: 3412 bytes --]

Re: [gentoo-user] Backups

[Mark Shields]

[-- Attachment #1: Type: text/plain, Size: 759 bytes --]

On 9/29/07, Grant <emailgrant@gmail.com> wrote:
>
> > > Do you back up anything other than /etc and /home on a standard
> system?
> > >
> > > - Grant
> >
> > /var because with /var gone its complete-reinstall time.
>
> What about splitting tar.gz files across multiple CDs?  Can that be done?
>
> - Grant
> --
> gentoo-user@gentoo.org mailing list
>
>
A lot of things you're asking for can be accomplished with a script I've
used (and successfully recovered with) called a stage 4 backup [1].  It's
just your standard bash script that uses tar, gzip, bzip2, etc. to create
manageable backups.  I have my server set to backup once a month (I don't
make significant changes to it very often).

[1] http://gentoo-wiki.com/HOWTO_Custom_Stage4

-- 
- Mark Shields

[-- Attachment #2: Type: text/html, Size: 1228 bytes --]

Re: [gentoo-user] Backups

[Alan McKinnon]

On Sunday 30 September 2007, Volker Armin Hemmann wrote:
> On Sonntag, 30. September 2007, Grant wrote:
> > Do you back up anything other than /etc and /home on a standard
> > system?
> >
> > - Grant
>
> /var because with /var gone its complete-reinstall time.

/usr/local too, otherwise you get to re-install everything in there as 
well

alan


-- 
Optimists say the glass is half full,
Pessimists say the glass is half empty,
Developers say wtf is the glass twice as big as it needs to be?

Alan McKinnon
alan at linuxholdings dot co dot za
+27 82, double three seven, one nine three five
-- 
gentoo-user@gentoo.org mailing list

Re: [gentoo-user] Backups

[Florian Philipp]

Steen Eugen Poulsen schrieb:
> Grant skrev:
>> Do you back up anything other than /etc and /home on a standard system?
> 
> In a Gentoo system nothing is really standard, so I backup everything
> from / and then have a small exclude list with things like:
> 
> /dev, /proc, /sys, /exports, /var/cache/squid, /srv/BackupPC.
> 
> 
> /var contains the most important files on a Gentoo system, if you loss
> the portage installed software information your in a heap of trouble.
> Goes both ways though backup of portages var information is less useful
> without backup of everything installed.
> 

I'd like to know which parts from /var are actually needed. Do we need 
anything more than /var/mail, /var/lib/portage/world and /var/log?

/var/db seems to contain data about installed packages but since we 
don't back up /usr (when doing a minimal backup) we have to reemerge 
everything and these data should be regenerated automatically, don't you 
think?

> 
> Minimal backup - if your willing to spend the hours on getting thing
> back up and running.
> 
> /etc /root /home /usr/local /var

I'd add /proc/config.gz to save the kernel config.
-- 
gentoo-user@gentoo.org mailing list

Re: [gentoo-user] Backups

[Grant]

> > Do you back up anything other than /etc and /home on a standard system?
>
> In a Gentoo system nothing is really standard, so I backup everything
> from / and then have a small exclude list with things like:
>
> /dev, /proc, /sys, /exports, /var/cache/squid, /srv/BackupPC.
>
>
> /var contains the most important files on a Gentoo system, if you loss
> the portage installed software information your in a heap of trouble.
> Goes both ways though backup of portages var information is less useful
> without backup of everything installed.
>
>
> I'm undecided about /usr/portage, I could save some time backing up
> /usr/portage/distfiles, but it is easily generated content.
>
>
>
> Minimal backup - if your willing to spend the hours on getting thing
> back up and running.
>
> /etc /root /home /usr/local /var

For now I think I'll do /etc, /root, /home, /var/lib/portage/world,
/usr/src/linux/.config, and anything specific I might need in
/usr/local.  What else am I missing out on in /var?  I'm OK with a
full reinstall for now.

- Grant
-- 
gentoo-user@gentoo.org mailing list

Re: [gentoo-user] Backups

[Grant]

> > > > Do you back up anything other than /etc and /home on a standard
> system?
> > > >
> > > > - Grant
> > >
> > > /var because with /var gone its complete-reinstall time.
> >
> > What about splitting tar.gz files across multiple CDs?  Can that be done?
> >
> > - Grant
> > --
> > gentoo-user@gentoo.org mailing list
> >
> >
>
> A lot of things you're asking for can be accomplished with a script I've
> used (and successfully recovered with) called a stage 4 backup [1].  It's
> just your standard bash script that uses tar, gzip, bzip2, etc. to create
> manageable backups.  I have my server set to backup once a month (I don't
> make significant changes to it very often).
>
> [1] http://gentoo-wiki.com/HOWTO_Custom_Stage4

That looks pretty slick.  That will have to be the next step.

- Grant
-- 
gentoo-user@gentoo.org mailing list

Re: [gentoo-user] Backups

[Grant]

> > > Do you back up anything other than /etc and /home on a standard system?
> >
> > In a Gentoo system nothing is really standard, so I backup everything
> > from / and then have a small exclude list with things like:
> >
> > /dev, /proc, /sys, /exports, /var/cache/squid, /srv/BackupPC.
> >
> >
> > /var contains the most important files on a Gentoo system, if you loss
> > the portage installed software information your in a heap of trouble.
> > Goes both ways though backup of portages var information is less useful
> > without backup of everything installed.
> >
> >
> > I'm undecided about /usr/portage, I could save some time backing up
> > /usr/portage/distfiles, but it is easily generated content.
> >
> >
> >
> > Minimal backup - if your willing to spend the hours on getting thing
> > back up and running.
> >
> > /etc /root /home /usr/local /var
>
> For now I think I'll do /etc, /root, /home, /var/lib/portage/world,
> /usr/src/linux/.config, and anything specific I might need in
> /usr/local.  What else am I missing out on in /var?  I'm OK with a
> full reinstall for now.
>
> - Grant

/boot/grub/grub.conf too.  Does anyone leave /boot mounted all the time?

- Grant
-- 
gentoo-user@gentoo.org mailing list

Re: [gentoo-user] Backups

[Dale]

[-- Attachment #1: Type: text/plain, Size: 1464 bytes --]

Grant wrote:
>>>> Do you back up anything other than /etc and /home on a standard system?
>>>>         
>>> In a Gentoo system nothing is really standard, so I backup everything
>>> from / and then have a small exclude list with things like:
>>>
>>> /dev, /proc, /sys, /exports, /var/cache/squid, /srv/BackupPC.
>>>
>>>
>>> /var contains the most important files on a Gentoo system, if you loss
>>> the portage installed software information your in a heap of trouble.
>>> Goes both ways though backup of portages var information is less useful
>>> without backup of everything installed.
>>>
>>>
>>> I'm undecided about /usr/portage, I could save some time backing up
>>> /usr/portage/distfiles, but it is easily generated content.
>>>
>>>
>>>
>>> Minimal backup - if your willing to spend the hours on getting thing
>>> back up and running.
>>>
>>> /etc /root /home /usr/local /var
>>>       
>> For now I think I'll do /etc, /root, /home, /var/lib/portage/world,
>> /usr/src/linux/.config, and anything specific I might need in
>> /usr/local.  What else am I missing out on in /var?  I'm OK with a
>> full reinstall for now.
>>
>> - Grant
>>     
>
> /boot/grub/grub.conf too.  Does anyone leave /boot mounted all the time?
>
> - Grant
>   

I do.  I'm on dial-up so even if they can catch me online, they can't
get anything big.  It's to slow to upload to them and just as slow to
send me something.  26K dial-up sucks but DSL is coming soon.

Dale

:-)  :-) 

[-- Attachment #2: Type: text/html, Size: 1969 bytes --]

Re: [gentoo-user] Backups

[Grant]

> > > Do you back up anything other than /etc and /home on a standard system?
> >
> > In a Gentoo system nothing is really standard, so I backup everything
> > from / and then have a small exclude list with things like:
> >
> > /dev, /proc, /sys, /exports, /var/cache/squid, /srv/BackupPC.
> >
> >
> > /var contains the most important files on a Gentoo system, if you loss
> > the portage installed software information your in a heap of trouble.
> > Goes both ways though backup of portages var information is less useful
> > without backup of everything installed.
> >
> >
> > I'm undecided about /usr/portage, I could save some time backing up
> > /usr/portage/distfiles, but it is easily generated content.
> >
> >
> >
> > Minimal backup - if your willing to spend the hours on getting thing
> > back up and running.
> >
> > /etc /root /home /usr/local /var
>
> For now I think I'll do /etc, /root, /home, /var/lib/portage/world,
> /usr/src/linux/.config, and anything specific I might need in
> /usr/local.  What else am I missing out on in /var?  I'm OK with a
> full reinstall for now.
>
> - Grant

Where do you guys store your backups?  Leaving backups on a DVD in the
same apartment as the machines doesn't make too much sense to me.
Maybe I should mail em to my parents every week or something?

- Grant
-- 
gentoo-user@gentoo.org mailing list

Re: [gentoo-user] Backups

[Florian Philipp]

Grant schrieb:
>>>> Do you back up anything other than /etc and /home on a standard system?
>>> In a Gentoo system nothing is really standard, so I backup everything
>>> from / and then have a small exclude list with things like:
>>>
>>> /dev, /proc, /sys, /exports, /var/cache/squid, /srv/BackupPC.
>>>
>>>
>>> /var contains the most important files on a Gentoo system, if you loss
>>> the portage installed software information your in a heap of trouble.
>>> Goes both ways though backup of portages var information is less useful
>>> without backup of everything installed.
>>>
>>>
>>> I'm undecided about /usr/portage, I could save some time backing up
>>> /usr/portage/distfiles, but it is easily generated content.
>>>
>>>
>>>
>>> Minimal backup - if your willing to spend the hours on getting thing
>>> back up and running.
>>>
>>> /etc /root /home /usr/local /var
>> For now I think I'll do /etc, /root, /home, /var/lib/portage/world,
>> /usr/src/linux/.config, and anything specific I might need in
>> /usr/local.  What else am I missing out on in /var?  I'm OK with a
>> full reinstall for now.
>>
>> - Grant
> 
> Where do you guys store your backups?  Leaving backups on a DVD in the
> same apartment as the machines doesn't make too much sense to me.
> Maybe I should mail em to my parents every week or something?
> 
> - Grant

I keep them on an USB-stick (udf filesystem, with the same settings like 
a CD-RW).

-- 
gentoo-user@gentoo.org mailing list

Re: [gentoo-user] Backups

[Grant]

> >>>> Do you back up anything other than /etc and /home on a standard system?
> >>> In a Gentoo system nothing is really standard, so I backup everything
> >>> from / and then have a small exclude list with things like:
> >>>
> >>> /dev, /proc, /sys, /exports, /var/cache/squid, /srv/BackupPC.
> >>>
> >>>
> >>> /var contains the most important files on a Gentoo system, if you loss
> >>> the portage installed software information your in a heap of trouble.
> >>> Goes both ways though backup of portages var information is less useful
> >>> without backup of everything installed.
> >>>
> >>>
> >>> I'm undecided about /usr/portage, I could save some time backing up
> >>> /usr/portage/distfiles, but it is easily generated content.
> >>>
> >>>
> >>>
> >>> Minimal backup - if your willing to spend the hours on getting thing
> >>> back up and running.
> >>>
> >>> /etc /root /home /usr/local /var
> >> For now I think I'll do /etc, /root, /home, /var/lib/portage/world,
> >> /usr/src/linux/.config, and anything specific I might need in
> >> /usr/local.  What else am I missing out on in /var?  I'm OK with a
> >> full reinstall for now.
> >>
> >> - Grant
> >
> > Where do you guys store your backups?  Leaving backups on a DVD in the
> > same apartment as the machines doesn't make too much sense to me.
> > Maybe I should mail em to my parents every week or something?
> >
> > - Grant
>
> I keep them on an USB-stick (udf filesystem, with the same settings like
> a CD-RW).

But where do you put the USB stick?  If my apartment building burns to
the ground while I'm away, I'll lose my systems and the backups.

- Grant
-- 
gentoo-user@gentoo.org mailing list

Re: [gentoo-user] Backups

[Christopher Copeland]

On 30 Sep 2007, at 12:33, Grant wrote:

> Where do you guys store your backups?  Leaving backups on a DVD in the
> same apartment as the machines doesn't make too much sense to me.
> Maybe I should mail em to my parents every week or something?
>
> - Grant

Offsite backups are a good idea if your data is important to you. I  
have several servers around the world so setting up rsync mirrors is  
pretty painless. Then I burn to DVD remotely.. (I have trained people  
enough so that when the tray opens they replace the DVD with a blank)

You might want to look at doing a stage 4 backup and then sending  
that file to one of those online storage services. A quick google  
shows there are many out there offering 2-25GB of free storage. There  
are some non-free services designed specifically for backup where you  
don't pay to upload but do pay when you want to get your data (which  
given it is a backup I assume you would be highly motivated to pay if  
a restore is required) A few months back I looked into Amazon's S3 to  
automate offsite storage of backups. I never implemented anything  
though.

I would encrypt anything sent to one of those online storage services.
--
Christopher
-- 
gentoo-user@gentoo.org mailing list

Re: [gentoo-user] Backups

[Alan McKinnon]

On Sunday 30 September 2007, Grant wrote:

> > I keep them on an USB-stick (udf filesystem, with the same settings
> > like a CD-RW).
>
> But where do you put the USB stick?  If my apartment building burns
> to the ground while I'm away, I'll lose my systems and the backups.

I can't believe you actually asked that. Think, man, think. 

Here's some ways to start:

Leave it at your mum's house where you have dinner every second day
Leave it at your girlfriend's house
Leave it in a safety box at the post office/your bank
Leave it at a friend's house
Leave it in the desk drawer at work
Hang it off your keyring so it's always on your person
Mail the data to your gmail account
Upload the data to your off-site web/ftp/whatever server
Store the backups in your car boot

alan

-- 
Optimists say the glass is half full,
Pessimists say the glass is half empty,
Developers say wtf is the glass twice as big as it needs to be?

Alan McKinnon
alan at linuxholdings dot co dot za
+27 82, double three seven, one nine three five
-- 
gentoo-user@gentoo.org mailing list

Re: [gentoo-user] Backups

[Grant]

> > Where do you guys store your backups?  Leaving backups on a DVD in the
> > same apartment as the machines doesn't make too much sense to me.
> > Maybe I should mail em to my parents every week or something?
> >
> > - Grant
>
> Offsite backups are a good idea if your data is important to you. I
> have several servers around the world so setting up rsync mirrors is
> pretty painless. Then I burn to DVD remotely.. (I have trained people
> enough so that when the tray opens they replace the DVD with a blank)
>
> You might want to look at doing a stage 4 backup and then sending
> that file to one of those online storage services. A quick google
> shows there are many out there offering 2-25GB of free storage. There
> are some non-free services designed specifically for backup where you
> don't pay to upload but do pay when you want to get your data (which
> given it is a backup I assume you would be highly motivated to pay if
> a restore is required) A few months back I looked into Amazon's S3 to
> automate offsite storage of backups. I never implemented anything
> though.
>
> I would encrypt anything sent to one of those online storage services.

Encryption yeah.  How do you encrypt your stuff?

- Grant
-- 
gentoo-user@gentoo.org mailing list

Re: [gentoo-user] Backups

[Grant]

> > > I keep them on an USB-stick (udf filesystem, with the same settings
> > > like a CD-RW).
> >
> > But where do you put the USB stick?  If my apartment building burns
> > to the ground while I'm away, I'll lose my systems and the backups.
>
> I can't believe you actually asked that. Think, man, think.

But hindsight is so much clearer than foresight.  Good suggestions BTW.

- Grant


> Here's some ways to start:
>
> Leave it at your mum's house where you have dinner every second day
> Leave it at your girlfriend's house
> Leave it in a safety box at the post office/your bank
> Leave it at a friend's house
> Leave it in the desk drawer at work
> Hang it off your keyring so it's always on your person
> Mail the data to your gmail account
> Upload the data to your off-site web/ftp/whatever server
> Store the backups in your car boot
>
> alan
-- 
gentoo-user@gentoo.org mailing list

Re: [gentoo-user] Backups

[Neil Bothwick]

[-- Attachment #1: Type: text/plain, Size: 378 bytes --]

Hello Grant,

> Where do you guys store your backups?  Leaving backups on a DVD in the
> same apartment as the machines doesn't make too much sense to me.
> Maybe I should mail em to my parents every week or something?

I use rsync.net, offsite backups using duplicity for GPG encryption.


-- 
Neil Bothwick

Anything is good and useful if it's made of chocolate.

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 189 bytes --]

Re: [gentoo-user] Backups

[Neil Bothwick]

[-- Attachment #1: Type: text/plain, Size: 358 bytes --]

Hello Grant,

> /boot/grub/grub.conf too.  Does anyone leave /boot mounted all the time?

Yes, mounted read-only. It avoids accidentally copying a new kernel
to /boot without mounting it. that's on the machines that have a
separate /boot, something I no longer bother with.


-- 
Neil Bothwick

Cross-country skiing is great in small countries.

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 189 bytes --]

Re: [gentoo-user] Backups

[Neil Bothwick]

[-- Attachment #1: Type: text/plain, Size: 357 bytes --]

Hello Grant,

> For now I think I'll do /etc, /root, /home, /var/lib/portage/world,
> /usr/src/linux/.config, and anything specific I might need in
> /usr/local.  What else am I missing out on in /var? 

Other data in /var/lib. For example, any databases kept in /var/lib/mysql.


-- 
Neil Bothwick

Every morning is the dawn of a new error...

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 189 bytes --]

Re: [gentoo-user] Backups

[Jerry McBride]

On Sunday 30 September 2007 12:31:51 pm Grant wrote:
> >  Do you back up anything other than /etc and /home on a standard system?

snip...

Just my two cents worth here. Often I find a need to generate a duplicate of 
an existing gentoo installation and to ease the build process I run this 
script via cron...

#!/bin/sh

rm  /portage.list/*.*

emerge -pe --color=n system > /portage.list/system.list
emerge -pe --color=n world  > /portage.list/world.list

Basicly it generates a list of installed ebuilds for both the system and world 
model.

In my normal backup routines I add /portage.list... A great way to help 
rebuild an exact duplicate of an existing gentoo box.

Cheers...

-- 


From the Desk of: Jerome D. McBride
--
gentoo-user@gentoo.org mailing list

Re: [gentoo-user] Backups

[Steve Dommett]

On Sunday 30 September 2007, Neil Bothwick wrote:
> Other data in /var/lib. For example, any databases kept in /var/lib/mysql.

Rather than backup MySQL's or Postgres' binary storage I prefer to use the 
relevant tool (mysqldump, pgdump[all]) to backup the database 
to /root/backups/ just prior to running the real backup job.  This has the 
advantage that you can generally restore onto any version of the database 
server, rather than the specific version that was running when the backup was 
taken.

I'm not 100% sure but I thought this method of dumping the database is the 
only way to guarantee consistency of the snapshot without having to stop the 
database server for the duration of the backup.  From what I understand when 
backing up a live database Postgres guarantees the consistency using MVCC but 
MySQL may be a little less careful if INSERTs/UPDATEs happen during the 
backup.  For keeping a hot-spare failover database server closely in sync 
with realtime changes I'd suggest Slony1.

Unless the database contains blobs I prefer to dump as plain text INSERTs and 
compress using gzip patched with --rsyncable support which leads me to...

After backing up the database I /always/ backup to a remote machine,  
sometimes two, using rdiff-backup.  It does point-in-time recovery and 
supports ACLs and xattr.  The backup is not in some odd file format; it's 
stored in a subfolder of your filesystem just like any other tree of files so 
it is instantly available.  A subfolder called rdiff-backup-data stores all 
the rollbacks and also all the acl/xattr/other metadata so the destination 
filesystem doesn't need to support them. There was even a GSoC project to 
provide a FUSE interface to mount the backup folder as it appeared at the 
time of some previous backup.  This is all /very/ nice for when used in 
combination with Linux-VServer.  With a little thought about XIDs you can 
start a backed-up VServer on your development box ;-)

This is the essence of what I run in a cron job on the machine needing to be 
backed up:
#!/bin/bash

#/root/backup_mysql.sh
#/root/backup_postgres.sh

mount /boot > /dev/null 2> /dev/null

rdiff-backup --force --remove-older-than 90d  \
 backups@backuphost::~/backups/myhostname/

echo "--------------------"

time rdiff-backup   \
 -v2 --print-statistics \
  --exclude /mnt \
  --exclude /media \
  --exclude /dev \
  --exclude /proc \
  --exclude /tmp \
  --exclude /var/tmp \
  --exclude /var/cache/squid/ \
  --exclude /var/cache/http-replicator/ \
  --exclude /var/lib/mysql/ \
  --exclude /var/lib/postgresql/data/base/ \
  --exclude /var/lib/postgresql/data/global/ \
  --exclude /var/lib/postgresql/data/pg_clog/ \
  --exclude /var/lib/postgresql/data/pg_subtrans/ \
  --exclude /var/lib/postgresql/data/pg_tblspc/ \
  --exclude /var/lib/postgresql/data/pg_xlog/ \
  --exclude /sys/ \
  --exclude /usr/portage/ \
  --exclude /usr/portage/distfiles \
 / backups@backuphost::~/backups/myhostname/

umount /boot > /dev/null 2> /dev/null
-- 
gentoo-user@gentoo.org mailing list

Re: [gentoo-user] Backups

[Neil Bothwick]

[-- Attachment #1: Type: text/plain, Size: 911 bytes --]

Hello Jerry McBride,

> Just my two cents worth here. Often I find a need to generate a
> duplicate of an existing gentoo installation and to ease the build
> process I run this script via cron...
> 
> #!/bin/sh
> 
> rm  /portage.list/*.*
> 
> emerge -pe --color=n system > /portage.list/system.list
> emerge -pe --color=n world  > /portage.list/world.list
> 
> Basicly it generates a list of installed ebuilds for both the system
> and world model.

Why not just backup the world list itself, /var/lib/portage/world? Your
method doesn't distinguish between packages in world and their
dependencies, emerging from this would result in a screwed world file.

The system list is contained in your profile, so you just need a note of
where /etc/make.profile points, which you will already have is you
backup /etc.


-- 
Neil Bothwick

If you smoke after sex, you're doing it too fast.

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 189 bytes --]

Re: [gentoo-user] Backups

[Jerry McBride]

On Sunday 30 September 2007 06:02:30 pm Neil Bothwick wrote:
> Hello Jerry McBride,
>
> > Just my two cents worth here. Often I find a need to generate a
> > duplicate of an existing gentoo installation and to ease the build
> > process I run this script via cron...
> >
> > #!/bin/sh
> >
> > rm  /portage.list/*.*
> >
> > emerge -pe --color=n system > /portage.list/system.list
> > emerge -pe --color=n world  > /portage.list/world.list
> >
> > Basicly it generates a list of installed ebuilds for both the system
> > and world model.
>
> Why not just backup the world list itself, /var/lib/portage/world? Your
> method doesn't distinguish between packages in world and their
> dependencies, emerging from this would result in a screwed world file.
>

It doesn't have too. The files I listed plus a backup of /etc is all you 
need...

> The system list is contained in your profile, so you just need a note of
> where /etc/make.profile points, which you will already have is you
> backup /etc.



-- 


From the Desk of: Jerome D. McBride
--
gentoo-user@gentoo.org mailing list

Re: [gentoo-user] Backups

[Neil Bothwick]

[-- Attachment #1: Type: text/plain, Size: 527 bytes --]

Hello Jerry McBride,

> > Why not just backup the world list itself, /var/lib/portage/world?
> > Your method doesn't distinguish between packages in world and their
> > dependencies, emerging from this would result in a screwed world file.

> It doesn't have too. The files I listed plus a backup of /etc is all
> you need...

So how do you create your world file? And why do you need a list of
system files when you have already backed up /etc?


-- 
Neil Bothwick

Top Oxymorons Number 37: Sanitary landfill

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 189 bytes --]

Re: [gentoo-user] Backups

[Dan Farrell]

On Sat, 29 Sep 2007 21:35:42 -0400
Kenneth Prugh <ken69267@gmail.com> wrote:

> On Sat, 29 Sep 2007 16:28:36 -0700
> Grant <emailgrant@gmail.com> wrote:
> > Does something like
> > '--exclude "/home/user/.*"' work with tar?
> > 
> > - Grant
> 
> Yes you may exclude files from being included. From the tar man page:
> 
> --exclude PATTERN	exclude files based upon PATTERN
> 
> -X, --exclude-from FILE	exclude files listed in FILE

However, don't exclude files you want, such as .bash*, .xsession, and
so on.  Generally these files aren't large and are important to the
private storage of uesr-specific info for many programs.  
-- 
gentoo-user@gentoo.org mailing list

Re: [gentoo-user] Backups

[Dan Farrell]

On Sun, 30 Sep 2007 20:15:04 +0100
Neil Bothwick <neil@digimed.co.uk> wrote:

> Hello Grant,
> 
> > For now I think I'll do /etc, /root, /home, /var/lib/portage/world,
> > /usr/src/linux/.config, and anything specific I might need in
> > /usr/local.  What else am I missing out on in /var? 
> 
> Other data in /var/lib. For example, any databases kept
> in /var/lib/mysql.
> 
> 
BIND, Apache, various mailing programs, at, Xauth, logs if you want to
know what happened on a particular computer six months from now (hard
to foresee this kind of thing).  I think you can clear out /var/tmp if
you wish.  Also many of the logs can be cleared and such.  After
clearing all the data you don't need (be careful; some data is
important to portage), you shouldn't have too much more than a few
hundred megs, pretty much all highly compressable text.  

-- 
gentoo-user@gentoo.org mailing list

Re: [gentoo-user] Backups

[Dan Farrell]

On Sat, 29 Sep 2007 15:26:07 -0700
Grant <emailgrant@gmail.com> wrote:

> Do you back up anything other than /etc and /home on a standard
> system?
> 
> - Grant

Don't forget to back up stuff that can help you rebuild the system
quickly.  Like /proc/config.gz, or better yet just the kernel and
modules you need so you don't have to rebuild at all or generate the
sources.

Another thing that I think is highly valuable to back up, and very
often ignored, is the output of 'fdisk -l'.  If your drive dies it's
very nice to have a reminder of how it was formatted.  

-- 
gentoo-user@gentoo.org mailing list

Re: [gentoo-user] Backups

[Mark Kirkwood]

Dan Farrell wrote:
> On Sat, 29 Sep 2007 15:26:07 -0700
> Grant <emailgrant@gmail.com> wrote:
>
>   
>> Do you back up anything other than /etc and /home on a standard
>> system?
>>
>> - Grant
>>     
>
> Don't forget to back up stuff that can help you rebuild the system
> quickly.  Like /proc/config.gz, or better yet just the kernel and
> modules you need so you don't have to rebuild at all or generate the
> sources.
>
> Another thing that I think is highly valuable to back up, and very
> often ignored, is the output of 'fdisk -l'.  If your drive dies it's
> very nice to have a reminder of how it was formatted.  
>
>   
In order to be able to restore a system (relatively) quickly, I use the 
appropriate fs dump tool (xfsdump in my case) to make level 0 backups of 
/boot, / , /usr, /var after a major configuration change (e.g emerge 
--sync;emerge -u world), along with output from df -m. This does not 
take too long (/usr does take a while), but really speeds up a restore 
(I have sufficient packages installed to make an emerge world take > 10 
hours).

For a modern server with minimal software actually installed, the time 
aspect for this method may not be too different from an install from 
scratch, but it also guarantees that the restored system is the same as 
it was before (modulo last backup obviously), which can save a lot of time!

Cheers

Mark

P.s : Actually rebuilding from these saved dumps requires a little 
thought - I'll post the steps if anyone new to dumps is interested in 
using this method  for themselves.
-- 
gentoo-user@gentoo.org mailing list

[gentoo-user] Re: Backups

[Francesco Talamona]

On Monday 01 October 2007, Mark Kirkwood wrote:
> P.s : Actually rebuilding from these saved dumps requires a little
> thought - I'll post the steps if anyone new to dumps is interested in
> using this method  for themselves.

Yes, please.
I'm not completely new to dump, but I'd like to read about a complete 
dump-backup solution.

Ciao
	Francesco

-- 
Linux Version 2.6.22-gentoo-r8, Compiled #1 PREEMPT Fri Sep 28 19:41:21 
CEST 2007
One 1GHz AMD Athlon 64 Processor, 2GB RAM, 2003.99 Bogomips Total
aemaeth
-- 
gentoo-user@gentoo.org mailing list

Re: [gentoo-user] Re: Backups

[Jason Messerschmitt]

On Mon, 1 Oct 2007 18:43:41 +0200
Francesco Talamona <ti.liame@email.it> wrote:

> On Monday 01 October 2007, Mark Kirkwood wrote:
> > P.s : Actually rebuilding from these saved dumps requires a little
> > thought - I'll post the steps if anyone new to dumps is interested
> > in using this method  for themselves.
> 
> Yes, please.
> I'm not completely new to dump, but I'd like to read about a complete 
> dump-backup solution.
> 
> Ciao
> 	Francesco
> 

I've been listening in and I too would be interested in this.

-jason
--
gentoo-user@gentoo.org mailing list

Re: [gentoo-user] Re: Backups

[Mark Kirkwood]

[-- Attachment #1: Type: text/plain, Size: 949 bytes --]

Francesco Talamona wrote:
> Yes, please.
> I'm not completely new to dump, but I'd like to read about a complete 
> dump-backup solution.
>
> Ciao
> 	Francesco
>
>   

Well - its not complete by any stretch of the imagination... but the 
attached (hopefully not striped off by the mailing list software) is a 
very brief discussion of how to do a minimal backup/restore using 
xfsdump. Note that user data is *not* explicitly covered - even tho 
there is no reason it cannot be backed up this way too! In addition it 
does not cover incremental or cumulative backup variations - again no 
reason why this cannot be used, but for a quick and simple *system* 
restore, I find using only full (i.e level 0) dumps  helps avoid admin 
(i.e me making) mistakes.

It's worth noting that the essential logic is simply:
- dump system filesystems
- save xfsrestore binaries as a package

- boot livecd
- install xfsrestore binaries somewhere
- restore dumps


[-- Attachment #2: backup.notes --]
[-- Type: text/plain, Size: 2637 bytes --]

Backup and Restore System
=========================

This is a quick guide for backing up and restoring xfs dilesystems using xfsdump/xfsrestore. It should be relatively simple to apply the ideas for other 
filesystems dump tools (e.g. dumpe2fs for ext2/3).

Backup
------

1. Dump filesystems:

$ cd /data0/backup
$ xfsdump -L boot-0 -M backup1 -l0 -f boot-0.dmp /boot
$ xfsdump -L root-0 -M backup1 -l0 -f .root.0.dmp /
$ xfsdump -L var-0 -M backup1 -l0 -f var-0.dmp /var
$ xfsdump -L usr-0 -M backup1 -l0 -f usr-0.dmp /usr


2. Package dump program

$ quickpkg xfsdump
$ cp /usr/portage/packages/All/xfsdump-2.2.45.tbz2 /data0/backup


3. Record filesystem layout

$ df -m > df.out


4. Save the dumps and packages

Copy to DVD or another machine...


Restore
-------

1. Boot from the live cd

We are assuming that we are completely rebuilding the system, or are making
another one (initially) identical to the backed-up one.


2. Partition drives and create empty filesystems etc if required

$ mkfs.xfs /dev/sda1
$ mkswap /dev/sda2
$ mkfs.xfs /dev/sda3
$ mkfs.xfs /dev/sda4
$ mkfs.xfs /dev/sda6


3. Retrieve backup dump and package files from DVD or other machine

May require 2 DVDROMS (or 1 DVDROM and 1 CDROM) - one for live cd, one for 
backup data.


4. Install dump program if it is not already on the live cd

Xfsdump is *not* on the live cd. You need to choose a partition you are not 
using yet and create a filesystem on it, install xfsrestore there and amend the
system path to see it. (or add another tmpfs filesystem).


$ mkfs.xfs  /dev/sda9
$ mkdir /xfsrestore
$ mount /dev/sda9 /xfsrestore
$ cd /xfsrestore
$ tar -jxvf  xfsdump-2.2.45.tbz2
$ cd usr/bin
$ rm xfsdump xfsrestore
$ ln -s /xfsrestore/sbin/xfsdump xfsdump
$ ln -s /xfsrestore/sbin/xfsrestore xfsrestore
$ export PATH=$PATH:/xfsrestore/sbin:/xfsrestore/usr/bin


5. Restore dumps

Use the contents of df.out to figure out which dump should be restored on which device! then temporily mount each filesystem and restore it.

$ mount /dev/sda3 /mnt2
$ xfsrestore -f /mnt/cdrom/root.0.dump  /mnt2

Now root is restored we can mount the other empty filesystems and restore them.

$ mount /dev/sda1 /mnt2/boot
$ xfsrestore -f /mnt/cdrom/boot.0.dump  /mnt2/boot
$ mount /dev/sda4 /mnt2/var
$ xfsrestore -f /mnt/cdrom/var.0.dump  /mnt2/var
$ mount /dev/sda6 /mnt2/usr
$ xfsrestore -f /mnt/cdrom/usr.0.dump  /mnt2/usr


6. Chroot, (re)install bootloader and reboot


7. Notes

Obviously you can backup user data this may too (i.e /home), altho other 
methods might be simpler (mind you most dump tools let you do incremental and 
cumulative relatively simply).

[gentoo-user] Re: Backups

[Francesco Talamona]

On Tuesday 02 October 2007, Mark Kirkwood wrote:
> $ mkfs.xfs  /dev/sda9
> $ mkdir /xfsrestore
> $ mount /dev/sda9 /xfsrestore
> $ cd /xfsrestore
> $ tar -jxvf  xfsdump-2.2.45.tbz2
> $ cd usr/bin
> $ rm xfsdump xfsrestore
> $ ln -s /xfsrestore/sbin/xfsdump xfsdump
> $ ln -s /xfsrestore/sbin/xfsrestore xfsrestore
> $ export PATH=$PATH:/xfsrestore/sbin:/xfsrestore/usr/bin
>
>
> 5. Restore dumps
>
> Use the contents of df.out to figure out which dump should be
> restored on which device! then temporily mount each filesystem and
> restore it.

First of all, thanks for sharing.

I used to think xfs was overkill for /boot, but the procedure described 
is quite straightforward.

There are two things I don't understand:

1) why do you delete xfsdump and xfsrestore in /xfsrestore/usr/bin/ just 
extracted to link them to /xfsrestore/sbin

2) the use of df.out isn't clear to me, isn't the dump file name enough 
to know what is in there?

Ciao
	Francesco
 
-- 
Linux Version 2.6.22-gentoo-r8, Compiled #1 PREEMPT Fri Sep 28 19:41:21 
CEST 2007
One 1GHz AMD Athlon 64 Processor, 2GB RAM, 2003.99 Bogomips Total
aemaeth
-- 
gentoo-user@gentoo.org mailing list

Re: [gentoo-user] Re: Backups

[Mark Kirkwood]

Francesco Talamona wrote:
>
> First of all, thanks for sharing.
>
> I used to think xfs was overkill for /boot, but the procedure described 
> is quite straightforward.
>
> There are two things I don't understand:
>
> 1) why do you delete xfsdump and xfsrestore in /xfsrestore/usr/bin/ just 
> extracted to link them to /xfsrestore/sbin
>
> 2) the use of df.out isn't clear to me, isn't the dump file name enough 
> to know what is in there?
>   

1) The symlinks are broken if the package is extracted anywhere other 
than /. I recreated 'em to point where they should (I recall they were 
needed, as some of the ancillary programs break if they are missing or 
broken).

2) The df.out is so you know that (say) usr.0.dmp should be restored to 
a device called (say) /dev/sda6. This will avoid the  need to edit 
restored /etc/fstab (or the need to boot into single user mode and fix 
it). the other point is if you are reusing the same disk setup (assuming 
a software issue is requiring the restore), then checking df.out ensures 
that you recover the system using the same partitions for the 
filesystems as you had pre-restore.

Cheers

Mark

P.s: You are quite correct that xfs is overkill for /boot. However I 
just found it easier to xfs everything (otherwise I'd have to use 
different dump programs depending on what I was backing up etc... ). To 
me this is more important than the fact that it wastes disk space a bit 
(my /boot uses a 128M partition but only gets 93M to actually use...and 
it uses 11M of that! - but disks are quite big now...)
-- 
gentoo-user@gentoo.org mailing list

[gentoo-user] Re: Backups

[Francesco Talamona]

> P.s: You are quite correct that xfs is overkill for /boot. However I
> just found it easier to xfs everything (otherwise I'd have to use
> different dump programs depending on what I was backing up etc... ).
> To me this is more important than the fact that it wastes disk space
> a bit (my /boot uses a 128M partition but only gets 93M to actually
> use...and it uses 11M of that! - but disks are quite big now...)

Now everything makes sense. I definitely learned something new.

Ciao
	Francesco
-- 
Linux Version 2.6.22-gentoo-r8, Compiled #1 PREEMPT Fri Sep 28 19:41:21 
CEST 2007
One 2.2GHz AMD Athlon 64 Processor, 2GB RAM, 4408.87 Bogomips Total
aemaeth
-- 
gentoo-user@gentoo.org mailing list

Re: [gentoo-user] Backups

[Matthias Bethke]

[-- Attachment #1: Type: text/plain, Size: 649 bytes --]

Hi Grant,
on Saturday, 2007-09-29 at 16:28:36, you wrote:
> Do you back up hidden files and directories in the home directory?
> There seems to be a lot of junk in there.  Does something like
> '--exclude "/home/user/.*"' work with tar?

It certainly does, but I'm quite sure it's not what you want. For me at
least losing all my carefully customized stuff in .mutt, .gnupg,
.bashrc, .vim etc. would suck asinine reproductive glands.
It's usually all text anyway that compresses very well.

cheers,
	Matthias
-- 
I prefer encrypted and signed messages. KeyID: FAC37665
Fingerprint: 8C16 3F0A A6FC DF0D 19B0  8DEF 48D9 1700 FAC3 7665

[-- Attachment #2: Type: application/pgp-signature, Size: 189 bytes --]

Re: [gentoo-user] Backups

[Joost Roeleveld]

On Sunday 30 September 2007 01:45:41 Grant wrote:
> > > Do you back up anything other than /etc and /home on a standard system?
> > >
> > > - Grant
> >
> > /var because with /var gone its complete-reinstall time.
>
> What about splitting tar.gz files across multiple CDs?  Can that be done?
>
> - Grant

You might also want to have a look at "dar", it will alow you to specify the 
size of every file (and even have a different size for the first file, 
usefull if you want to put a linux rescue install on the first cd)

--
Joost
-- 
gentoo-user@gentoo.org mailing list

[gentoo-user] Backups...

[BRM]

Well, now that I've got my systems cleaned up, and KDE3 removed, I'm tackling another project I've been meaning to do - backups.

Here's my basic plan:
- I've got a directory on my server that I want to synchronize several systems with (some linux, and one Windows).
- I want clients to push the backup; and not the server to pull it.
- Clients may backup more than once a month.
- the server will receive an additional backup itself once a month which includes all the client backups (may be more often, not sure).

At least on the Linux Systems, I've settled to using rsync for the backup - easy enough to do. I'm already running an rsync server for hosting portage, so it's relatively trivial to add another rsync module to support that way, though I'm not sure what the best way is.

rsync in attractive since it will do delta transfers to keep things in sync; though if I could use scp the same way I probably would since I would just have to setup appropriate keys.

Any how...I setup the rsync daemon with a read-write section. Tested it, and it worked. But I'd really like to have it secured - I don't want anyone to be able to read/write to it. So I tried adding the following:

[backup]
     uid = <backup user>
        gid = <backup group>
     path = /path/to/backup/repo
     read only = false
     list = false
     auth users = <user>
     secrets file = /path/to/rsyncd.secrets

The rsyncd.secrets is simple:
<user>:<8 digit password>

If I don't have the last two lines (e.g. auth user, secrets file) then I can write to it.
Otherwise I get an authentication error:

@ERROR: auth failed on module backup
rsync error: error starting client-server protocol (code 5) at main.c(1503) [sender=3.0.6]

I'm uploading via:

rsync -a --password-file=rsync.passwd someTestFile rsync://<user>@host/backup/extra/path/

rsync.passwd contains the same <8 digit password>, nothing else.


I've already checked file permissions - the entire directory structure under /path/to/backup/repo is owned by <backup user>:<backup group>.

What am I doing wrong?
Is there a better approach?

TIA,

Ben

Re: [gentoo-user] BACKUPS

[Joseph]

On 09/10/14 06:10, Kerin Millar wrote:
[snip]

>>> I just extracted the files with "tar..."
>>
>> I read your forum post and can see that you're (dangerously) extracting
>> directly into the root directory and that this is among the contents of
>> the archive:
>>
>>    ./usr/lib/
>>    ./usr/lib/libbrcomplpr2.so
>>
>> I posit that tar clobbers the /usr/lib symlink, converting it into a
>> directory because that is what is stored in the archive.
>>
>> Ergo, use the --keep-directory-symlink parameter.
>
>Excuse the fact that I am replying to myself, but I must also stress
>that the library does not belong in lib64. On a 64-bit system, you
>should adapt your process so that the library ends up residing in lib32,
>not lib64 (by way of the lib symlink). The software will not be able to
>function correctly otherwise.
>
>--Kerin

Thank you again. 
On a different subject.  Do you have a good pointer on how to backup a system.
I just had a HD crash so I selected a replacement SSD and I'm re installing the software.
I had backup of /etc/ and /home but I've missed all other settings eg:
/boot/ kernel config and other files and are not in /etc directory like: hylafax setting etc.

Is there a way to keep backup of all those configuration files that are manually edited?

-- 
Joseph

Re: [gentoo-user] BACKUPS

[Alan McKinnon]

On 10/09/2014 07:32, Joseph wrote:
> Thank you again. On a different subject.  Do you have a good pointer on
> how to backup a system.


Did it even occur to you at all to type that exact question into a
search engine and see what comes back?

Come on dude, we aren't here to do ALL your thinking for you.

-- 
Alan McKinnon
alan.mckinnon@gmail.com

Re: [gentoo-user] BACKUPS

[Dale]

Alan McKinnon wrote:
> On 10/09/2014 07:32, Joseph wrote:
>> Thank you again. On a different subject.  Do you have a good pointer on
>> how to backup a system.
>
> Did it even occur to you at all to type that exact question into a
> search engine and see what comes back?
>
> Come on dude, we aren't here to do ALL your thinking for you.
>


Even easier,

eix backup

  ;-)

Dale

:-)  :-) 

Re: [gentoo-user] BACKUPS

[J. Roeleveld]

[-- Attachment #1: Type: text/plain, Size: 694 bytes --]


On Wednesday, September 10, 2014 02:47:26 AM Dale wrote:
> Alan McKinnon wrote:
> > On 10/09/2014 07:32, Joseph wrote:
> >> Thank you again. On a different subject.  Do you have a good pointer 
on
> >> how to backup a system.
> > 
> > Did it even occur to you at all to type that exact question into a
> > search engine and see what comes back?
> > 
> > Come on dude, we aren't here to do ALL your thinking for you.
> 
> Even easier,
> 
> eix backup

That only returns 18 packages and you're missing most of the ones in app-
backup/.

Try:
eix app-backup/

That gives you 44 to choose from.

Alternatively, copy every file to a usb-disk and manually confirm they are all 
identical?

--
Joost

[-- Attachment #2: Type: text/html, Size: 4980 bytes --]

Re: [gentoo-user] BACKUPS

[Dale]

[-- Attachment #1: Type: text/plain, Size: 1322 bytes --]

J. Roeleveld wrote:
>
>  
>
> On Wednesday, September 10, 2014 02:47:26 AM Dale wrote:
>
> > Alan McKinnon wrote:
>
> > > On 10/09/2014 07:32, Joseph wrote:
>
> > >> Thank you again. On a different subject. Do you have a good
> pointer on
>
> > >> how to backup a system.
>
> > >
>
> > > Did it even occur to you at all to type that exact question into a
>
> > > search engine and see what comes back?
>
> > >
>
> > > Come on dude, we aren't here to do ALL your thinking for you.
>
> >
>
> > Even easier,
>
> >
>
> > eix backup
>
>  
>
> That only returns 18 packages and you're missing most of the ones in
> app-backup/.
>
>  
>
> Try:
>
> eix app-backup/
>
>  
>
> That gives you 44 to choose from.
>
>  
>
> Alternatively, copy every file to a usb-disk and manually confirm they
> are all identical?
>
>  
>
> --
>
> Joost
>


Well, I first used eix backup.  My thinking was this, if one searches
first for something with "backup" in it, they should notice a lot of
apps in the app-backup category even tho they might not know it existed
before that.  At that point, pot of gold with this:

eix app-backup/*

Thing is, he may not have eix installed.  :/ 

Either way works tho.  :-D 

Me, I just use rsync and call it a day. 

Dale

:-)  :-)

[-- Attachment #2: Type: text/html, Size: 6262 bytes --]

Re: [gentoo-user] BACKUPS

[Neil Bothwick]

[-- Attachment #1: Type: text/plain, Size: 526 bytes --]

On Wed, 10 Sep 2014 09:14:43 +0200, Alan McKinnon wrote:

> > Thank you again. On a different subject.  Do you have a good pointer
> > on how to backup a system.  
> 
> Did it even occur to you at all to type that exact question into a
> search engine and see what comes back?

And if you then need to ask a question on a different subject, please
start a new thread. It's still thread-jacking if the thread you hijack is
one you started.


-- 
Neil Bothwick

I am Flatulus of Borg.  You will be asphixiated.

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 181 bytes --]

Re: [gentoo-user] BACKUPS

[Alan McKinnon]

On 10/09/2014 10:03, Dale wrote:
> J. Roeleveld wrote:
>>
>>  
>>
>> On Wednesday, September 10, 2014 02:47:26 AM Dale wrote:
>>
>> > Alan McKinnon wrote:
>>
>> > > On 10/09/2014 07:32, Joseph wrote:
>>
>> > >> Thank you again. On a different subject. Do you have a good
>> pointer on
>>
>> > >> how to backup a system.
>>
>> > >
>>
>> > > Did it even occur to you at all to type that exact question into a
>>
>> > > search engine and see what comes back?
>>
>> > >
>>
>> > > Come on dude, we aren't here to do ALL your thinking for you.
>>
>> >
>>
>> > Even easier,
>>
>> >
>>
>> > eix backup
>>
>>  
>>
>> That only returns 18 packages and you're missing most of the ones in
>> app-backup/.
>>
>>  
>>
>> Try:
>>
>> eix app-backup/
>>
>>  
>>
>> That gives you 44 to choose from.
>>
>>  
>>
>> Alternatively, copy every file to a usb-disk and manually confirm they
>> are all identical?
>>
>>  
>>
>> --
>>
>> Joost
>>
> 
> 
> Well, I first used eix backup.  My thinking was this, if one searches
> first for something with "backup" in it, they should notice a lot of
> apps in the app-backup category even tho they might not know it existed
> before that.  At that point, pot of gold with this:
> 
> eix app-backup/*
> 
> Thing is, he may not have eix installed.  :/ 



that's why we have emerge -s


:-)



> 
> Either way works tho.  :-D 
> 
> Me, I just use rsync and call it a day. 
> 
> Dale
> 
> :-)  :-)


-- 
Alan McKinnon
alan.mckinnon@gmail.com

Re: [gentoo-user] BACKUPS

[Kerin Millar]

On 10/09/2014 06:32, Joseph wrote:
> On 09/10/14 06:10, Kerin Millar wrote:

<snip>

> Thank you again. On a different subject.  Do you have a good pointer on
> how to backup a system.
> I just had a HD crash so I selected a replacement SSD and I'm re
> installing the software.
> I had backup of /etc/ and /home but I've missed all other settings eg:
> /boot/ kernel config and other files and are not in /etc directory like:
> hylafax setting etc.
>
> Is there a way to keep backup of all those configuration files that are
> manually edited?

As suggested by Neil, please begin a new thread.

--Kerin