next »

[jitspoe]

I need a good way to make automated backups of the EV1 server I'm leasing, since it will be hosting the global login system, the forums, and various other things that change constantly.  I'll probably do them weekly.  Maybe daily if there's not too much overhead.  Any recommendations?

[XtremeBain]

-Weekly full backups
-Daily incremental backups

Have the backups gzip or bzip2'd into split pieces and generate parity files.
scp or sftp'd offsite, or get some storage at EV1 ($10/mo for 10GB, $20/mo for 20GB, etc.)

[jitspoe]

EV1 is where the current server is.  I'd rather not put all my eggs in one basket.  I'd actually prefer to have it sent directly to my own PC, so I'll have a copy even if the Internet explodes.   I assume there's something I could set up on Windows that I could scp to from a Linux server, right?

Incremental updates are a good idea -- just run a diff against the last full backup?  Are there any tools already made for this, or would I have to script it all myself?

[KnacK]

Jitspoe:

Do what bain said, but take it a step further. When you do the backups, make the chunks 2 meg in size ( easy to handle). Then have the server email the backups to a gmail account.  Now you have almost 3 gig of space that is not on an EV1 server or their farm.

[jitspoe]

Given recent circumstances, I don't know that I want to be sending out large amounts of data through email.

[Smokey]

EV1 is where the current server is.  I'd rather not put all my eggs in one basket.  I'd actually prefer to have it sent directly to my own PC, so I'll have a copy even if the Internet explodes.   I assume there's something I could set up on Windows that I could scp to from a Linux server, right?

Incremental updates are a good idea -- just run a diff against the last full backup?  Are there any tools already made for this, or would I have to script it all myself?

First of, tubes don't "explode" they implode.

Um, i have no idea how else to do it, other than what everyone else has just said.

[XtremeBain]

To minimize scripting you could cron rsync for your weekly backups and rdiff for incremental backups.  Although I haven't looked into rdiff too much so I'm not sure how easy it is to do incrementals from a different weekly snapshot.

You'll have to wrap a little bit of scripting around it if:
-you're using a database server (dump the databases to an area that is going to be backed up)
-wanted to copy (cp -al) files to a temp location before backing it up
-wanted to compress+split+parity the files like I initially suggested.
-etc.

I would also look at setting up an rss feed or automatic e-mail that goes out when a backup has completed successfully (or failed, if you can catch the exception). That way you know each morning that your backups continue to work.

You should hire KnacK as Digital Paint's Network Engineer.

[KnacK]

I would also look at setting up an rss feed or automatic e-mail that goes out when a backup has completed successfully (or failed, if you can catch the exception). That way you know each morning that your backups continue to work.

Funny that you mention that because I've been working on this at work for 2 weeks now.  This new job I have and taking over this new network, I have ALL of the event alarms email me and my crackberry whenever anything works/fails/stalls/quits/what-e-ver.

Between the oracle and sql db's and some custom apps on 7 servers with veritas running almsot a T of backups daily; rotating tapes on a daily/weekly basis then doing a full month end backup, thats a lot of tape.

However you do it, make sure that you can test a backup and make sure it restores with no surprises.