Seven Deadly Backup Sins And Seven Heavenly Ways For Redemption

The End of EverythingAbout a month ago my computer's Power Supply Unit died on me. While changing that power unit was both cheap and got me banging my head against the computer case technically effortless, it got me thinking that my pictures are not all that secured on my hard drive. Now, I do back up to an external disk, but after hearing some tips from DIYP readers, I realized that I am guilty of seven deadly backup sins. Here is a collection on those sins and matching redemption as suggested by DIYP readers. A lot of the tips were given by more than one reader. 

This is also a great opportunity to mention Brian's excellent series about Photo backup. [Image by Dude Crush]

The Sin Of Closeness

External disk or DVD backup are only somewhat good as backup solutions. It will protect you against a PC failure and internal disk crash. But consider this, a fire sadly hits you. If your external drive is located near your PC, you risk loosing both your internal and your external drive.

Redemption: There were several options suggested:  backing up to multiple copies and keeping some off site; using an online service; backup to a remote PC at a loyal friend's house.

The Sin Of Manual Labor

How are you backing your images up? Are you manually copying them to an external disk? Manually uploading them to a remote FTP site? Those are good solution f you are dealing with a small number of files, but as we know image collections are getting bigger with each session, arriving to hundreds and thousands of files. As the number of images increase, it becomes harder and harder to keep track of the files that changed, the files that were added and the ones that are deleted. By doing manual backups you take the risk of missing a file or an entire directory to back up. You also run the risk of missing your backup schedule.

Redemption: One option is to use automated backup software. Such software allows you to set backup scheduling, select directories to back up, and even decide that you only back up your RAW files, and leave the jpgs alone; Another option is to build your own system using windows / Linux scripting; The last option is to "backup as you go" - a lot of the online backup providers install an add on that will automatically sends any new files to remote backup location.

The Sin of Running Windows

This is kinda specific, if you are a pc boy (or a Linux kid) you are probably familiar with the rsync. rsync is a great piece of software that allows you to  manage your backup, and do multiple backups to different locations, backup to remote serves and run a backup schedule. Here is the thing - it is a Linux program, or at least more comfortable to Linux users.

Redemption: if you are comfortable with running scripts you can use cwrsync the windows port of rsync. If you like windows programs and interfaces better, you can use Synctoy - a windows syncing solution.

The Sin Of Single Copy

Having a single backup is better then having no backup at all. But only slightly. The chances of this backup going bad / online service closing / remote PC crashing are something to consider. If the unfortunate happens and your backup dies when your main storage dies (and trust Murphy - it will), you are left with nothing. 

Redemption:  use multiple copies. Or even better, use multiple backup methods. If your main backup is DVD based, add an online storage, if you are backing up on external hard drive, also back up using portable media. The more the merrier.

The Sin Of Being Hot

This sin has more to do with the chances of you needing your backup. That is if your main PC crashes, or if your hard drive dies. Or in other words it deals with poor PC maintenance. One of the major killers of PCs in general and hard drives in particular is heat. The hotter your PC is the more load you are putting on your system and on your hard drive, increasing the risk of killing your main storage.

Redemption: Take good care of your PC. Make sure you have a good power supply unit, and good fans to keep your PC cool. Some of the PC cases offer better cooling options than others, by having internal tunneling to transfer heat outside the PC case.

The Sin Of Huge Files

Large files are harder to back up. Lightroom catalog files specifically are huge. My catalog file is over 60 Megs. This would have been fine if I could have backed it up and be done with it, however, this file changes daily with additions of new images, and development of others. The fact that it is both huge and in constant change makes it virtually impossible to backup online.

Redemption: I don't have a good solution for this one, only three work rounds: 1 - do not back up your catalogs. 2 -do not use Lightroom, this is a hard one to follow, Brian has a great review on Adobe Bridge which does not use a huge file, yet provides almost all the features of Lightroom. 3 - Back up your Lightroom catalog separately on a DVD or external drive.

The Sin Of Never Restoring 

Is your back up working? Are you sure? How do you know? Have you ever tried to restore it? If you never did a successful restore you can never be sure it works.

Redemption:  Test your backup. The concept here is that a backing up is not sufficient if you can not be 100% sure that you'll be able to restore from your back up at the time of need. If you are using DVD, verify that your older DVDs are still operational. If you are using an online solution, randomly restore files to verify that they are properly backed up. This is true for any backup solution that you use.

Make sure you don't miss out on the next article - Register to the RSS feed or the newsletter

Comments

I use Microsoft SyncToy to

I use Microsoft SyncToy to do scheduled synchronizations every night to my Drobo. I use drobo because when (not if) one drive fails, I can easily swap it out for another and drobo never skips a beat. Lastly, I subscribe to Carbonite where all my data files are backed up to an offsite server. This protects me in case of a major catastrophe. All it takes is one lightning strike and every electronic component in your house is fried.

How disappointing

You obviously don't know about Vista's own capable backup and recovery services. A cobbled-together Linux solution isn't necessary (unless you're running Linux).

In reply to "How disappointing"

Vista might be able to backup and recover but the point of the article is to make people more aware of the need for multiple back-ups in multiple geographic locations. If you're a pro you need to ensure that you are keeping your archives. If you are just an amateur shooter then go ahead and risk loosing them by only storing them locally.

I make 2 dvd copies, store one copy at a remote location, store one locally, back-up to an external drive, and I've recently started looking for an online option too.

I have clients that ask me for work that I've shot a few years ago and have had to grab shots from CDs on a few occasions as that was how I started archiving when I realized that zip discs were not a viable option ;0)

In reply to "How Disappointing"

You don't even need Vista. XP Pro will do it. You can back up to any writable media you have, and you can automate it.

One Potential Solution to Huge Files

Large, dynamic files like catalogs are difficult to bakup. The most common solution is to use RAID so that the data is redundant across multiple disks. On a high end desktop you can do this internally, otherwise you can use an external array at the expense of network latency. This doesn't resolve the sin of closeness but it ain't bad and obviates the issue of manual backups as well.

I blogged briefly about being a paranoid baby photographer and some of the lengths I go through to keep backups from the moment I shoot to delivering the final deliverable.

robocopy

for those with PC's try robocopy it's a free ms command line utility that can back up entire drives to remote locations.

Windows Home Server

All my photos reside on a Windows Home Server with two hard drives in it. The photos are automatically duplicated on both drives to protect against single drive failure. Plus, these folders are all backed up in the cloud on my idrive.com account for $50/year for up to 150GB. Once I accumulate more than 150GB, I think I'll change my strategy and keep the WHS files mirrored on a drive on my main PC and use Mozy to back up to EMC's servers for the same price.

So, my PCs are backed up nightly to my WHS, and the shared folders on my WHS are backed nightly to idrive as well.

Greet roundup

That's a great collection of sins and redemptions ;-)

I definitely agree with you on the last one about testing a restore. I've heard from too many people who thought they were backing up their data, but failed to do a restore to test it....and found out the hard way that their backups were not completing successfully!

* i just bought a DROBO and it is amazing.

I have a very very miserable stories about backups.
--Photos you take, you cleanup, you save, & backup.
10megs to 20 megs etc.

Just one 200k size file in illustrator could be 20-40 hours of my work.
so the file size is nothing compared to the TIME- THAT MEANS EVERYTHING.
****** NO I AM NOT AFFILIATED WITH DROBO***** I just need to tell you my experiences. www.drobo.com
i didnt want to spend 500bucks on an empty external drive CASE.(no drives)
I heard good things so i took a shot(hard thing to do in this economy).
I got it and copied all of my files onto it. i also made a TIME MACHINE backup on it too. (which is amazing). Well it just keeps everything safe. SO now i use it for a main drive to all my work on it. I feel safe. It just spreads the files over any drive you place in it. - Extra safety I use SuperDuper just to back up my time machine to another external. ** I hope this makes sense i am typing 4am in the morning. hahhahaha

Drobo Arigato

When the firewire 800 Drobo came out the USB version dropped in price. I picked one up and use it to back up upwards of 50,000 images per year from the past few years of business.

No tools are required for installation / removal of drives so if you're going to be away for a weekend... shut down the Drobo (let it cool first), remove the duplicated drives, store one in a fire safe and one off site.

Time Machine and SuperDuper for Mac are both used to back up our business' laptops - incremental Time Machine and a nightly bootable SuperDuper copy.

If we weren't running a home office for our photography business I might not be so obsessive about multiple backups but... each has saved me from a lot of trouble and upset customers.

Good topic to bring up, thanks for posting.

mozy backup rocks!!! I

mozy backup rocks!!! I don't even have to think about it and all of my files on my computer are backed up to a remote location. It is unlimited amounts of storage for just $50 per year (and I think they have a sale right now?)... :o) Google mozy home backup and you'll find it...

I second that!

I'll second the mozy backup comment!
See my blog post on 10 reasons why you should use Mozy backup:

RE: The Sin of Huge Files

Rsync is an incremental file tranfser utility, so with your 60MB catalog file, it would only copy the portion of the file that has changed since the last backup.

Allway Sync also great for PC

I'm on a PC... (I hope that's not a sin!)... Actually it's just a tool right?

I thought about the MS sync toy thing, but ended up trying Allway Sync which had a free trial. http://allwaysync.com/ I learned it, and liked it. The think I like is it only backs up the changes, and it's not proprietary like a zip, rar, or whatever ghost uses.

Just straight files.

Because I've moved a ton of files with it, it will eventually yell at you and either not work, or maybe just nag you into registering. Then again I'm a professional photographer and push a lot of files with it. If you do lower volume you'll probably have more time to try it out. (though my time allowed was generous)

I'm super happy with it. Check them out.

Adam Nollmeyer.
http://twitter.com/acmephoto

Unison is a nice rsync alternative

Hi,

A nice alternative for rsync is Unison. It also uses the rsync algorithm, has
a gui and a commandline interface, and is also available for both windows and linux.
http://www.cis.upenn.edu/~bcpierce/unison/

I use allwaysync

I'm VERY happy with it and it is really affordable.

Robocopy can be a very good alternative if you want something free but allwaysync is my choice.

rdiff-backup

Another tool related to rsync is 'rdiff-backup' which worked great for me. It stores file differences as well and so is better than the other synching programs. Having the ability to restore earlier versions of files is very important. For example, if you realize that you actually need a file you erased accidentally few months ago.

The worse has happened, now what?

My wife's cousin had hd HDD crash after a supposed lighting hit. All her photos and data gone. So she took her HDD to a local tech before coming to me and he did his magic and saved her MP3 files but no photos. Then he reformatted the drive! No no no. She finally comes to me and after looking online I found a program that recovers data from corrupted HDDs. I'm sure there are more than one out there but I found a demo that was free to try. It scans the HDD's sectors and locates all the files based on the extension(s) if you choose to filter the results. The application shows you what it can recover and then you can buy the software (it was $100) and recover the files. It got a lot of them but there is no way of knowing if it could have recovered more if the local tech didn't reformat the HDD. It found a lot of jpg files that it couldn't display and there was no file information such as date. However there was size and any JPEG tags placed by the camera so I was very quickly able to tell which ones were close to be recoverable.

I'm not selling the program but just be aware that they exist and work but in no way should you rely on them.

Photorec

I have had great luck with this application and it is free:
http://www.cgsecurity.org/wiki/PhotoRec
It did a better job recovering all types of files that a commercial application did.

I use Syncback for windows.

I use Syncback for windows. It's free, and allows you to define exactly what you want to back up and how. Great if you have multiple external drives, and want to define a different way to do backup on each one.

Folder Clone

I have been using Folder Clone (http://www.folderclone.com/) which does exactly that; maintains an exact duplicate of one folder at another location. I keep all of my photos on one 500 GB drive and Folder Clone maintains another 500 GB drive with the duplicate folders/files. It runs in the background when the pc is otherwise idle. Now if I can just get a third 500 GB drive to alternate as the backup each week and keep the other one off-site.

Mac OS X - Time Machine

I could recommend Mac OS X and Timemachine to you, plus a manual backup.
I have a Mac with a small internal drive, where I keep almost nothing, apart from the library files, etc. like your photo library. If you have an external drive you don't need you can use that as a time machine. This will back up your main drive every hour (it only makes changes to the files you changed on your computer, so it's pretty quick). Of course if you have your photos on that drive it will back it up too every hour and all their changes. However, I have a lot of photos so have to keep them on another external drive, which I back up to a third external hdd, plus a portable hdd that I take with me or store in a different place (e.g. at work). That only happens once a month, but it's better loosing only a couple of weeks worth of photos than everything I suppose. Anyway, time machine is a great tool and if you keep your pictures on your main drive it will back them up as well. PS: I'm a newly convert to Mac OS X and can only say that as a photographer it's worth the effort and money changing from Win to Mac ;)

Back up

I despair of people using DVD or CD back up, I have conducted research into storage on these devices.

Pinholing, sublimation, oxidisation, actinic burns are the enemy of DVDs and CDs. Especially the cheap versions.

CDs and DVDs that have come from distributors are glass pressed and suffer little of these effects.

However the home market discs use dyes that respond to laser and these are prone to data loss. They are cheaply made have little or no laquer protecting them from scratches. I have gone through a thousand discs in a picture library and have had to use specialist disc drives to recover data.

Word documents are fine but high compressed algorythmic data ie Jpegs and RAW files are prone to significant data loss.

I would recommend that if you do back up on disc is that you use high end (expensive discs, that are availbale from media sellers) the gold type.

Damp free storage Dessicant packing and stored in a light free environment.

Gloves should be worn (lint free) and specialist standalone disc drives that do not overheat the disc.

Rich

Great article -- useful and

Great article -- useful and entertaining, and that's not always easy to accomplish on a topic like this. I'll put in a good word for Mozy, too, and I also want to mention FileReplicationPro -- not cheap, but just about unlimited for speed and capacity. The great thing is that it updates automatically without using much at all in the way of resources, and it doesn't require people to remember to do it.
What solution you need depends on the amount of data you've got. But I think a lot of us have an irrational "I don't have that much data, so I don't need tot do anything about it" feeling. We'd miss our files just as much as a bigger company would.

Post new comment

The content of this field is kept private and will not be shown publicly.
  • Allowed HTML tags: <a> <em> <strong> <cite> <code> <ul> <ol> <li> <dl> <dt> <dd> <img> <a>
  • Lines and paragraphs break automatically.
  • Web page addresses and e-mail addresses turn into links automatically.

More information about formatting options