Overclock.net › Forums › Components › Hard Drives & Storage › Sean's Data Backup Guide
New Posts  All Forums:Forum Nav:

Sean's Data Backup Guide - Page 2

post #11 of 231
Its been a little while since I played with this but what I almost had working was:

copy source to destination only new or changed files w/o purge
if files in dest not in source then create dated_deleted folder in each subfolder in source (best if only created for that subfolder having orphan files)
move dest files not in source to folder dated_deleted

This involves if/then loops which I just can't seem to figure out given the minuscule amount of code I know.

I thought it would be really cool to use this in conjunction with ZFS so that you are protected against both accidental deletion and bit level corruption.
Edited by ddietz - 10/3/11 at 7:28am
Alpha v.2
(13 items)
 
  
CPUMotherboardGraphicsRAM
Phenom II 740be @ 3.63 (16.5 x 220) ASUS M3A78-CM XFX HD4850 Crucial 2x2GM DDR2-800 6-6-6-18 
Hard DriveOptical DriveOSMonitor
WD Black 500GB OS/Programs, WD 1Tb + 800 GB data Sony DVD-RW Win 7x64 Professional Dell 22" 
PowerCase
Antec Earthwatts 650 Antec 300 w/5 fans 
  hide details  
Reply
Alpha v.2
(13 items)
 
  
CPUMotherboardGraphicsRAM
Phenom II 740be @ 3.63 (16.5 x 220) ASUS M3A78-CM XFX HD4850 Crucial 2x2GM DDR2-800 6-6-6-18 
Hard DriveOptical DriveOSMonitor
WD Black 500GB OS/Programs, WD 1Tb + 800 GB data Sony DVD-RW Win 7x64 Professional Dell 22" 
PowerCase
Antec Earthwatts 650 Antec 300 w/5 fans 
  hide details  
Reply
post #12 of 231
Wow, nice guide.
post #13 of 231
Thread Starter 
Quote:
Originally Posted by t-ramp View Post
Wow, nice guide.
Thanks!
Sean's Sandy!
(15 items)
 
Terrorbyte
(15 items)
 
Le Papa's
(10 items)
 
Reply
Sean's Sandy!
(15 items)
 
Terrorbyte
(15 items)
 
Le Papa's
(10 items)
 
Reply
post #14 of 231
will have to try this when i do my next backup...thanks for the tip Sean
The Computer
(13 items)
 
  
CPUMotherboardGraphicsRAM
i5-2500k 4.5ghz@1.3v Asus P8P67 MSI TF4 GTX 670 PE/OC 8GB G.Skill Sniper DDR3 1600 
Hard DriveOSMonitorKeyboard
Samsung F3 1TB,Seagate 500gb 7200.10 Windows 7 Ultimate x64 Samsung EX2220 Logitech Illuminated 
PowerCaseMouse
SeaSonic X-650 Corsair 650D Razer Mamba 
  hide details  
Reply
The Computer
(13 items)
 
  
CPUMotherboardGraphicsRAM
i5-2500k 4.5ghz@1.3v Asus P8P67 MSI TF4 GTX 670 PE/OC 8GB G.Skill Sniper DDR3 1600 
Hard DriveOSMonitorKeyboard
Samsung F3 1TB,Seagate 500gb 7200.10 Windows 7 Ultimate x64 Samsung EX2220 Logitech Illuminated 
PowerCaseMouse
SeaSonic X-650 Corsair 650D Razer Mamba 
  hide details  
Reply
post #15 of 231
I love robocopy...I backup my steam games then run a script to sync them over to a USB drive. I also do that for updated copies of Minecraft, GW and WoW. My Firefox portable as well but I'm just weird that way. I have a separate batch for each thing I want to sync over. I like the skip-on-error feature.

I did find setting the time out and number of retries (on fail or error) to something sane eventually helped me about quite a bit.

I also applaud the tutorial.
 
VM Server
(17 items)
 
 
CPUGraphicsRAMHard Drive
Intel Ivy Bridge Core i7-3630QM nVidia GeForce GTX 680M 16GB DDR3 1600MHz Dual Channel Memory (2 SODIMMS) Hard Drive: Serial-ATA II 3GB/s 
Hard DriveOSMonitorPower
Hard Drive: Serial-ATA II 3GB/s Windows 7 Ultimate x64 17.3" FHD 16:9 (1920x1080) Battery: Smart Li-ion Battery (8-Cell) 
Audio
Sound Blaster Compatible 3D Audio 
CPUMotherboardGraphicsRAM
Intel Core i7 860 Biostar T5 XE Radeon HD 5870 Corsair 16GB  
Hard DriveHard DriveOptical DriveOS
Western Digital hard drive wd1001fals-00e8b0 Maxtor 300GB I don't need no stinking optical drive Microsoft Windows 7 Ultimate x64 
MonitorMonitorKeyboardPower
HP ZR24w 24'' Samsung SyncMaster 24" logitech wireless k360 Seventeam ST-850ZAF 850W ATX 
CaseMouseAudioAudio
Thermaltake V9 Black Edition Logitech G500 Programmable Gaming Mouse FiiO E7 USB DAC and Portable Headphone Amplifier Sennheiser HD555 Professional Headphones 
  hide details  
Reply
 
VM Server
(17 items)
 
 
CPUGraphicsRAMHard Drive
Intel Ivy Bridge Core i7-3630QM nVidia GeForce GTX 680M 16GB DDR3 1600MHz Dual Channel Memory (2 SODIMMS) Hard Drive: Serial-ATA II 3GB/s 
Hard DriveOSMonitorPower
Hard Drive: Serial-ATA II 3GB/s Windows 7 Ultimate x64 17.3" FHD 16:9 (1920x1080) Battery: Smart Li-ion Battery (8-Cell) 
Audio
Sound Blaster Compatible 3D Audio 
CPUMotherboardGraphicsRAM
Intel Core i7 860 Biostar T5 XE Radeon HD 5870 Corsair 16GB  
Hard DriveHard DriveOptical DriveOS
Western Digital hard drive wd1001fals-00e8b0 Maxtor 300GB I don't need no stinking optical drive Microsoft Windows 7 Ultimate x64 
MonitorMonitorKeyboardPower
HP ZR24w 24'' Samsung SyncMaster 24" logitech wireless k360 Seventeam ST-850ZAF 850W ATX 
CaseMouseAudioAudio
Thermaltake V9 Black Edition Logitech G500 Programmable Gaming Mouse FiiO E7 USB DAC and Portable Headphone Amplifier Sennheiser HD555 Professional Headphones 
  hide details  
Reply
post #16 of 231
Gonna try this! Using Areca backup and Synkron right now, i'll get around to this in a little bit
post #17 of 231
Thread Starter 
Quote:
Originally Posted by FreekyGTi View Post
will have to try this when i do my next backup...thanks for the tip Sean
Np, glad to help!

Quote:
Originally Posted by subassy View Post
I love robocopy...I backup my steam games then run a script to sync them over to a USB drive. I also do that for updated copies of Minecraft, GW and WoW. My Firefox portable as well but I'm just weird that way. I have a separate batch for each thing I want to sync over. I like the skip-on-error feature.

I did find setting the time out and number of retries (on fail or error) to something sane eventually helped me about quite a bit.

I also applaud the tutorial.
Thanks for sharing your experience.

Quote:
Originally Posted by Pigeon View Post
Gonna try this! Using Areca backup and Synkron right now, i'll get around to this in a little bit
Good luck!
Sean's Sandy!
(15 items)
 
Terrorbyte
(15 items)
 
Le Papa's
(10 items)
 
Reply
Sean's Sandy!
(15 items)
 
Terrorbyte
(15 items)
 
Le Papa's
(10 items)
 
Reply
post #18 of 231
Thread Starter 
Bumpidy lolz
Sean's Sandy!
(15 items)
 
Terrorbyte
(15 items)
 
Le Papa's
(10 items)
 
Reply
Sean's Sandy!
(15 items)
 
Terrorbyte
(15 items)
 
Le Papa's
(10 items)
 
Reply
post #19 of 231
Thread Starter 
I just made an uber script!
Sean's Sandy!
(15 items)
 
Terrorbyte
(15 items)
 
Le Papa's
(10 items)
 
Reply
Sean's Sandy!
(15 items)
 
Terrorbyte
(15 items)
 
Le Papa's
(10 items)
 
Reply
post #20 of 231
Quote:
Originally Posted by SeanWebster View Post
I just made an uber script!
What's it do? I am setting Robocopy up right now and following your tutorial as we speak!

One tip I wanted to add, if you do multiple backups (ie daily/weekly/etc) you may want to use the /LOG+ option instead of simply /LOG so that it will append to your existing log file instead of overwriting it.

Interested in knowing what your script does...

So far I think I'm going to do the following: Have Win7 do a daily system image, but not backup any individual files. Then have Robocopy do a complete copy of my storage drive. The only thing I'm afraid of is what if it is erroring out from time to time and if nobody checks the log file, there's no way of knowing.


EDIT: Ok so after reading about Robocopy some more, I'm wondering if I really should be using it or not. I read that it cannot backup open or locked files (since it doesn't use Windows' Volume Shadow service). Not sure if it is risky to be copying my entire drive if it will be skipping some things depending on what is happening on the system at the time. For example, if someone is using Outlook at that time, the outlook mailbox file will be locked and none of it will be copied over.

Sigh...the search for an automated easy backup solution continues I guess.
Edited by GasMan320 - 10/12/11 at 8:48pm
2013 Rig
(13 items)
 
2012 Rig
(15 items)
 
 
CPUMotherboardGraphicsRAM
i5 2500K 4.8GHz @ 1.34v ASRock P67 Extreme4 B3 XFX Radeon HD 6850 1GB 8GB DDR3 1600 MHz CL8 
Hard DriveOptical DriveCoolingOS
Crucial C300 128GB + 3x 1TB Spinpoint F3 RAID0 2x ASUS 24x DVD+-RW/DL Noctua NH-D14 Windows 7 Pro x64 SP1 
MonitorPowerCaseAudio
Viewsonic 24" LED SeaSonic X650 Gold Cooler Master HAF X Onboard HD 
  hide details  
Reply
2013 Rig
(13 items)
 
2012 Rig
(15 items)
 
 
CPUMotherboardGraphicsRAM
i5 2500K 4.8GHz @ 1.34v ASRock P67 Extreme4 B3 XFX Radeon HD 6850 1GB 8GB DDR3 1600 MHz CL8 
Hard DriveOptical DriveCoolingOS
Crucial C300 128GB + 3x 1TB Spinpoint F3 RAID0 2x ASUS 24x DVD+-RW/DL Noctua NH-D14 Windows 7 Pro x64 SP1 
MonitorPowerCaseAudio
Viewsonic 24" LED SeaSonic X650 Gold Cooler Master HAF X Onboard HD 
  hide details  
Reply
New Posts  All Forums:Forum Nav:
  Return Home
  Back to Forum: Hard Drives & Storage
Overclock.net › Forums › Components › Hard Drives & Storage › Sean's Data Backup Guide