Overclock.net › Forums › Software, Programming and Coding › Operating Systems › Linux, Unix › Centralized Disk Backup Software
New Posts  All Forums:Forum Nav:

Centralized Disk Backup Software

post #1 of 10
Thread Starter 
I'm looking for a Linux-based software solution that will take full disk image backups, and hopefully incremental backups as well (not required) of target machines on my LAN. I was hoping for something akin to Acronis, but that doesn't cost $250 for the Linux license.

Should be able to:
  • Create full disk images over the network
  • Compress data to save space
  • Automatically rotate backups, i.e. delete old ones when new ones are created
  • Facilitate re-imaging over the network

If there is a Windows solution that runs without error via WINE, I'll give it a look. Would prefer a native Linux solution first however.
    
CPUMotherboardGraphicsRAM
Core i7 970 @ 4.0 GHz 1.22 Vcore Asus Rampage II Gene GTX 260 216SP G.SKILL PI 3x2gb DDR3 1600 @ 7-8-7-24 
Hard DriveOSMonitorPower
2x 500gb Seagates RAID 0, 1x 500gb non-RAID Windows 7 Professional x64 ASUS 24'' VH242H / Spectre 24'' WS Corsair 750TX 
Case
Corsair 300R 
  hide details  
Reply
    
CPUMotherboardGraphicsRAM
Core i7 970 @ 4.0 GHz 1.22 Vcore Asus Rampage II Gene GTX 260 216SP G.SKILL PI 3x2gb DDR3 1600 @ 7-8-7-24 
Hard DriveOSMonitorPower
2x 500gb Seagates RAID 0, 1x 500gb non-RAID Windows 7 Professional x64 ASUS 24'' VH242H / Spectre 24'' WS Corsair 750TX 
Case
Corsair 300R 
  hide details  
Reply
post #2 of 10
I love BackupPC!
workstation
(14 items)
 
  
CPUMotherboardGraphicsRAM
i5 2500K EVGA Z68 SLI GeForce 670 GTX G.Skill 32GB 1600Mhz 
Hard DriveCoolingOSMonitor
OCZ Agility 3 60GB Zalman arch x86_x64 U3011 + U3014 
PowerCaseMouseAudio
PCPowerCooling 860w Chenbro server G500 Asus D2X, Def Tech 5.3 
  hide details  
Reply
workstation
(14 items)
 
  
CPUMotherboardGraphicsRAM
i5 2500K EVGA Z68 SLI GeForce 670 GTX G.Skill 32GB 1600Mhz 
Hard DriveCoolingOSMonitor
OCZ Agility 3 60GB Zalman arch x86_x64 U3011 + U3014 
PowerCaseMouseAudio
PCPowerCooling 860w Chenbro server G500 Asus D2X, Def Tech 5.3 
  hide details  
Reply
post #3 of 10
I was in your situation about a year ago, did plenty of research and ultimately went with www.bacula.org


it's not "full disk IMAGE" backups, which are useless anyway. It's filesystem backups, works a lot like microsoft data protection manager if you've ever used that. Similar in nature, both good for getting an entire lan backed up in the middle of the night.

I've tested the bare metal recovery with full/diff/incremental sets several times and it works perfectly, even to a different target machine.. Though it's a little tricky to do, you have to build a statically linked bacula-fd and start it in a chroot, chroot /mnt/recovery /mnt/recovery/bin/bacula-fd (instead of /bin/bash).

I would recommend you try it out, I'm sure it would work fine for you. You have to learn the config files and it takes a bit to setup how you want, but like anything, you get out of it what you put into it. There's a few gtk and web front ends for it, i've been using webacula, although these days i mostly just ssh right to bconsole.

I have a few windows machines I've been meaning to set it up on, I tried it for a few minutes and it was clear it was going to take some more time than I had. And the bare metal recovery process to a windows client is totally different, but I'm sure does work.
Edited by lloyd mcclendon - 5/13/12 at 10:57am
stable again
(25 items)
 
  
CPUCPUMotherboardGraphics
E5-2687W E5-2687W ASUS Z9PED8-WS EVGA GTX 570 (Linux host) 
GraphicsRAMHard DriveHard Drive
EVGA GTX 970 FTW (win7 guest) 64GB G.SKILL 2133 2x Crucial M4 256GB raid1 4x 3TB raid 10 
CoolingCoolingCoolingCooling
2x Apogee HD  2x RX 480 2x MCP 655 RP-452x2 rev2 (new) 
CoolingCoolingOSOS
16x Cougar Turbine CFT12SB4 (new) EK FC 580 Gentoo (host) Gentoo (x23 guests) 
OSMonitorMonitorPower
windows 7 (guest w/ vfio-pci) Viewsonic 23" 1080P Viewsonic 19" Antec HCP Platinum 1000 (new) 
CaseOtherOther
Case Labs TH10 (still the best ever) 2x Lamptron FC-5 IOGEAR 2 way DVI KVM Switch 
  hide details  
Reply
stable again
(25 items)
 
  
CPUCPUMotherboardGraphics
E5-2687W E5-2687W ASUS Z9PED8-WS EVGA GTX 570 (Linux host) 
GraphicsRAMHard DriveHard Drive
EVGA GTX 970 FTW (win7 guest) 64GB G.SKILL 2133 2x Crucial M4 256GB raid1 4x 3TB raid 10 
CoolingCoolingCoolingCooling
2x Apogee HD  2x RX 480 2x MCP 655 RP-452x2 rev2 (new) 
CoolingCoolingOSOS
16x Cougar Turbine CFT12SB4 (new) EK FC 580 Gentoo (host) Gentoo (x23 guests) 
OSMonitorMonitorPower
windows 7 (guest w/ vfio-pci) Viewsonic 23" 1080P Viewsonic 19" Antec HCP Platinum 1000 (new) 
CaseOtherOther
Case Labs TH10 (still the best ever) 2x Lamptron FC-5 IOGEAR 2 way DVI KVM Switch 
  hide details  
Reply
post #4 of 10
Rsync does most of what you want (example). Eventually you can write your own BASH scripts to "re-image" from a live Linux distro that's booted through PXE. So it doesn't have to be expensive. Eventually you can host this on github and make it a new FOSS project smile.gif
#well
(19 items)
 
Lenovo L530
(8 items)
 
 
CPUMotherboardGraphicsRAM
Intel Core i7 4770k Gigabyte Z87X-UD4H XFX Radeon HD 6950 Corsair CMX8GX3M2A2000C9 
Hard DriveHard DriveOptical DriveCooling
Samsung EVO 840 Hitachi HDS722020ALA330 Generic DVD±RW Burner Noctua NH-D14 
OSMonitorMonitorKeyboard
Windows 8.1 Dell U2711 LG W2453 Ducky DK9008 Overclock.net Edition, Cherry MX B... 
PowerCaseMouseMouse Pad
Corsair TX850 Antec Three Hundred Corsair Raptor M40 QPAD HeatoN M 
AudioAudioAudio
E-MU Tracker|pre Beyerdynamic DT-770 250 Ohm AntLion ModMIc 
CPUGraphicsRAMRAM
Intel Ivy Bridge 3210M Intel HD 4000 Graphics Soldered Corsair Vengeance  
Hard DriveOptical DriveOSMonitor
500GB DVD-+RW Windows 7 Professional 1600x900 
  hide details  
Reply
#well
(19 items)
 
Lenovo L530
(8 items)
 
 
CPUMotherboardGraphicsRAM
Intel Core i7 4770k Gigabyte Z87X-UD4H XFX Radeon HD 6950 Corsair CMX8GX3M2A2000C9 
Hard DriveHard DriveOptical DriveCooling
Samsung EVO 840 Hitachi HDS722020ALA330 Generic DVD±RW Burner Noctua NH-D14 
OSMonitorMonitorKeyboard
Windows 8.1 Dell U2711 LG W2453 Ducky DK9008 Overclock.net Edition, Cherry MX B... 
PowerCaseMouseMouse Pad
Corsair TX850 Antec Three Hundred Corsair Raptor M40 QPAD HeatoN M 
AudioAudioAudio
E-MU Tracker|pre Beyerdynamic DT-770 250 Ohm AntLion ModMIc 
CPUGraphicsRAMRAM
Intel Ivy Bridge 3210M Intel HD 4000 Graphics Soldered Corsair Vengeance  
Hard DriveOptical DriveOSMonitor
500GB DVD-+RW Windows 7 Professional 1600x900 
  hide details  
Reply
post #5 of 10
bacula seems like it needs a better wiki....

I was going to screw around with it on my home server, but aside from compiling the source into an executeable, I was frustrated by how granular you had to configure it just to start up, let alone work with it on a daily basis.
post #6 of 10
Quote:
write your own BASH scripts to "re-image" from a live Linux distro that's booted through PXE. So it doesn't have to be expensive. Eventually you can host this on github and make it a new FOSS project

redface.gif .. talk about reinventing the wheel... the last thing anyone needs is another half baked backup program. Plenty of others have spent many long hours already, use an existing solution and kick that time towards something a little more useful


http://en.wikipedia.org/wiki/List_of_backup_software
http://www.junauza.com/2009/01/7-best-freeopen-source-backup-software.htm
stable again
(25 items)
 
  
CPUCPUMotherboardGraphics
E5-2687W E5-2687W ASUS Z9PED8-WS EVGA GTX 570 (Linux host) 
GraphicsRAMHard DriveHard Drive
EVGA GTX 970 FTW (win7 guest) 64GB G.SKILL 2133 2x Crucial M4 256GB raid1 4x 3TB raid 10 
CoolingCoolingCoolingCooling
2x Apogee HD  2x RX 480 2x MCP 655 RP-452x2 rev2 (new) 
CoolingCoolingOSOS
16x Cougar Turbine CFT12SB4 (new) EK FC 580 Gentoo (host) Gentoo (x23 guests) 
OSMonitorMonitorPower
windows 7 (guest w/ vfio-pci) Viewsonic 23" 1080P Viewsonic 19" Antec HCP Platinum 1000 (new) 
CaseOtherOther
Case Labs TH10 (still the best ever) 2x Lamptron FC-5 IOGEAR 2 way DVI KVM Switch 
  hide details  
Reply
stable again
(25 items)
 
  
CPUCPUMotherboardGraphics
E5-2687W E5-2687W ASUS Z9PED8-WS EVGA GTX 570 (Linux host) 
GraphicsRAMHard DriveHard Drive
EVGA GTX 970 FTW (win7 guest) 64GB G.SKILL 2133 2x Crucial M4 256GB raid1 4x 3TB raid 10 
CoolingCoolingCoolingCooling
2x Apogee HD  2x RX 480 2x MCP 655 RP-452x2 rev2 (new) 
CoolingCoolingOSOS
16x Cougar Turbine CFT12SB4 (new) EK FC 580 Gentoo (host) Gentoo (x23 guests) 
OSMonitorMonitorPower
windows 7 (guest w/ vfio-pci) Viewsonic 23" 1080P Viewsonic 19" Antec HCP Platinum 1000 (new) 
CaseOtherOther
Case Labs TH10 (still the best ever) 2x Lamptron FC-5 IOGEAR 2 way DVI KVM Switch 
  hide details  
Reply
post #7 of 10
We just use rsync at work, but I was looking into Bacula last year and think when the time comes that we need to update the pre-existing scripts, I might instead go for Bacula.
post #8 of 10
My work has IBM TSM, which has a lot of cool features, it's interesting to manage actually. It was also interesting to read this software and how it operates with so many services. TSM combines them all into 1 really. There isn't one central database, but each storage server has a database of it's own data. There are companies with thousands of storage servers, so have all the data in 1 place would be a bad idea.
post #9 of 10
Thread Starter 
Quote:
Originally Posted by herkalurk View Post

My work has IBM TSM, which has a lot of cool features, it's interesting to manage actually. It was also interesting to read this software and how it operates with so many services. TSM combines them all into 1 really. There isn't one central database, but each storage server has a database of it's own data. There are companies with thousands of storage servers, so have all the data in 1 place would be a bad idea.

My old company used TSM.



I hate TSM.


Maybe it was just how our backup admin had things configured but we couldn't go a day without 10-20 backups failing.



I'll look into Bacula. The main clients being backed up would be Windows clients.
    
CPUMotherboardGraphicsRAM
Core i7 970 @ 4.0 GHz 1.22 Vcore Asus Rampage II Gene GTX 260 216SP G.SKILL PI 3x2gb DDR3 1600 @ 7-8-7-24 
Hard DriveOSMonitorPower
2x 500gb Seagates RAID 0, 1x 500gb non-RAID Windows 7 Professional x64 ASUS 24'' VH242H / Spectre 24'' WS Corsair 750TX 
Case
Corsair 300R 
  hide details  
Reply
    
CPUMotherboardGraphicsRAM
Core i7 970 @ 4.0 GHz 1.22 Vcore Asus Rampage II Gene GTX 260 216SP G.SKILL PI 3x2gb DDR3 1600 @ 7-8-7-24 
Hard DriveOSMonitorPower
2x 500gb Seagates RAID 0, 1x 500gb non-RAID Windows 7 Professional x64 ASUS 24'' VH242H / Spectre 24'' WS Corsair 750TX 
Case
Corsair 300R 
  hide details  
Reply
post #10 of 10
I'm going to bet it was the configuration....

I run backups on 150+ servers daily and the only ones that are failing are because we turned off the system, or the scheduler. It's not the easiest to learn, IBM has all their proprietary commands for TSM, but after working with it for months it's 2nd nature now. It's fairly robust and will accomodate all types of systems, old and new, linux and windows and AIX.
New Posts  All Forums:Forum Nav:
  Return Home
  Back to Forum: Linux, Unix
Overclock.net › Forums › Software, Programming and Coding › Operating Systems › Linux, Unix › Centralized Disk Backup Software