Overclock.net - Overclocking.net
     
 
Home Gallery Reviews Blogs Register Today's Posts Mark Forums Read Members List


Go Back   Overclock.net - Overclocking.net > Specialty Builds > Servers

Reply
 
LinkBack Thread Tools
Old 09-29-09   #1 (permalink)
4.0 GHz
 
SniperXX's Avatar
 
intel nvidia

Join Date: Sep 2008
Location: So-Cal
Posts: 1,103

Rep: 68 SniperXX is acknowledged by some
Unique Rep: 61
Trader Rating: 6
Default Server Backup Ideas

Ok my company I work for has alot of servers at a datacenter.

Due to recent hd problems with a server we are redoing our backup plan. The previous setup was done by my boss but it didn't perform to what we wanted.

What kind of options would we have for backing up terabytes of data off multiple servers besides tape? To give an idea most servers have 1-2TB of data on them.
__________________
Want to get ~25,000PPD folding on your i7 running a Virtual Machine?

EVGA 680i FOR SALE

i7 920 @ 4.2Ghz
HT off for now, still testing.

HEATWARE

O o
/Ż/___________________________ _\
| BBBBBAHHHHHHHHHHHHHHHHH
\_\ŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻ Ż/

System: LAN Rig
CPU
i7 920 (D0) @ 4.0GHz HT ON
Motherboard
Asus Rampage II GENE
Memory
6GB Crucial Dominators
Graphics Card
2x BFG GTX285
Hard Drive
~5TB (Raid 0 w/ backup drives)
Power Supply
Corsair TX750
Case
Antec 300
CPU cooling
Coolermaster V8 (WC gear is here)
GPU cooling
Stock
OS
Windows 7 Ultimate
Monitor
Samsung Syncmaster 2233RZ (120hz)
Overclock.net - 2009 Chimp Challenge Champions
SniperXX is offline   Reply With Quote
Old 09-29-09   #2 (permalink)
Case Modder
 
max302's Avatar
 
intel nvidia

Join Date: Oct 2007
Location: Trois-Rivieres, QC
Posts: 1,266
Blog Entries: 26

Rep: 122 max302 is acknowledged by manymax302 is acknowledged by many
Unique Rep: 101
Folding Team Rank: 193
Hardware Reviews: 3
Trader Rating: 15
Default

Hard drives?

Being more precise might allow us to give you some ideas. Do you need raid? Occasional manual backups? You're backing up the entire servers? As in the data on them, or OS + data?
__________________

System: Umbra
CPU
Q8400 R0 @ 3.2ghz stock volts
Motherboard
DFI LanParty Jr P45-T2RS
Memory
G.Skill Pi Black 4x2
Graphics Card
EVGA 8800 GT KO BIOS Mod
Hard Drive
Seagate ES.2 250 GB
Sound Card
Onboard
Power Supply
Xigmatek NRP-MC651
Case
Motherboard box
CPU cooling
Xigmatek Dark Knight w/ ICD7
GPU cooling
Thermaltake DuOrb
OS
Windows 7 RC1
Monitor
LG Flatron Wide 19"
1 Million+ Folding at Home points
max302 is offline I fold for Overclock.net   Reply With Quote
Old 09-29-09   #3 (permalink)
First Time Build
 
Turnoz's Avatar
 
intel nvidia

Join Date: Dec 2006
Location: Toronto!
Posts: 1,683

Rep: 129 Turnoz is acknowledged by manyTurnoz is acknowledged by many
Unique Rep: 118
Trader Rating: 5
Default

Quote:
Originally Posted by SniperXX View Post
Ok my company I work for has alot of servers at a datacenter.

Due to recent hd problems with a server we are redoing our backup plan. The previous setup was done by my boss but it didn't perform to what we wanted.

What kind of options would we have for backing up terabytes of data off multiple servers besides tape? To give an idea most servers have 1-2TB of data on them.
If you are willing to invest some money and time, the best solution is an offsite SAN. But that's pretty expensive. And also quite demanding on the net connection.
__________________
Quote:
Originally Posted by DigitalSonata View Post
There is an obvious solution to their problem: wear a tinfoil hat

System: Finally an upgrade
CPU
E4300 @ 3.2ghz (400x8)
Motherboard
EP45-DS3L
Memory
6 gig A-Data 800mhz (2x2 + 2x1)
Graphics Card
XFX 8800GS
Hard Drive
250Gig WD IDE
Sound Card
Integrated
Power Supply
650W Cooler Master
Case
Antec 300
CPU cooling
Tuniq Tower + Tri-cool.
GPU cooling
Accellero S1
OS
Vista 32-bit
Monitor
20.1" Metro
Turnoz is offline   Reply With Quote
Old 09-29-09   #4 (permalink)
Linux Lobbyist
 
parityboy's Avatar
 
intel nvidia

Join Date: Jan 2009
Location: London, United Kingdom
Posts: 526

Rep: 57 parityboy is acknowledged by some
Unique Rep: 53
Trader Rating: 0
Default

Yeah an off-site SAN would be ideal, but "ideal" usually equals "expensive".

@OP

For those sized data sets, tape is still probably your best bet, especially since you can move the tapes into a safe, or off-site. Look at tape library systems/software such as IBM's Tivoli. It's certainly pricey, but it works.

Alternatively, you could co-locate a back up server at a data centre and spend some cash on a decent Internet up-link. The first full backup would be slow, obviously, but after that, it'd only be differential backups.

You *might* be able to

a) do a full backup to tape

b) "restore" that tape back up to the co-located server

c) point your backup software at the co-located server and tell it to do differential backups from that point onwards. That should minimise your traffic needs.
__________________
System: Odessa (dead)
CPU
Xeon 1MB L3 @ 3.06GHz (dual)
Motherboard
ASUS PC-DL Deluxe
Memory
Corsair TwinX2048-3200PT
Graphics Card
Gainward 7800GS BLISS
Hard Drive
Western Digital 250GB RAID Edition (RAID1)
Sound Card
Intel i8x0 (On-board)
Power Supply
Thermaltake ToughPower 850W
Case
GlobalWin 802
CPU cooling
Dynatron Xeon Copper HSF
OS
Gentoo 2008.0
Monitor
HP L1800
parityboy is offline   Reply With Quote
Old 09-29-09   #5 (permalink)
4.0 GHz
 
SniperXX's Avatar
 
intel nvidia

Join Date: Sep 2008
Location: So-Cal
Posts: 1,103

Rep: 68 SniperXX is acknowledged by some
Unique Rep: 61
Trader Rating: 6
Default

Quote:
Originally Posted by max302 View Post
Hard drives?

Being more precise might allow us to give you some ideas. Do you need raid? Occasional manual backups? You're backing up the entire servers? As in the data on them, or OS + data?
We are doing data only. Current servers run raid 5 but recently one went down due to a backplane issue and the perc card kicked out 2 drives!

Quote:
Originally Posted by Turnoz View Post
If you are willing to invest some money and time, the best solution is an offsite SAN. But that's pretty expensive. And also quite demanding on the net connection.
Well the only other offsite would be another datacenter, not really an option unless we go back to LA which we didnt care for, or backups at the office (all we have available is 3mpbs crappy dsl).

Quote:
Originally Posted by parityboy View Post
Yeah an off-site SAN would be ideal, but "ideal" usually equals "expensive".

@OP

For those sized data sets, tape is still probably your best bet, especially since you can move the tapes into a safe, or off-site. Look at tape library systems/software such as IBM's Tivoli. It's certainly pricey, but it works.

Alternatively, you could co-locate a back up server at a data centre and spend some cash on a decent Internet up-link. The first full backup would be slow, obviously, but after that, it'd only be differential backups.

You *might* be able to

a) do a full backup to tape

b) "restore" that tape back up to the co-located server

c) point your backup software at the co-located server and tell it to do differential backups from that point onwards. That should minimise your traffic needs.
I'll have to check out that Tivoli. I havent messed with tapes in 4 years when I was at my old IT job.
__________________
Want to get ~25,000PPD folding on your i7 running a Virtual Machine?

EVGA 680i FOR SALE

i7 920 @ 4.2Ghz
HT off for now, still testing.

HEATWARE

O o
/Ż/___________________________ _\
| BBBBBAHHHHHHHHHHHHHHHHH
\_\ŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻŻ Ż/

System: LAN Rig
CPU
i7 920 (D0) @ 4.0GHz HT ON
Motherboard
Asus Rampage II GENE
Memory
6GB Crucial Dominators
Graphics Card
2x BFG GTX285
Hard Drive
~5TB (Raid 0 w/ backup drives)
Power Supply
Corsair TX750
Case
Antec 300
CPU cooling
Coolermaster V8 (WC gear is here)
GPU cooling
Stock
OS
Windows 7 Ultimate
Monitor
Samsung Syncmaster 2233RZ (120hz)
Overclock.net - 2009 Chimp Challenge Champions
SniperXX is offline   Reply With Quote
Old 09-29-09   #6 (permalink)
66MHz
 
Manyak's Avatar
 
intel ati

Join Date: Mar 2008
Posts: 7,077

Rep: 654 Manyak is becoming famousManyak is becoming famousManyak is becoming famousManyak is becoming famousManyak is becoming famousManyak is becoming famous
Unique Rep: 430
Folding Team Rank: 422
Trader Rating: 31
Default

I think the solution with the best cost/benefit ratio would be a combination of having a dedicated backup server and tape backups you take offsite.

For the dedicated backup server, if you can't afford sparing bandwidth on the main network give it a separate one with just the other servers (either through a VLAN if you've got the spare ports or with a separate switch).

Then for tape backups, alternate between two or three sets of tapes so that one of them is always offsite even during backups.

System: Obsidian Phoenix
CPU
Ci7 920 D0
Motherboard
E760 Classified
Memory
12GB G.Skill Titan DDR3-2000
Graphics Card
Waiting for HD5870x2
Hard Drive
1x Intel G2, 4x Intel G2, 1x Scorpio Black 320GB
Sound Card
Xonar D2X
Power Supply
Corsair 1000HX
Case
Corsair Obsidian 800D
CPU cooling
Heatkiller 3.0 Copper
OS
Windows 7 Ultimate
Monitor
3x Sony GDM-FW900 24" CRT's
Manyak is online now I fold for Overclock.net Overclocked Account   Reply With Quote
Old 10-09-09   #7 (permalink)
Linux Lobbyist
 
intel ati

Join Date: May 2009
Location: San Diego, CA
Posts: 233

Rep: 42 BLinux is acknowledged by some
Unique Rep: 34
Trader Rating: 0
Default

hold on there buddy... let's start with your requirements?

how many servers? how much data per server? what is your required recovery window/time? what is your backup window/time? what is your desired backup frequency for fulls and incrementals? what is your data retention policy? do you require off-site storage for disaster recovery? what does your disaster recovery plan require? what is the ballpark figure for the budget on hardware, software, labor?

when you answer those questions, the technical details start making sense. For example, i have one customer who requires a maximum recovery time of 6 hours on a maximum of 3.5TB of data. That means I need a system that can restore about 600GB of data per hour, which is 10GB/min, which is about 171MBytes/sec. this tells me that in a bare metal recovery scenario, I can't accomplish this over a 1Gbps network (which is about 120MB/sec), and I need a I/O subsystem that can sustain about 200MB/sec writes on the bare metal server, and 200MB/sec reads on the backup I/O subsystem. Once you know these numbers, then you start looking for hardware solutions that can accomplish this. Then you start looking at software solutions, etc. This is just a back of the envelope analysis of a bare metal recovery scenario, but you'll need to look into the backup scenarios, single file system recovery scenarios, disaster recovery scenarios, etc.

Start by understanding the requirements.... otherwise, later down the road you'll realize all over again that you don't have the backup solution you need.

System: AURORA
CPU
Dual Quad-core E5420 2.5Ghz 12mb cache
Motherboard
Intel 5000 chipset
Memory
48GB FBDIMM DDR2 PC2-5300 667Mhz
Graphics Card
ATI ES1000
Hard Drive
8x500GB WD5002ABYS/RAID5 PERC6/I 256MB cache
Power Supply
950W x2
OS
CentOS 5.3
BLinux is offline   Reply With Quote
Old 10-09-09   #8 (permalink)
2 + 2 = 5
 
DuckieHo's Avatar
 
intel nvidia

Join Date: Nov 2006
Location: In a Chair.
Posts: 34,932

Rep: 4172 DuckieHo is a guruDuckieHo is a guruDuckieHo is a guruDuckieHo is a guruDuckieHo is a guruDuckieHo is a guruDuckieHo is a guruDuckieHo is a guruDuckieHo is a guruDuckieHo is a guruDuckieHo is a guru
Unique Rep: 1907
Trader Rating: 56
Default

Quote:
Originally Posted by SniperXX View Post
Well the only other offsite would be another datacenter, not really an option unless we go back to LA which we didnt care for, or backups at the office (all we have available is 3mpbs crappy dsl).
Use a really long CAT6 cable.
__________________
To answer most of your questions: (1) a fridge cannot cool a PC (2) 64-bit OS for over 3.4GB (3) If a PCIe card fits, it should work (4) Resolution, not screen size (5) If you have a question, it is not news (6) Report, not respond to Spam (7) Single-Rail/Non-Modular PSUs are not always better than Multi-Rail/Modular


System: Three Dead Mobos in a Year
CPU
Q6600 (3.4GHz)
Motherboard
EVGA 780i
Memory
2x2GB OCZ Reaper 1096MHz
Graphics Card
GTX260 55nm
Hard Drive
PERC 6/i: 3xRAID0 7200.12 500GB
Sound Card
X-Fi XtremeMusic
Power Supply
Corsair 620HX
Case
Li Lian PC-V2100 [10x120mm fans]
CPU cooling
FuZion V2 + Quad-Heatercore
GPU cooling
EK Block + DDC-3.2
OS
Vista Ultimate 64
Monitor
Samsung 226BW "C" + Sceptre 19"
DuckieHo is online now Overclocked Account DuckieHo's Gallery   Reply With Quote
Old 10-12-09   #9 (permalink)
Networking Nut
 
intel nvidia

Join Date: Mar 2006
Posts: 58

Rep: 2 WBAGAM Unknown
Unique Rep: 2
Trader Rating: 0
Default

commvault software. We run it on our servers here in the data centers I support. Offsite tape backups are going to be a definite need.
__________________
System: HTPC/Gamer
CPU
Q6600
Motherboard
P5E-VM HDMI
Memory
5gb kingstion 800mhz
Graphics Card
9800gt
Hard Drive
2x 250gb + 1TB
Power Supply
Antec HE 550
Case
Lanbox Lite
OS
Vista ultimate
Monitor
22" samsung and 40" Samsung TV
WBAGAM is offline   Reply With Quote
Reply


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools



All times are GMT -5. The time now is 09:49 PM.


Overclock.net is a Carbon Neutral Site Creative Commons License

Terms of Service / Forum Rules | Privacy Policy | DMCA Info | Advertising | Become an Official Vendor
Copyright İ 2009 Shogun Interactive Development. Most rights reserved.
Page generated in 0.17186 seconds with 8 queries