Overclock.net › Forums › Components › Hard Drives & Storage › Drives for Array (20 TB)
New Posts  All Forums:Forum Nav:

Drives for Array (20 TB)

post #1 of 11
Thread Starter 
I was thinking about getting 8 WD 4TB Reds and running them in raid 6 just wanted input from others.

Controller: LSI 9261-8I

Also I was considering something like 4x WD xe 600GB in Raid 10 for working \ active data

Also any advice on SAS expanders would be great as well.
post #2 of 11
What case you using?

Lsi cards are not cheap



Can I ask, why raid 6 and not raid 5?
Edited by levontraut - 4/17/14 at 8:24pm
Server1 - Main
(17 items)
 
Slow Coach
(17 items)
 
 
CPUMotherboardGraphicsRAM
4790K Asus z97 Hero Gigabyte 980Ti 6gb Kingston Hyper X 2400 
Hard DriveHard DriveHard DriveCooling
M500 M500 OCZ ARC H100i 
OSMonitorMonitorMonitor
Windows 10 Enterprise  Prolite GB2488HSU Prolite GB2488HSU Prolite GB2488HSU 
KeyboardPowerCaseMouse
Razer Corsair AX860 Fractal Design R4 Razer Mamba 
Audio
Razer 
CPUMotherboardRAMHard Drive
1055T Gigabyte 990fx UD5 corsair 4 x 2 GiG 2 x 1 terabyte Western Black 
Hard DriveOptical DriveCoolingOS
3 x 500 gig WD Black Pix Fractal Design Fans x 2 Server 2012 
MonitorKeyboardPowerCase
mstsc mstsc 400 watt corsair Fractal Design R5 
MouseOtherOtherOther
mstsc EATON 5110 UPS StarView SV231UADVI KVM LSI controller card 4 port 
Other
Intel DualPort Gigabit NIC PRO1000PT 
  hide details  
Reply
Server1 - Main
(17 items)
 
Slow Coach
(17 items)
 
 
CPUMotherboardGraphicsRAM
4790K Asus z97 Hero Gigabyte 980Ti 6gb Kingston Hyper X 2400 
Hard DriveHard DriveHard DriveCooling
M500 M500 OCZ ARC H100i 
OSMonitorMonitorMonitor
Windows 10 Enterprise  Prolite GB2488HSU Prolite GB2488HSU Prolite GB2488HSU 
KeyboardPowerCaseMouse
Razer Corsair AX860 Fractal Design R4 Razer Mamba 
Audio
Razer 
CPUMotherboardRAMHard Drive
1055T Gigabyte 990fx UD5 corsair 4 x 2 GiG 2 x 1 terabyte Western Black 
Hard DriveOptical DriveCoolingOS
3 x 500 gig WD Black Pix Fractal Design Fans x 2 Server 2012 
MonitorKeyboardPowerCase
mstsc mstsc 400 watt corsair Fractal Design R5 
MouseOtherOtherOther
mstsc EATON 5110 UPS StarView SV231UADVI KVM LSI controller card 4 port 
Other
Intel DualPort Gigabit NIC PRO1000PT 
  hide details  
Reply
post #3 of 11
Thread Starter 
I got the card for $220 on ebay wink.gif


Right now I am not sure on case have been looking at a lot of different options was just trying to break cost of build up controller and drives are going to be a big part of that.

I am open to any suggestion about the build
post #4 of 11
The case pictured is a cooler master elite 335

Temps are shocking.

If I had to choose a case I would go for a fractal design r4 with a 3 in 2 drive Bay.

This will allow for 13 drives total max
The case has brilliant air flow. Lots of space. And can put a full size mobo into it.
Cable management is a dream.


Why raid 6 please and not 5?
Server1 - Main
(17 items)
 
Slow Coach
(17 items)
 
 
CPUMotherboardGraphicsRAM
4790K Asus z97 Hero Gigabyte 980Ti 6gb Kingston Hyper X 2400 
Hard DriveHard DriveHard DriveCooling
M500 M500 OCZ ARC H100i 
OSMonitorMonitorMonitor
Windows 10 Enterprise  Prolite GB2488HSU Prolite GB2488HSU Prolite GB2488HSU 
KeyboardPowerCaseMouse
Razer Corsair AX860 Fractal Design R4 Razer Mamba 
Audio
Razer 
CPUMotherboardRAMHard Drive
1055T Gigabyte 990fx UD5 corsair 4 x 2 GiG 2 x 1 terabyte Western Black 
Hard DriveOptical DriveCoolingOS
3 x 500 gig WD Black Pix Fractal Design Fans x 2 Server 2012 
MonitorKeyboardPowerCase
mstsc mstsc 400 watt corsair Fractal Design R5 
MouseOtherOtherOther
mstsc EATON 5110 UPS StarView SV231UADVI KVM LSI controller card 4 port 
Other
Intel DualPort Gigabit NIC PRO1000PT 
  hide details  
Reply
Server1 - Main
(17 items)
 
Slow Coach
(17 items)
 
 
CPUMotherboardGraphicsRAM
4790K Asus z97 Hero Gigabyte 980Ti 6gb Kingston Hyper X 2400 
Hard DriveHard DriveHard DriveCooling
M500 M500 OCZ ARC H100i 
OSMonitorMonitorMonitor
Windows 10 Enterprise  Prolite GB2488HSU Prolite GB2488HSU Prolite GB2488HSU 
KeyboardPowerCaseMouse
Razer Corsair AX860 Fractal Design R4 Razer Mamba 
Audio
Razer 
CPUMotherboardRAMHard Drive
1055T Gigabyte 990fx UD5 corsair 4 x 2 GiG 2 x 1 terabyte Western Black 
Hard DriveOptical DriveCoolingOS
3 x 500 gig WD Black Pix Fractal Design Fans x 2 Server 2012 
MonitorKeyboardPowerCase
mstsc mstsc 400 watt corsair Fractal Design R5 
MouseOtherOtherOther
mstsc EATON 5110 UPS StarView SV231UADVI KVM LSI controller card 4 port 
Other
Intel DualPort Gigabit NIC PRO1000PT 
  hide details  
Reply
post #5 of 11
Thread Starter 
Quote:
Originally Posted by levontraut View Post

Why raid 6 please and not 5?


The reason behind Raid 6 was I can have a 25% (2 of 8l) failure of drives and still not loose any data.
post #6 of 11
RAID5 on an array that size would be a very bad idea indeed. It comes down to percentages, and the likel ihood of a URE during a rebuild is incredibly high with 2TB+ disks and/or large arrays.

Personally I think R10 trumps parity arrays by a large margin, except for RAID6 in a WORM setup.
   
Z77 Bench-a-lot
(31 items)
 
CPUMotherboardGraphicsGraphics
i7 3930K @ 4.92Ghz Asus Rampage 4 Extreme EVGA GTX670 FTW 2GB  EVGA GTX780Ti Classified K|ngp|n Edition @ 1483... 
GraphicsRAMHard DriveHard Drive
EVGA GTX780Ti Classified K|ngp|n Edition @ 1483... 16GB G.Skill Ripjaws-Z @ DDR3-2248 9-10-9-26 1T Samsung 830 256GB SSD WD10EZEX 1TB HDD 
Hard DriveHard DriveHard DriveHard Drive
WD10EALX 1TB HDD Seagate Barracuda 7200.14 1TB WD3200AAKS 320GB HDD WD5000HHTZ 10krpm 500GB VelociRaptor 
Optical DriveCoolingCoolingCooling
LG/Hitachi Slim DVD-R/W Custom MB-Backside VRM-sinks (Copper) 3x NZXT RF-FX140LB 1-2krpm 98.3CFM Case Fans 2x Corsair SP120-PE Case Fans 
CoolingCoolingCoolingCooling
Heatkiller GTX680 "Hole Edition" Block + Backplate XSPC Single-Bay Res (Single 5.25 bay) EK Multioption Res X2 - Advanced 150 DD "Fill-Port Res" + Fill-Port Fitting (Red) 
CoolingCoolingCoolingCooling
2x MCP35X + Heatsinks/80x15mm Fan XSPC EX420 Alphacool NeXXos UT60 240 6x Bgears Blasters 140mm 1800rpm Fans 
CoolingCoolingCoolingOS
4x Koolance 120x25mm 2600rpm Fans Comp/Rotary Fittings (BP/XSPC/Monsoon) Primoflex Pro LRT - White (1/2x3/4) Windows 7 Professional 64bit  
MonitorMonitorMonitorMonitor
Dell P2210Hb 21.5" 1920x1080p Viewsonic VA2012WB 20.1" LCD 1680x1050 Dell U3014 Eizo 27" 1440p 10bit RGB-LED Backlit AH-IPS Panel 
MonitorKeyboardPowerCase
55" LG HDTV (their top 2014 model) Ducky Mechanical (Browns) NZXT HALE90 850W + 8 blown-up AX1200/i's NZXT Switch 810 (White) 
MouseMouse PadAudioAudio
R.A.T.3 + MX510 My Desk GRADO RS1i Headphones Grado PS1000 Headphones 
OtherOtherOtherOther
Bitfenix Hydra Pro Fan Controller 5ch 30W/ch Bitfenix Alchemy Individually-Sleeved Extension... NZXT Individually-Sleeved Front Panel Wires (Bl... Phobya Sleeved 1x3pin-to-4x3pin Fan Splitter 
OtherOtherOther
Sleeved Wires w Paracord myself (no Heatshrink) Custom Front and Top Panels w HexxMesh *In Prog... Working on Custom Pedestal Prototype 
  hide details  
Reply
   
Z77 Bench-a-lot
(31 items)
 
CPUMotherboardGraphicsGraphics
i7 3930K @ 4.92Ghz Asus Rampage 4 Extreme EVGA GTX670 FTW 2GB  EVGA GTX780Ti Classified K|ngp|n Edition @ 1483... 
GraphicsRAMHard DriveHard Drive
EVGA GTX780Ti Classified K|ngp|n Edition @ 1483... 16GB G.Skill Ripjaws-Z @ DDR3-2248 9-10-9-26 1T Samsung 830 256GB SSD WD10EZEX 1TB HDD 
Hard DriveHard DriveHard DriveHard Drive
WD10EALX 1TB HDD Seagate Barracuda 7200.14 1TB WD3200AAKS 320GB HDD WD5000HHTZ 10krpm 500GB VelociRaptor 
Optical DriveCoolingCoolingCooling
LG/Hitachi Slim DVD-R/W Custom MB-Backside VRM-sinks (Copper) 3x NZXT RF-FX140LB 1-2krpm 98.3CFM Case Fans 2x Corsair SP120-PE Case Fans 
CoolingCoolingCoolingCooling
Heatkiller GTX680 "Hole Edition" Block + Backplate XSPC Single-Bay Res (Single 5.25 bay) EK Multioption Res X2 - Advanced 150 DD "Fill-Port Res" + Fill-Port Fitting (Red) 
CoolingCoolingCoolingCooling
2x MCP35X + Heatsinks/80x15mm Fan XSPC EX420 Alphacool NeXXos UT60 240 6x Bgears Blasters 140mm 1800rpm Fans 
CoolingCoolingCoolingOS
4x Koolance 120x25mm 2600rpm Fans Comp/Rotary Fittings (BP/XSPC/Monsoon) Primoflex Pro LRT - White (1/2x3/4) Windows 7 Professional 64bit  
MonitorMonitorMonitorMonitor
Dell P2210Hb 21.5" 1920x1080p Viewsonic VA2012WB 20.1" LCD 1680x1050 Dell U3014 Eizo 27" 1440p 10bit RGB-LED Backlit AH-IPS Panel 
MonitorKeyboardPowerCase
55" LG HDTV (their top 2014 model) Ducky Mechanical (Browns) NZXT HALE90 850W + 8 blown-up AX1200/i's NZXT Switch 810 (White) 
MouseMouse PadAudioAudio
R.A.T.3 + MX510 My Desk GRADO RS1i Headphones Grado PS1000 Headphones 
OtherOtherOtherOther
Bitfenix Hydra Pro Fan Controller 5ch 30W/ch Bitfenix Alchemy Individually-Sleeved Extension... NZXT Individually-Sleeved Front Panel Wires (Bl... Phobya Sleeved 1x3pin-to-4x3pin Fan Splitter 
OtherOtherOther
Sleeved Wires w Paracord myself (no Heatshrink) Custom Front and Top Panels w HexxMesh *In Prog... Working on Custom Pedestal Prototype 
  hide details  
Reply
post #7 of 11
Quote:
Originally Posted by nleksan View Post

RAID5 on an array that size would be a very bad idea indeed. It comes down to percentages, and the likel ihood of a URE during a rebuild is incredibly high with 2TB+ disks and/or large arrays.

Personally I think R10 trumps parity arrays by a large margin, except for RAID6 in a WORM setup.

I kind of have to agree with this.

also with the drives you save from using raid 10 over 6 you can use them as backups?
Server1 - Main
(17 items)
 
Slow Coach
(17 items)
 
 
CPUMotherboardGraphicsRAM
4790K Asus z97 Hero Gigabyte 980Ti 6gb Kingston Hyper X 2400 
Hard DriveHard DriveHard DriveCooling
M500 M500 OCZ ARC H100i 
OSMonitorMonitorMonitor
Windows 10 Enterprise  Prolite GB2488HSU Prolite GB2488HSU Prolite GB2488HSU 
KeyboardPowerCaseMouse
Razer Corsair AX860 Fractal Design R4 Razer Mamba 
Audio
Razer 
CPUMotherboardRAMHard Drive
1055T Gigabyte 990fx UD5 corsair 4 x 2 GiG 2 x 1 terabyte Western Black 
Hard DriveOptical DriveCoolingOS
3 x 500 gig WD Black Pix Fractal Design Fans x 2 Server 2012 
MonitorKeyboardPowerCase
mstsc mstsc 400 watt corsair Fractal Design R5 
MouseOtherOtherOther
mstsc EATON 5110 UPS StarView SV231UADVI KVM LSI controller card 4 port 
Other
Intel DualPort Gigabit NIC PRO1000PT 
  hide details  
Reply
Server1 - Main
(17 items)
 
Slow Coach
(17 items)
 
 
CPUMotherboardGraphicsRAM
4790K Asus z97 Hero Gigabyte 980Ti 6gb Kingston Hyper X 2400 
Hard DriveHard DriveHard DriveCooling
M500 M500 OCZ ARC H100i 
OSMonitorMonitorMonitor
Windows 10 Enterprise  Prolite GB2488HSU Prolite GB2488HSU Prolite GB2488HSU 
KeyboardPowerCaseMouse
Razer Corsair AX860 Fractal Design R4 Razer Mamba 
Audio
Razer 
CPUMotherboardRAMHard Drive
1055T Gigabyte 990fx UD5 corsair 4 x 2 GiG 2 x 1 terabyte Western Black 
Hard DriveOptical DriveCoolingOS
3 x 500 gig WD Black Pix Fractal Design Fans x 2 Server 2012 
MonitorKeyboardPowerCase
mstsc mstsc 400 watt corsair Fractal Design R5 
MouseOtherOtherOther
mstsc EATON 5110 UPS StarView SV231UADVI KVM LSI controller card 4 port 
Other
Intel DualPort Gigabit NIC PRO1000PT 
  hide details  
Reply
post #8 of 11
If I were building a new NAS I'd look at using the ZFS file system. ZFS+2 = raid 6. It has built-in error correction which benefits today's high density drives and lots of other cool features. Of course using a stable version of it pretty much limits you to BSD OS builds such as nas4free, freenas, ...

Keep in mind the second parity disk in a raid6 generally comes with quite a write penalty. My NAS currently holds 10x 2TB WD greens in Raid6. Never had any trouble but the reds are better in a NAS particularly with heavier use or should one in a raid have small errors or start failing. Keep in mind a full write check on 2TB took me roughly 9 hours, so a rebuild for a 4TB drive would take roughly 18 hours which is part of why you don't want just raid 5.

It somewhat confuses me why people would recommend raid 10 for a backup or archiving volume. Yes the performance is much better but the protection in a worst case scenario is essentially that of a raid5. With 8 drives: A1 B1 C1 D1 + A2 B2 C2 D2. If drive A1 fails you have a 1 in 7 chance that a second failure is drive A2 destroying all your data. Which to me would be an unacceptable risk... Also you lose half the drives for mirroring rather than 2 drives for parity, so R10 = +/- 16TB vs R6 = +/- 24TB. That said raid 10 is great for a high performance scratch drive and it all depends on cost/benefit for your application.

Also keep in mind - raid is not backup. One lightning bolt -or any catastrophic failure- can destroy multiple or even all drives. Always keep a backup!
3930K
(19 items)
 
  
CPUMotherboardGraphicsRAM
Intel Core i7 3930K [C2 rev] Gigabyte X79-UD3 Sapphire Radeon HD 7950 OC G.Skill 32GB PC3-12800 RipjawsZ DDR3 SDRAM (4x ... 
Hard DriveOptical DriveCoolingOS
Samsung 512GB 830 SSD LG USB DVD-RW Noctua NH-D14 CPU Cooling Socket 2011 Win7 x64 Ultimate 
OSMonitorMonitorKeyboard
Debian amd64 7.2 LG 47" LX9500 TV 5x1P Dell U2713HM Ergonomic Microsoft wired keyboard 
PowerCaseMouseMouse Pad
OCZ ZX 1250W APLUS Case Monolize, ATX, Black, 2x250mm Fans Logitech MX518 generic 
AudioAudioAudio
onboard sound card Onkyo TX-NR1009 receiver Jamo S 606 HCS 5 - 5.1 speakers 
  hide details  
Reply
3930K
(19 items)
 
  
CPUMotherboardGraphicsRAM
Intel Core i7 3930K [C2 rev] Gigabyte X79-UD3 Sapphire Radeon HD 7950 OC G.Skill 32GB PC3-12800 RipjawsZ DDR3 SDRAM (4x ... 
Hard DriveOptical DriveCoolingOS
Samsung 512GB 830 SSD LG USB DVD-RW Noctua NH-D14 CPU Cooling Socket 2011 Win7 x64 Ultimate 
OSMonitorMonitorKeyboard
Debian amd64 7.2 LG 47" LX9500 TV 5x1P Dell U2713HM Ergonomic Microsoft wired keyboard 
PowerCaseMouseMouse Pad
OCZ ZX 1250W APLUS Case Monolize, ATX, Black, 2x250mm Fans Logitech MX518 generic 
AudioAudioAudio
onboard sound card Onkyo TX-NR1009 receiver Jamo S 606 HCS 5 - 5.1 speakers 
  hide details  
Reply
post #9 of 11
Thread Starter 
What does everyone think of something like this for a case

http://www.newegg.com/Product/Product.aspx?Item=N82E16816101796&ignorebbr=1

Also any reason this cpu wouldn't work since they are same socket http://www.newegg.com/Product/Product.aspx?Item=N82E16819116940
post #10 of 11
Thread Starter 
From what I have seen I will not be able to use IVy-E with the motherboard so I was looking at this http://www.newegg.com/Product/Product.aspx?Item=N82E16819116934 (Xeon E5-2620)

That means the biggest thing left is Hard drives:
What would be the best drives to run in largers slower array used for write once read a lot and the smaller faster array with lots of read \ writes?

I was considered using 6x600gb wd xe's in raid 10 for the small fast array instead of the orginal 4 I posted cause it would put me close to 2TBs.
New Posts  All Forums:Forum Nav:
  Return Home
  Back to Forum: Hard Drives & Storage
Overclock.net › Forums › Components › Hard Drives & Storage › Drives for Array (20 TB)