Overclock.net › Forums › Components › Hard Drives & Storage › RAID Controllers and Software › Ideal RAID choices for media, and general program storage?
New Posts  All Forums:Forum Nav:

Ideal RAID choices for media, and general program storage? - Page 2

post #11 of 18
Thread Starter 
The RAID 0 plus JBOD option isn't available, as I would be using the onboard controller for those four disks, and the motherboard doesn't support JBOD setups, only RAID 0/1/5/10. The suggestion of RAID 50/60 has been considered for this build. I am keeping an eye out for RAID Controllers that can support it, however I have been having trouble finding ones that have decent reliability.

As for ZFS, I would need a more straight forward explanation of what that is, as it is something I've never heard of before, and it takes me a really long time to go through pages that big (not a fast reader).

Lastly, about the comment regarding RAID setups and SSD's, I've heard that there is no real advantage to using SSDs in a RAID setup (the main exception being RAID 1 for the OS), and even heard that there are potential disadvantages due to them just plain quitting after enough write operations being made to the flash memory, as apposed to developing individual bad sectors on a magnetic disk...then there's the problem of not having the capacity I need for the 10TB drives (already have the 5TB drives installed).
Edited by Elanachan - 7/20/17 at 6:55pm
post #12 of 18
Quote:
Originally Posted by Elanachan View Post


As for ZFS, I would need a more straight forward explanation of what that is, as it is something I've never heard of before, and it takes me a really long time to go through pages that big (not a fast reader).

Its software raid in a nutshell. Software raid is what you should be looking at anyways over hardware raid. Its much easier to manage and you are not dependent on another piece of hardware to ensure everything is operational.

Ill just say any type of onsite raid is not a backup. However, if i was looking at something to just build to have the extra space knowing full well i can lose everything at any minute i wouldn't go below raid6 / raidz2 and plan ahead for future issues / offsite locations.

Check out Freenas, Nas4free, Unraid, Openmediavault, Linux with zfs... something built with data storage and integrity in mind and move away from dealing with anything related to hardware raid
Edited by burksdb - 7/20/17 at 7:09pm
Home
(13 items)
 
Server
(15 items)
 
 
CPUMotherboardGraphicsRAM
r7 1700 Asrock Fatal1ty X370 Gaming-ITX/ac Evga 1080ti SC Black Edition 16GB G.SKILL TridentZ Series  
Hard DriveCoolingOSMonitor
256gb Samsung p951 Noctua U9s Windows 10 Pro Sony XBR43X830C 43" 4K 
MonitorKeyboardPowerMouse
Monoprice 28" 4k Logitech g810 Pro Corsair SF600 Logitech G900 Chaos 
Mouse Pad
Steelseries QCK 
CPUCPUMotherboardRAM
Intel L5640 Intel L5640  Supermicro - X8DT3 24Gb ECC 
Hard DriveHard DriveHard DriveOS
4x 128gb ssd's raid 0 - Cache Wd Red 3tb Seagate 8tb smr - parity Unriad 6.2 
PowerCaseOtherOther
ThermalTake 700 watt  Norco 4220 HP sas expander Lsi 9211-8i 
  hide details  
Reply
Home
(13 items)
 
Server
(15 items)
 
 
CPUMotherboardGraphicsRAM
r7 1700 Asrock Fatal1ty X370 Gaming-ITX/ac Evga 1080ti SC Black Edition 16GB G.SKILL TridentZ Series  
Hard DriveCoolingOSMonitor
256gb Samsung p951 Noctua U9s Windows 10 Pro Sony XBR43X830C 43" 4K 
MonitorKeyboardPowerMouse
Monoprice 28" 4k Logitech g810 Pro Corsair SF600 Logitech G900 Chaos 
Mouse Pad
Steelseries QCK 
CPUCPUMotherboardRAM
Intel L5640 Intel L5640  Supermicro - X8DT3 24Gb ECC 
Hard DriveHard DriveHard DriveOS
4x 128gb ssd's raid 0 - Cache Wd Red 3tb Seagate 8tb smr - parity Unriad 6.2 
PowerCaseOtherOther
ThermalTake 700 watt  Norco 4220 HP sas expander Lsi 9211-8i 
  hide details  
Reply
post #13 of 18
Thread Starter 
The main reason why I'm insisting on hardware RAID is because I am going to be using both linux and windows with this build, and as far as I know, there isn't any kind of RAID software that would work effectively with both operating systems. I also knew that I'd be getting a controller for the 8 drive array simply because there aren't enough sata ports on the motherboard to support a total of 15 drives, so even if I did go with some kind of alternative, the hardware would probably still be in the system.
post #14 of 18
Quote:
Originally Posted by Elanachan View Post

The main reason why I'm insisting on hardware RAID is because I am going to be using both linux and windows with this build, and as far as I know, there isn't any kind of RAID software that would work effectively with both operating systems.


Your wanting to dual boot your desktop and still have access to a raid installed in that same machine - if thats the case i would highly avoid doing this and build a proper storage solution
Home
(13 items)
 
Server
(15 items)
 
 
CPUMotherboardGraphicsRAM
r7 1700 Asrock Fatal1ty X370 Gaming-ITX/ac Evga 1080ti SC Black Edition 16GB G.SKILL TridentZ Series  
Hard DriveCoolingOSMonitor
256gb Samsung p951 Noctua U9s Windows 10 Pro Sony XBR43X830C 43" 4K 
MonitorKeyboardPowerMouse
Monoprice 28" 4k Logitech g810 Pro Corsair SF600 Logitech G900 Chaos 
Mouse Pad
Steelseries QCK 
CPUCPUMotherboardRAM
Intel L5640 Intel L5640  Supermicro - X8DT3 24Gb ECC 
Hard DriveHard DriveHard DriveOS
4x 128gb ssd's raid 0 - Cache Wd Red 3tb Seagate 8tb smr - parity Unriad 6.2 
PowerCaseOtherOther
ThermalTake 700 watt  Norco 4220 HP sas expander Lsi 9211-8i 
  hide details  
Reply
Home
(13 items)
 
Server
(15 items)
 
 
CPUMotherboardGraphicsRAM
r7 1700 Asrock Fatal1ty X370 Gaming-ITX/ac Evga 1080ti SC Black Edition 16GB G.SKILL TridentZ Series  
Hard DriveCoolingOSMonitor
256gb Samsung p951 Noctua U9s Windows 10 Pro Sony XBR43X830C 43" 4K 
MonitorKeyboardPowerMouse
Monoprice 28" 4k Logitech g810 Pro Corsair SF600 Logitech G900 Chaos 
Mouse Pad
Steelseries QCK 
CPUCPUMotherboardRAM
Intel L5640 Intel L5640  Supermicro - X8DT3 24Gb ECC 
Hard DriveHard DriveHard DriveOS
4x 128gb ssd's raid 0 - Cache Wd Red 3tb Seagate 8tb smr - parity Unriad 6.2 
PowerCaseOtherOther
ThermalTake 700 watt  Norco 4220 HP sas expander Lsi 9211-8i 
  hide details  
Reply
post #15 of 18
Thread Starter 
Why would this be such an issue if the RAID levels can be configured at the BIOS level, as I've been told?

Edit: After doing more research on it, the ZFS system does look like the ideal setup for the 8 drive array, however I do not know if such a setup could be done where it is implemented before either OS starts in such a way where it would be cross compatible between the two.
Edited by Elanachan - 7/20/17 at 7:48pm
post #16 of 18
Thread Starter 
After looking it up even more, it has been suggested that I might actually want to run FreeBSD as the core operating system, and run the ZFS system through that, and then run both windows and linux as guest operating systems. Would something like this be viable?
post #17 of 18
Honestly, I would do more research. I know you're not big on reading long blocks of text, but managing a RAID BIOS, the ZFS CLI, configuring BSD or a hypervisor, etc - every step is going to require a few manuals to be read.

For example, building a ZFS system at all would generally require ECC RAM, and ideally a UPS as well. ZFS can comfortably max out two CPU cores, so running a Windows VM on top of BSD would require a pretty beefy processor for any real performance.

More, it is generally recommended to have 8GB + 1GB per TB of storage for ZFS, so with a 80TB (50/60TB usable) you'd want 64GB of ECC RAM (and then your Windows VM would have very little RAM left to utilize).

For all of these reasons, users typically run their ZFS box as a standalone server, running VMs for lighter services like torrents and plex and apache and the like, and keep a dedicated machine for work and play (ZFS is compatible with most major OSs).

So, I'd read more, and consider building a standalone ZFS-NAS for those 8x10TB drives.

As for your current disks:
Quote:
Originally Posted by Elanachan View Post

The RAID 0 plus JBOD option isn't available, as I would be using the onboard controller for those four disks, and the motherboard doesn't support JBOD setups, only RAID 0/1/5/10.
I was suggesting purchasing an external exclosure that can handle two disks. This would leave two disks in your system in RAID and two disks in the external enclosure for backup.

Alternatively you could run 2x disks in RAID from the controller and then leave 2 removed from the RAID but connected to your motherboard for backup (ie internally).

Or you could just run all 4 in RAID, but when it fails you'll be at high risk of data loss and will be dependent on your motherboard's controller (I haven't heard many good stories about moving an Intel SW RAID from one board to another, but YMMV).
Quote:
Lastly, about the comment regarding RAID setups and SSD's, I've heard that there is no real advantage to using SSDs in a RAID setup (the main exception being RAID 1 for the OS), and even heard that there are potential disadvantages due to them just plain quitting after enough write operations being made to the flash memory, as apposed to developing individual bad sectors on a magnetic disk...
This is all true. To be clear, I only recommend hardware RAID for maximum performance, which is why I suggest SSDs. I see all arrays as disposable (because disks fail), so the only purpose of such an array would be a scratch disk for high IO operations (like AV work) where data is managed before it's stored somewhere else.
Edited by claes - 7/22/17 at 12:34pm
finally quiet
(20 items)
 
Peggy
(11 items)
 
Betty - WIP
(17 items)
 
CPUMotherboardGraphicsRAM
i5-760 3.8 + turbo MSI P55-GD80 MSI GTX 970 Golden Edition 16GB Tactical LP 1600 c8 
Hard DriveHard DriveHard DriveCooling
Samsung 840 Pro 128GB OCZ Agility 60GB Spinpoint F3 1TB Noctua NH-U12P SE2 
CoolingOSMonitorMonitor
2x NF-P12, CPU OS X 10.10, 8.1 Ultimate Asus VW246H Ergotron Neo-Flex 
KeyboardPowerCaseMouse
CM Quick Fire Rapid EVGA Supernova G2 850W Silverstone FT-02W CM Spawn 
AudioAudioAudio
Sony TA-AX380 Sennheiser HD 280 KLH 911B 
CPUMotherboardGraphicsRAM
i3-2125 GA-H61N USB3 HD3000 8GB Samsung Miracle RAM 
Hard DriveHard DriveHard DriveCooling
Kingston 60GB 3ware/LSI 9750-4i Hitachi 5k3000 2TB x4 RAID 5 Intel for now 
OSPowerCase
OS X 10.8.2 Corsiar CX430M Fractal Design Node 304 
CPUMotherboardGraphicsRAM
i3-2100 ASUS P8H67-M PRO/CSM ASUS Passive GT 440 4GB Dominator 1600 c8 
Hard DriveOptical DriveCoolingCooling
Hitachi 120GB 2.5" LG BR-RW CM GeminII S + NF-P12 2x NF-R8 - Intake 
CoolingOSMonitorKeyboard
NF-B9 Windows 7 Sony KDL-46NX700 MK700 
PowerCaseMouseAudio
Antec EA-650 Zalman HD160XT, Modded MK700 Yamaha RX-V373 
  hide details  
Reply
finally quiet
(20 items)
 
Peggy
(11 items)
 
Betty - WIP
(17 items)
 
CPUMotherboardGraphicsRAM
i5-760 3.8 + turbo MSI P55-GD80 MSI GTX 970 Golden Edition 16GB Tactical LP 1600 c8 
Hard DriveHard DriveHard DriveCooling
Samsung 840 Pro 128GB OCZ Agility 60GB Spinpoint F3 1TB Noctua NH-U12P SE2 
CoolingOSMonitorMonitor
2x NF-P12, CPU OS X 10.10, 8.1 Ultimate Asus VW246H Ergotron Neo-Flex 
KeyboardPowerCaseMouse
CM Quick Fire Rapid EVGA Supernova G2 850W Silverstone FT-02W CM Spawn 
AudioAudioAudio
Sony TA-AX380 Sennheiser HD 280 KLH 911B 
CPUMotherboardGraphicsRAM
i3-2125 GA-H61N USB3 HD3000 8GB Samsung Miracle RAM 
Hard DriveHard DriveHard DriveCooling
Kingston 60GB 3ware/LSI 9750-4i Hitachi 5k3000 2TB x4 RAID 5 Intel for now 
OSPowerCase
OS X 10.8.2 Corsiar CX430M Fractal Design Node 304 
CPUMotherboardGraphicsRAM
i3-2100 ASUS P8H67-M PRO/CSM ASUS Passive GT 440 4GB Dominator 1600 c8 
Hard DriveOptical DriveCoolingCooling
Hitachi 120GB 2.5" LG BR-RW CM GeminII S + NF-P12 2x NF-R8 - Intake 
CoolingOSMonitorKeyboard
NF-B9 Windows 7 Sony KDL-46NX700 MK700 
PowerCaseMouseAudio
Antec EA-650 Zalman HD160XT, Modded MK700 Yamaha RX-V373 
  hide details  
Reply
post #18 of 18
Thread Starter 
claes, this is the hardware setup that I had intended, currently installed parts listed first:


Case: Caselabs S8 w/pedestal

Processor: i7-6700k

Motherboard Gigabyte GA-Z170X-Gaming G1

Ram: G.Skill Ripjaws V 64GB (4x16GB) DDR4 3000MHz

Hard drives:
2x Sandisk SD8SN8U-1T00-1122 X400 1TB M.2 2280 Solid State Drive (hardware RAID 1 using motherboard)
5x Seagate 5TB Barracuda Sata 6GB/s 128MB Cache 2.5-Inch 15mm Internal Bare/OEM Hard Drive (ST5000LM000) (intended on hardware RAID 5 or 10 using motherboard)

Optical Drive:
LG BU20N Internal Blu-ray Writer

Drive enclosure
ICY DOCK 2 Bay 2.5 HDD SSD Hot Swap Backplane Cage Mobile Rack with Slim ODD Tray for 5.25 Drive Bay - ToughArmor MB994IPO-3SB


To be added:
Drives:
2x 2.5" SSD for RAID 0 scratch disk (again using motherboard hardware raid controller)
8x 3.5" 10TB HDD for media storage (original intention was combining them in RAID 5, 6 or 10, Raid 50/60 wasn't seen much when initially designed.)

PCI cards:

1x dual slot, or 2x single slot (water cooled) graphics card (1050 TI temporarily installed)
Dual slot audio card with 6.35mm audio jacks
Digital Video Recorder
Analog Video Recorder (can't find a single card that does both digital and analog togeather)
Wifi Adapter (incase onboard adapter fails)
RAID controller for x8 HDD array

The grand design of this build includes everything listed above, and anything external to the case is not being included in this part list, including any external backup drives. I opened up this thread to find the best configuration for the hardware, given what will be inhabiting the case once the case is completed.
New Posts  All Forums:Forum Nav:
  Return Home
  Back to Forum: RAID Controllers and Software
Overclock.net › Forums › Components › Hard Drives & Storage › RAID Controllers and Software › Ideal RAID choices for media, and general program storage?