Overclock.net › Forums › Components › Hard Drives & Storage › RAID Controllers and Software › How to expand RAID cards (various posts read) ?
New Posts  All Forums:Forum Nav:

How to expand RAID cards (various posts read) ? - Page 4

post #31 of 42
hmmm...you see, the SAS 6/iR is looking kind of attractive, along with IBM's M1015 and others of these kinds of cards, since storage pool technologies such as Linux RAID & LVM, and ZFS are so accessible, and CPU power is now so cheap.

Hardware RAID cards are nice, but I'll be honest, they're looking less and less attractive, at least for personal use.
Ryzen
(12 items)
 
  
CPUMotherboardGraphicsRAM
Ryzen 7 1700 Gigabyte GA-AB350M Gaming 3 Palit GT-430 Corsair Vengeance LPX CMK16GX4M2B3000C15 
Hard DriveCoolingOSMonitor
Samsung 850 EVO AMD Wraith Spire Linux Mint 18.x Dell UltraSharp U2414H 
KeyboardPowerCaseMouse
Apple Basic Keyboard Thermaltake ToughPower 850W Lian-Li PC-A04B Logitech Trackman Wheel 
  hide details  
Reply
Ryzen
(12 items)
 
  
CPUMotherboardGraphicsRAM
Ryzen 7 1700 Gigabyte GA-AB350M Gaming 3 Palit GT-430 Corsair Vengeance LPX CMK16GX4M2B3000C15 
Hard DriveCoolingOSMonitor
Samsung 850 EVO AMD Wraith Spire Linux Mint 18.x Dell UltraSharp U2414H 
KeyboardPowerCaseMouse
Apple Basic Keyboard Thermaltake ToughPower 850W Lian-Li PC-A04B Logitech Trackman Wheel 
  hide details  
Reply
post #32 of 42
I agree completely - with the latest ultra-high capacity drives, the RAID capabilities of hardware cards just isn't enough to ensure data integrity.

How long before cards start to offer more ZFS-style options in hardware I wonder?
post #33 of 42
Well I floated an idea on here a while back for a hardware RAID card along the lines of the KillerNIC; in other words a card that ran embedded Linux (let's call it "KillerRAID").

If such a card was flash-upgradeable, it's on-disk format could be compatible with Linux such that the on-disk format would look like Linux RAID formatted with (for example) btrfs. This would make the array transportable between systems, regardless of whether you had a KillerRAID installed.

Or perhaps a card with an embedded FlexRAID or unRAID installed?
Ryzen
(12 items)
 
  
CPUMotherboardGraphicsRAM
Ryzen 7 1700 Gigabyte GA-AB350M Gaming 3 Palit GT-430 Corsair Vengeance LPX CMK16GX4M2B3000C15 
Hard DriveCoolingOSMonitor
Samsung 850 EVO AMD Wraith Spire Linux Mint 18.x Dell UltraSharp U2414H 
KeyboardPowerCaseMouse
Apple Basic Keyboard Thermaltake ToughPower 850W Lian-Li PC-A04B Logitech Trackman Wheel 
  hide details  
Reply
Ryzen
(12 items)
 
  
CPUMotherboardGraphicsRAM
Ryzen 7 1700 Gigabyte GA-AB350M Gaming 3 Palit GT-430 Corsair Vengeance LPX CMK16GX4M2B3000C15 
Hard DriveCoolingOSMonitor
Samsung 850 EVO AMD Wraith Spire Linux Mint 18.x Dell UltraSharp U2414H 
KeyboardPowerCaseMouse
Apple Basic Keyboard Thermaltake ToughPower 850W Lian-Li PC-A04B Logitech Trackman Wheel 
  hide details  
Reply
post #34 of 42
Thread Starter 
(...reading your posts and studying the subject biggrin.gif...)
bubulle_b0x
(13 items)
 
  
CPUMotherboardRAMHard Drive
Intel Pentium Dual-Core E5300 Gigabyte GA-73PVM-S2H 2 Go DDR2-800 CL6 250Go ES.2 - PERC 6/i : 8*1To 7200.12 (RAID6) 
Optical DriveOSPowerCase
Optiarc AD-7240S Windows 7 Corsair CX400 Cooler Master Elite 310 
  hide details  
Reply
bubulle_b0x
(13 items)
 
  
CPUMotherboardRAMHard Drive
Intel Pentium Dual-Core E5300 Gigabyte GA-73PVM-S2H 2 Go DDR2-800 CL6 250Go ES.2 - PERC 6/i : 8*1To 7200.12 (RAID6) 
Optical DriveOSPowerCase
Optiarc AD-7240S Windows 7 Corsair CX400 Cooler Master Elite 310 
  hide details  
Reply
post #35 of 42
Thread Starter 
Well, i post this in order to update this thread.

After studying your posts, i research about ZFS and other FS...

And i found ZFS as being very interesting...

But, as i know a lot more Linux than BSD, i decided to study BtrFS (unless someone has another Linux ZFS-like FS to advice)...

But, unless i'm wrong, it doesn't seem to support RAID6 confused.gif ???

So, i came back to ZFS... and some choices appear :

- Ready-to-use solutions : FreeNas, NexentaStor, etc...
- Debian GNU/kFreeBSD (as Debian is the system i best practice)

I don't manage to choose one but i'll try to test these ones.
bubulle_b0x
(13 items)
 
  
CPUMotherboardRAMHard Drive
Intel Pentium Dual-Core E5300 Gigabyte GA-73PVM-S2H 2 Go DDR2-800 CL6 250Go ES.2 - PERC 6/i : 8*1To 7200.12 (RAID6) 
Optical DriveOSPowerCase
Optiarc AD-7240S Windows 7 Corsair CX400 Cooler Master Elite 310 
  hide details  
Reply
bubulle_b0x
(13 items)
 
  
CPUMotherboardRAMHard Drive
Intel Pentium Dual-Core E5300 Gigabyte GA-73PVM-S2H 2 Go DDR2-800 CL6 250Go ES.2 - PERC 6/i : 8*1To 7200.12 (RAID6) 
Optical DriveOSPowerCase
Optiarc AD-7240S Windows 7 Corsair CX400 Cooler Master Elite 310 
  hide details  
Reply
post #36 of 42
It'll be interesting to hear your experiences. smile.gif

@the_beast: On a PERC 6/i, what's the difference between "Consistency Check", and "Read Patrol"? I know one of them ("Read Patrol") is also known as data scrubbing, so what does the other one do?
Ryzen
(12 items)
 
  
CPUMotherboardGraphicsRAM
Ryzen 7 1700 Gigabyte GA-AB350M Gaming 3 Palit GT-430 Corsair Vengeance LPX CMK16GX4M2B3000C15 
Hard DriveCoolingOSMonitor
Samsung 850 EVO AMD Wraith Spire Linux Mint 18.x Dell UltraSharp U2414H 
KeyboardPowerCaseMouse
Apple Basic Keyboard Thermaltake ToughPower 850W Lian-Li PC-A04B Logitech Trackman Wheel 
  hide details  
Reply
Ryzen
(12 items)
 
  
CPUMotherboardGraphicsRAM
Ryzen 7 1700 Gigabyte GA-AB350M Gaming 3 Palit GT-430 Corsair Vengeance LPX CMK16GX4M2B3000C15 
Hard DriveCoolingOSMonitor
Samsung 850 EVO AMD Wraith Spire Linux Mint 18.x Dell UltraSharp U2414H 
KeyboardPowerCaseMouse
Apple Basic Keyboard Thermaltake ToughPower 850W Lian-Li PC-A04B Logitech Trackman Wheel 
  hide details  
Reply
post #37 of 42
Quote:
Originally Posted by parityboy;12096091 
@the_beast: On a PERC 6/i, what's the difference between "Consistency Check", and "Read Patrol"? I know one of them ("Read Patrol") is also known as data scrubbing, so what does the other one do?

Patrol Read reads the data off each sector from each drive independently, looking for bad sectors. If a bad sector is encountered, the PERC tells the drive to remap the sector, and uses the remaining drives' data to reconstruct the relevant sector. If it's set to manual the Patrol Read will test each sector on each disk then stop, if set to auto it will restart at the beginning and keep looping through all the sectors. This has relatively little impact on performance, as each drive basically gets on with the testing independently (as no or very few parity calcs are required, so the drives don't have to be working on the same data stripe at the same time). The controller isn't really involved either, again lessening the performance impact.

Consistency Check is a lot more involved - now the controller reads all the data from each stripe, re-calculates the parity and checks to see if everything is consistent. As this now involves parity calcs & all the drives reading specific data at once it is much more invasive, and can slow performance down considerably. Therefore it is usually done as a scheduled service over the weekend for example when the controller load is likely to be low, rather than running constantly like the Patrol Read.

In short - Patrol Read checks the disks, Consistency Check checks the data.
post #38 of 42
ahhh, so Patrol Read is more akin to something like SpinRite? Secondly, which one of those does Linux RAID do (I'm guessing it's Consistency Check, since on reflection that seems closer to the concept of data scrubbing)?

Whichever one it does, can it be made to do the other (if it doesn't do both)?
Ryzen
(12 items)
 
  
CPUMotherboardGraphicsRAM
Ryzen 7 1700 Gigabyte GA-AB350M Gaming 3 Palit GT-430 Corsair Vengeance LPX CMK16GX4M2B3000C15 
Hard DriveCoolingOSMonitor
Samsung 850 EVO AMD Wraith Spire Linux Mint 18.x Dell UltraSharp U2414H 
KeyboardPowerCaseMouse
Apple Basic Keyboard Thermaltake ToughPower 850W Lian-Li PC-A04B Logitech Trackman Wheel 
  hide details  
Reply
Ryzen
(12 items)
 
  
CPUMotherboardGraphicsRAM
Ryzen 7 1700 Gigabyte GA-AB350M Gaming 3 Palit GT-430 Corsair Vengeance LPX CMK16GX4M2B3000C15 
Hard DriveCoolingOSMonitor
Samsung 850 EVO AMD Wraith Spire Linux Mint 18.x Dell UltraSharp U2414H 
KeyboardPowerCaseMouse
Apple Basic Keyboard Thermaltake ToughPower 850W Lian-Li PC-A04B Logitech Trackman Wheel 
  hide details  
Reply
post #39 of 42
Not sure on the Linux stuff - maybe PM BLinux about it? IIRC he is pretty clued up about the Linux internals. I only know enough with Linux to get by, and mainly know the hardware stuff.
post #40 of 42
Thread Starter 
Hello,

I tried this afternoon NexentaStor and i have to admit that i liked it biggrin.gif ...

Meanwhile, my experience wasn't great enough because of the setup environment : a virtual machine with only a few resources.

Indeed, run a RAID-Z2 pool w/ 24 drives seems to need enough power biggrin.gif...

Despite the fact it's obvious that i need enough resources to run such a setup, i can't tell how much resources are needed for such a setup...

Until now, i used to let resources brought by the controller for the RAID part... But now, as all raid/parity part is run as software raid, i admit i can't imagine how much resources (CPU/RAM) are need to run flawlessly 20+ RAID-Z2 pool.

What i intend to setup later :

- 20+ drives (1TB+ drives)
- RAID-Z2
- File storage w/ SMB/CIFS
- NexentaStor VM on a free hypervisor (which one ? i often used Proxmox but i'll perhaps have to use ESXi to exploit PassThrough option ?)

If someone has example setups, i'd like to know about them smile.gif.

Thank you:
bubulle_b0x
(13 items)
 
  
CPUMotherboardRAMHard Drive
Intel Pentium Dual-Core E5300 Gigabyte GA-73PVM-S2H 2 Go DDR2-800 CL6 250Go ES.2 - PERC 6/i : 8*1To 7200.12 (RAID6) 
Optical DriveOSPowerCase
Optiarc AD-7240S Windows 7 Corsair CX400 Cooler Master Elite 310 
  hide details  
Reply
bubulle_b0x
(13 items)
 
  
CPUMotherboardRAMHard Drive
Intel Pentium Dual-Core E5300 Gigabyte GA-73PVM-S2H 2 Go DDR2-800 CL6 250Go ES.2 - PERC 6/i : 8*1To 7200.12 (RAID6) 
Optical DriveOSPowerCase
Optiarc AD-7240S Windows 7 Corsair CX400 Cooler Master Elite 310 
  hide details  
Reply
New Posts  All Forums:Forum Nav:
  Return Home
  Back to Forum: RAID Controllers and Software
Overclock.net › Forums › Components › Hard Drives & Storage › RAID Controllers and Software › How to expand RAID cards (various posts read) ?