Overclock.net › Forums › Specialty Builds › Servers › Thinking of Creating "Massive" Storage Server
New Posts  All Forums:Forum Nav:

Thinking of Creating "Massive" Storage Server - Page 2

post #11 of 39
Another admittedly small benefit to either Unraid or Snapraid is that drives are independent. They can spin down when not in use. Normal raid styles including ZFS require all drives to be spinning all the time. Drives wear out faster + eats the electric bill a bit. More than a few drives and it can be very noticeable.

I know my server at the moment as listed in sig runs around $1 (US) a month on the electric bill. That would go up a couple hundred % easy if I added a handful of spinning drives in a standard zfs / raid solution. SnapRaid or Unraid and it would barely budge since they can spin down.

Justify low power use with global warming, save money on electric bill cost, just like to save electricity... pick your poison.
Edited by Tadaen Sylvermane - 4/15/17 at 12:22pm
 
Micromachine
(8 items)
 
 
CPUMotherboardGraphicsRAM
i7 4500u Inspiron 15 7000 Integrated 8gb 
Hard DriveOSMouse
120gb Samsung EVO SSD Ubuntu 16.04 Logitech m705 
CPUMotherboardRAMHard Drive
AMD 5350 Kabini AsRock AM1H-ITX 8gb Gskill Ripjaws (2x4) Samsung 120 Evo 
Hard DriveHard DriveOSCase
WD 1tb 2.5 WD 2tb USB 3.0 Ubuntu Server 16.04 Antec ISK 
  hide details  
Reply
 
Micromachine
(8 items)
 
 
CPUMotherboardGraphicsRAM
i7 4500u Inspiron 15 7000 Integrated 8gb 
Hard DriveOSMouse
120gb Samsung EVO SSD Ubuntu 16.04 Logitech m705 
CPUMotherboardRAMHard Drive
AMD 5350 Kabini AsRock AM1H-ITX 8gb Gskill Ripjaws (2x4) Samsung 120 Evo 
Hard DriveHard DriveOSCase
WD 1tb 2.5 WD 2tb USB 3.0 Ubuntu Server 16.04 Antec ISK 
  hide details  
Reply
post #12 of 39
Quote:
Originally Posted by Liranan View Post

This is why I use SnapRAID. Not only can the drives be migrated to any other PC but the data remains intact and untouched by the RAID software.

Yup. I'd be using SnapRAID if it included some type of easy to setup caching feature.
post #13 of 39
Thread Starter 

So if I'm understanding correctly, the parity drives have to be equal or greater than the next biggest drive. So if I want to run 8x 10TB drives, that would be 20TB parity and 60TB usable? Does it work the same way for the cache drive or can that be smaller? Does it require the firmware for RAID in more expensive HDDs or is that not required for unRAID? Thanks for all the help guys.

Be Rock Steady
(19 items)
 
  
CPUMotherboardGraphicsRAM
i7-2600K 4.7ghz @ 1.33 ASUS P8Z68 Deluxe Titan X Corsair Vengeance 16GB PC12800 DDR3 
Hard DriveHard DriveHard DriveCooling
Corsair Force CSSD-F115GB Seagate 1tb Western Digital 3TB bare H100 
OSMonitorKeyboardPower
Windows 7 Home Premium qnix kul es-87 Cooler Master Silent Pro M850 
CaseMouseAudioAudio
Corsair Obsidian 800D Razer Deathadder BE Schiit Audio Bifrost Uber Schiit Audio Lyr 2 
Audio
Audeze LCD-2 
  hide details  
Reply
Be Rock Steady
(19 items)
 
  
CPUMotherboardGraphicsRAM
i7-2600K 4.7ghz @ 1.33 ASUS P8Z68 Deluxe Titan X Corsair Vengeance 16GB PC12800 DDR3 
Hard DriveHard DriveHard DriveCooling
Corsair Force CSSD-F115GB Seagate 1tb Western Digital 3TB bare H100 
OSMonitorKeyboardPower
Windows 7 Home Premium qnix kul es-87 Cooler Master Silent Pro M850 
CaseMouseAudioAudio
Corsair Obsidian 800D Razer Deathadder BE Schiit Audio Bifrost Uber Schiit Audio Lyr 2 
Audio
Audeze LCD-2 
  hide details  
Reply
post #14 of 39
Quote:
Originally Posted by B-rock View Post

So if I'm understanding correctly, the parity drives have to be equal or greater than the next biggest drive. So if I want to run 8x 10TB drives, that would be 20TB parity and 60TB usable? Does it work the same way for the cache drive or can that be smaller? Does it require the firmware for RAID in more expensive HDDs or is that not required for unRAID? Thanks for all the help guys.

You understand the parity drives correctly. No special firmware required and the cache drives can be any size you want. You just want to ensure they are large enough for any sustained writes to the array so that you can maintain good speeds plus the expected size of any high performance shares (VMs/Dockers) you want to set as cache only.
Edited by PuffinMyLye - 4/15/17 at 4:19pm
post #15 of 39
Thread Starter 
Quote:
Originally Posted by PuffinMyLye View Post

No special firmware required

Man, I'm having a hard time seeing why anyone would use regular RAID anymore then, seems archaic.

Be Rock Steady
(19 items)
 
  
CPUMotherboardGraphicsRAM
i7-2600K 4.7ghz @ 1.33 ASUS P8Z68 Deluxe Titan X Corsair Vengeance 16GB PC12800 DDR3 
Hard DriveHard DriveHard DriveCooling
Corsair Force CSSD-F115GB Seagate 1tb Western Digital 3TB bare H100 
OSMonitorKeyboardPower
Windows 7 Home Premium qnix kul es-87 Cooler Master Silent Pro M850 
CaseMouseAudioAudio
Corsair Obsidian 800D Razer Deathadder BE Schiit Audio Bifrost Uber Schiit Audio Lyr 2 
Audio
Audeze LCD-2 
  hide details  
Reply
Be Rock Steady
(19 items)
 
  
CPUMotherboardGraphicsRAM
i7-2600K 4.7ghz @ 1.33 ASUS P8Z68 Deluxe Titan X Corsair Vengeance 16GB PC12800 DDR3 
Hard DriveHard DriveHard DriveCooling
Corsair Force CSSD-F115GB Seagate 1tb Western Digital 3TB bare H100 
OSMonitorKeyboardPower
Windows 7 Home Premium qnix kul es-87 Cooler Master Silent Pro M850 
CaseMouseAudioAudio
Corsair Obsidian 800D Razer Deathadder BE Schiit Audio Bifrost Uber Schiit Audio Lyr 2 
Audio
Audeze LCD-2 
  hide details  
Reply
post #16 of 39
Quote:
Originally Posted by B-rock View Post

Man, I'm having a hard time seeing why anyone would use regular RAID anymore then, seems archaic.

The main reason is if you need high performance reads as with non-striped you are limited to the performance of a single drive since files are non striped across multiple drives.
Edited by PuffinMyLye - 4/15/17 at 9:26pm
post #17 of 39
To be fair, you don't really need enterprise drives/special firmware for any RAID, although some disks may require changing settings (notably older WD Greens).
finally quiet
(20 items)
 
Peggy
(11 items)
 
Betty - WIP
(17 items)
 
CPUMotherboardGraphicsRAM
i5-760 3.8 + turbo MSI P55-GD80 MSI GTX 970 Golden Edition 16GB Tactical LP 1600 c8 
Hard DriveHard DriveHard DriveCooling
Samsung 840 Pro 128GB OCZ Agility 60GB Spinpoint F3 1TB Noctua NH-U12P SE2 
CoolingOSMonitorMonitor
2x NF-P12, CPU OS X 10.10, 8.1 Ultimate Asus VW246H Ergotron Neo-Flex 
KeyboardPowerCaseMouse
CM Quick Fire Rapid EVGA Supernova G2 850W Silverstone FT-02W CM Spawn 
AudioAudioAudio
Sony TA-AX380 Sennheiser HD 280 KLH 911B 
CPUMotherboardGraphicsRAM
i3-2125 GA-H61N USB3 HD3000 8GB Samsung Miracle RAM 
Hard DriveHard DriveHard DriveCooling
Kingston 60GB 3ware/LSI 9750-4i Hitachi 5k3000 2TB x4 RAID 5 Intel for now 
OSPowerCase
OS X 10.8.2 Corsiar CX430M Fractal Design Node 304 
CPUMotherboardGraphicsRAM
i3-2100 ASUS P8H67-M PRO/CSM ASUS Passive GT 440 4GB Dominator 1600 c8 
Hard DriveOptical DriveCoolingCooling
Hitachi 120GB 2.5" LG BR-RW CM GeminII S + NF-P12 2x NF-R8 - Intake 
CoolingOSMonitorKeyboard
NF-B9 Windows 7 Sony KDL-46NX700 MK700 
PowerCaseMouseAudio
Antec EA-650 Zalman HD160XT, Modded MK700 Yamaha RX-V373 
  hide details  
Reply
finally quiet
(20 items)
 
Peggy
(11 items)
 
Betty - WIP
(17 items)
 
CPUMotherboardGraphicsRAM
i5-760 3.8 + turbo MSI P55-GD80 MSI GTX 970 Golden Edition 16GB Tactical LP 1600 c8 
Hard DriveHard DriveHard DriveCooling
Samsung 840 Pro 128GB OCZ Agility 60GB Spinpoint F3 1TB Noctua NH-U12P SE2 
CoolingOSMonitorMonitor
2x NF-P12, CPU OS X 10.10, 8.1 Ultimate Asus VW246H Ergotron Neo-Flex 
KeyboardPowerCaseMouse
CM Quick Fire Rapid EVGA Supernova G2 850W Silverstone FT-02W CM Spawn 
AudioAudioAudio
Sony TA-AX380 Sennheiser HD 280 KLH 911B 
CPUMotherboardGraphicsRAM
i3-2125 GA-H61N USB3 HD3000 8GB Samsung Miracle RAM 
Hard DriveHard DriveHard DriveCooling
Kingston 60GB 3ware/LSI 9750-4i Hitachi 5k3000 2TB x4 RAID 5 Intel for now 
OSPowerCase
OS X 10.8.2 Corsiar CX430M Fractal Design Node 304 
CPUMotherboardGraphicsRAM
i3-2100 ASUS P8H67-M PRO/CSM ASUS Passive GT 440 4GB Dominator 1600 c8 
Hard DriveOptical DriveCoolingCooling
Hitachi 120GB 2.5" LG BR-RW CM GeminII S + NF-P12 2x NF-R8 - Intake 
CoolingOSMonitorKeyboard
NF-B9 Windows 7 Sony KDL-46NX700 MK700 
PowerCaseMouseAudio
Antec EA-650 Zalman HD160XT, Modded MK700 Yamaha RX-V373 
  hide details  
Reply
post #18 of 39
Quote:
Originally Posted by B-rock View Post
 

So if I'm understanding correctly, the parity drives have to be equal or greater than the next biggest drive. So if I want to run 8x 10TB drives, that would be 20TB parity and 60TB usable? Does it work the same way for the cache drive or can that be smaller? Does it require the firmware for RAID in more expensive HDDs or is that not required for unRAID? Thanks for all the help guys.

You can buy special NAS drives such as the WD Reds and Seagate NAS drives or you can buy regular Toshiba DT01ACA300's. WD Reds and Seagate NAS are 5400 RPM drives and the Toshiba are regular 7200 rpm drives with CCTL enabled and I believe they are the best drives for the price. They are in effect consumer NAS drives as they have all the technology that WD and Seagate toute as being NAS drive exclusives and they are much cheaper and faster than either WD or Seagate.

 

Quote:
Originally Posted by B-rock View Post
 
Quote:
Originally Posted by PuffinMyLye View Post

No special firmware required

Man, I'm having a hard time seeing why anyone would use regular RAID anymore then, seems archaic.

Because of read speeds. There is no way Netflix could run UnRAID or SnapRAID due to the number of people who access their servers. For a home server Windows XP with SnapRAID is fine but cloud storage or streaming service with massive users need as high read/writes as they can get and SnapRAID and UnRAID are both limited to single drive reads and writes.

The girlfriend.
(15 items)
 
The Mistress
(13 items)
 
Media Server
(11 items)
 
CPUMotherboardGraphicsRAM
FX8320 @ 4.5 Crosshair V (Third One) 290 Tri-X OC 16GB HyperX 
Hard DriveHard DriveHard DriveCooling
Sandisk SSD Plus 240GB Toshiba 3TB Hitachi 2TB Swiftech H220-X 
OSMonitorKeyboardPower
Win 8.1/Mint Viewsonic VX2457-mhd Fuhlen L411 Slim Super Flower Golden King 650W 
CaseMouseMouse Pad
Enthoo Pro G400 Super Flower 
CPUMotherboardGraphicsRAM
A8-6410 Lenovo Lancer 4B2 K16.3 R5 128 Shaders/M230 Hynix 8GB DDR3 1600 
Hard DriveHard DriveOSMonitor
Samsung 840 120 GB SSD Seagate Momentus 1TB 5400rmp Win 8.1 CMN1487 TN LED 14" 1366*768 
KeyboardPowerMouseMouse Pad
Lenovo AccuType 2900mAh/41Wh Elan Trackpad/Logitech M90 Super Flower 
Audio
AMD Avalon(Connexant) 
  hide details  
Reply
The girlfriend.
(15 items)
 
The Mistress
(13 items)
 
Media Server
(11 items)
 
CPUMotherboardGraphicsRAM
FX8320 @ 4.5 Crosshair V (Third One) 290 Tri-X OC 16GB HyperX 
Hard DriveHard DriveHard DriveCooling
Sandisk SSD Plus 240GB Toshiba 3TB Hitachi 2TB Swiftech H220-X 
OSMonitorKeyboardPower
Win 8.1/Mint Viewsonic VX2457-mhd Fuhlen L411 Slim Super Flower Golden King 650W 
CaseMouseMouse Pad
Enthoo Pro G400 Super Flower 
CPUMotherboardGraphicsRAM
A8-6410 Lenovo Lancer 4B2 K16.3 R5 128 Shaders/M230 Hynix 8GB DDR3 1600 
Hard DriveHard DriveOSMonitor
Samsung 840 120 GB SSD Seagate Momentus 1TB 5400rmp Win 8.1 CMN1487 TN LED 14" 1366*768 
KeyboardPowerMouseMouse Pad
Lenovo AccuType 2900mAh/41Wh Elan Trackpad/Logitech M90 Super Flower 
Audio
AMD Avalon(Connexant) 
  hide details  
Reply
post #19 of 39
Thread Starter 

Is this page pretty accurate on SAS vs SATA? Looking at the hard drives comparing Helium vs Standard and 4kn vs 512e, apparently unRAID doesn't support 4kn just yet but from VM perspective the programs in the VM shouldn't be affected by the 4kn, correct?

 

Thanks again everyone for the help, I'm learning a lot.

 

Edit: Forgot to link the page http://www.intel.com/content/www/us/en/support/server-products/000005782.html


Edited by B-rock - 4/16/17 at 8:49am
Be Rock Steady
(19 items)
 
  
CPUMotherboardGraphicsRAM
i7-2600K 4.7ghz @ 1.33 ASUS P8Z68 Deluxe Titan X Corsair Vengeance 16GB PC12800 DDR3 
Hard DriveHard DriveHard DriveCooling
Corsair Force CSSD-F115GB Seagate 1tb Western Digital 3TB bare H100 
OSMonitorKeyboardPower
Windows 7 Home Premium qnix kul es-87 Cooler Master Silent Pro M850 
CaseMouseAudioAudio
Corsair Obsidian 800D Razer Deathadder BE Schiit Audio Bifrost Uber Schiit Audio Lyr 2 
Audio
Audeze LCD-2 
  hide details  
Reply
Be Rock Steady
(19 items)
 
  
CPUMotherboardGraphicsRAM
i7-2600K 4.7ghz @ 1.33 ASUS P8Z68 Deluxe Titan X Corsair Vengeance 16GB PC12800 DDR3 
Hard DriveHard DriveHard DriveCooling
Corsair Force CSSD-F115GB Seagate 1tb Western Digital 3TB bare H100 
OSMonitorKeyboardPower
Windows 7 Home Premium qnix kul es-87 Cooler Master Silent Pro M850 
CaseMouseAudioAudio
Corsair Obsidian 800D Razer Deathadder BE Schiit Audio Bifrost Uber Schiit Audio Lyr 2 
Audio
Audeze LCD-2 
  hide details  
Reply
post #20 of 39
Quote:
Originally Posted by B-rock View Post
 

Is this page pretty accurate on SAS vs SATA? Looking at the hard drives comparing Helium vs Standard and 4kn vs 512e, apparently unRAID doesn't support 4kn just yet but from VM perspective the programs in the VM shouldn't be affected by the 4kn, correct?

 

Thanks again everyone for the help, I'm learning a lot.

Unless you absolutely have to for whatever reason you have no need of NAS drives. Even Backblaze use regular SATA drives for their cloud storage (Backblaze are the cloud storage company who post quarterly HD failure statistics) so you can ignore SAS drives as they are quite a bit more expensive than SATA drives.

The girlfriend.
(15 items)
 
The Mistress
(13 items)
 
Media Server
(11 items)
 
CPUMotherboardGraphicsRAM
FX8320 @ 4.5 Crosshair V (Third One) 290 Tri-X OC 16GB HyperX 
Hard DriveHard DriveHard DriveCooling
Sandisk SSD Plus 240GB Toshiba 3TB Hitachi 2TB Swiftech H220-X 
OSMonitorKeyboardPower
Win 8.1/Mint Viewsonic VX2457-mhd Fuhlen L411 Slim Super Flower Golden King 650W 
CaseMouseMouse Pad
Enthoo Pro G400 Super Flower 
CPUMotherboardGraphicsRAM
A8-6410 Lenovo Lancer 4B2 K16.3 R5 128 Shaders/M230 Hynix 8GB DDR3 1600 
Hard DriveHard DriveOSMonitor
Samsung 840 120 GB SSD Seagate Momentus 1TB 5400rmp Win 8.1 CMN1487 TN LED 14" 1366*768 
KeyboardPowerMouseMouse Pad
Lenovo AccuType 2900mAh/41Wh Elan Trackpad/Logitech M90 Super Flower 
Audio
AMD Avalon(Connexant) 
  hide details  
Reply
The girlfriend.
(15 items)
 
The Mistress
(13 items)
 
Media Server
(11 items)
 
CPUMotherboardGraphicsRAM
FX8320 @ 4.5 Crosshair V (Third One) 290 Tri-X OC 16GB HyperX 
Hard DriveHard DriveHard DriveCooling
Sandisk SSD Plus 240GB Toshiba 3TB Hitachi 2TB Swiftech H220-X 
OSMonitorKeyboardPower
Win 8.1/Mint Viewsonic VX2457-mhd Fuhlen L411 Slim Super Flower Golden King 650W 
CaseMouseMouse Pad
Enthoo Pro G400 Super Flower 
CPUMotherboardGraphicsRAM
A8-6410 Lenovo Lancer 4B2 K16.3 R5 128 Shaders/M230 Hynix 8GB DDR3 1600 
Hard DriveHard DriveOSMonitor
Samsung 840 120 GB SSD Seagate Momentus 1TB 5400rmp Win 8.1 CMN1487 TN LED 14" 1366*768 
KeyboardPowerMouseMouse Pad
Lenovo AccuType 2900mAh/41Wh Elan Trackpad/Logitech M90 Super Flower 
Audio
AMD Avalon(Connexant) 
  hide details  
Reply
New Posts  All Forums:Forum Nav:
  Return Home
  Back to Forum: Servers
Overclock.net › Forums › Specialty Builds › Servers › Thinking of Creating "Massive" Storage Server