Overclock.net › Forums › Specialty Builds › Servers › Storage server - need some advice
New Posts  All Forums:Forum Nav:

Storage server - need some advice - Page 7

post #61 of 67
Quote:
Originally Posted by michael_sj123 View Post

Right, so I have hit a small wall here. Basically as I expressed earlier I'd like to have separate machines for different roles. One for handling storage, one for handling VPN, one for handling downloads, and so on. However, I've just tried installing vSphere 5 on the machine, and it does detect the controller, however, how do I manage the raid from it? I was assuming I could pass it through to one of the VM's (preferably the storage one) and install the MegaRAID Storage Manager software on there to manage it, but apparently again my motherboard does not support IOMMU. My motherboard is an ASUS M5A78L-M (cheapest I could find with support for the CPU and all the video outputs I need). What would you guys do in this situation?

Oh yeah, the raid controller is an IBM M1015. The machine has 16GB of DDR3 memory and an AMD FX-8350 CPU.
The raid configure will run on the core machine that is hosting the VM. Basically the VM will just see whatever partition you set up for it, nothing else. So it will just look like free space. Not sure how recovery would work since if it goes down it means the host went down as well then you would have to rebuild the raid
 
My desktop
(12 items)
 
First Desktop
(11 items)
 
CPUMotherboardGraphicsGraphics
AMD FX-8350 Vishera @ 4.86 Ghz 1.5V ASUS SABERTOOTH 990FX R2.0 AM3+ AMD 990FX EVGA GTX 660 TI 3GB EVGA GTX 660Ti FTW+ 3GB 
RAMHard DriveOptical DriveCooling
16 GB DDR3 1600 G.Skill Samsung Pro 850 256GB SSD LG BD Corsair H110i 
OSPowerCaseOther
Windows 7x64 Professional CORSAIR HX Series HX750 750W ATX12V Antec LanBoy Air 5 switch fan controller 
CPUMotherboardGraphicsRAM
AMD Phenom X4 965 Black Edition MSI NF750-G55 AM3 NVIDIA nForce 750a SLI HDMI ATX ASUS GTX 550TI 1GB 8GB 1333 DDR3 G. Skill (2x 4GB) 
Hard DriveOptical DriveCoolingOS
1x 500 GB Western Digital Caviar Black 7200RPM Samsung DVD  Stock air Windows 7 Professional x64 
PowerCaseAudio
700 Watt Rosewill Rosewill CHALLENGER Black Gaming ATX Mid Tower ... Integrated  
  hide details  
Reply
 
My desktop
(12 items)
 
First Desktop
(11 items)
 
CPUMotherboardGraphicsGraphics
AMD FX-8350 Vishera @ 4.86 Ghz 1.5V ASUS SABERTOOTH 990FX R2.0 AM3+ AMD 990FX EVGA GTX 660 TI 3GB EVGA GTX 660Ti FTW+ 3GB 
RAMHard DriveOptical DriveCooling
16 GB DDR3 1600 G.Skill Samsung Pro 850 256GB SSD LG BD Corsair H110i 
OSPowerCaseOther
Windows 7x64 Professional CORSAIR HX Series HX750 750W ATX12V Antec LanBoy Air 5 switch fan controller 
CPUMotherboardGraphicsRAM
AMD Phenom X4 965 Black Edition MSI NF750-G55 AM3 NVIDIA nForce 750a SLI HDMI ATX ASUS GTX 550TI 1GB 8GB 1333 DDR3 G. Skill (2x 4GB) 
Hard DriveOptical DriveCoolingOS
1x 500 GB Western Digital Caviar Black 7200RPM Samsung DVD  Stock air Windows 7 Professional x64 
PowerCaseAudio
700 Watt Rosewill Rosewill CHALLENGER Black Gaming ATX Mid Tower ... Integrated  
  hide details  
Reply
post #62 of 67
Thread Starter 
Quote:
Originally Posted by hawkeye071292 View Post

The raid configure will run on the core machine that is hosting the VM. Basically the VM will just see whatever partition you set up for it, nothing else. So it will just look like free space. Not sure how recovery would work since if it goes down it means the host went down as well then you would have to rebuild the raid

Yeah, I know. So basically if I do decide to go ESXi, I will not be able to configure the arrays, monitor the card's health and whatnot? What other options do I have in regards to virtualization and actually using the raidcard?
Edited by michael_sj123 - 5/23/13 at 11:14pm
post #63 of 67
Quote:
Originally Posted by michael_sj123 View Post

Yeah, I know. So basically if I do decide to go ESXi, I will not be able to configure the arrays, monitor the card's health and whatnot? What other options do I have in regards to virtualization and actually using the raidcard?

All of the monitoring would be done on the host system. So basically, it would be a system wide health (host machine+VMs)

Do you want further monitoring than that? I mean the only way I know if having a raid array setup for each one would be to have its own drives/raid card. What is your HDD configuration? Basically what I think you are trying to say is you would like a VM to keep running even if the raid on one fails? Without being on different drives, that really isnt possible.
 
My desktop
(12 items)
 
First Desktop
(11 items)
 
CPUMotherboardGraphicsGraphics
AMD FX-8350 Vishera @ 4.86 Ghz 1.5V ASUS SABERTOOTH 990FX R2.0 AM3+ AMD 990FX EVGA GTX 660 TI 3GB EVGA GTX 660Ti FTW+ 3GB 
RAMHard DriveOptical DriveCooling
16 GB DDR3 1600 G.Skill Samsung Pro 850 256GB SSD LG BD Corsair H110i 
OSPowerCaseOther
Windows 7x64 Professional CORSAIR HX Series HX750 750W ATX12V Antec LanBoy Air 5 switch fan controller 
CPUMotherboardGraphicsRAM
AMD Phenom X4 965 Black Edition MSI NF750-G55 AM3 NVIDIA nForce 750a SLI HDMI ATX ASUS GTX 550TI 1GB 8GB 1333 DDR3 G. Skill (2x 4GB) 
Hard DriveOptical DriveCoolingOS
1x 500 GB Western Digital Caviar Black 7200RPM Samsung DVD  Stock air Windows 7 Professional x64 
PowerCaseAudio
700 Watt Rosewill Rosewill CHALLENGER Black Gaming ATX Mid Tower ... Integrated  
  hide details  
Reply
 
My desktop
(12 items)
 
First Desktop
(11 items)
 
CPUMotherboardGraphicsGraphics
AMD FX-8350 Vishera @ 4.86 Ghz 1.5V ASUS SABERTOOTH 990FX R2.0 AM3+ AMD 990FX EVGA GTX 660 TI 3GB EVGA GTX 660Ti FTW+ 3GB 
RAMHard DriveOptical DriveCooling
16 GB DDR3 1600 G.Skill Samsung Pro 850 256GB SSD LG BD Corsair H110i 
OSPowerCaseOther
Windows 7x64 Professional CORSAIR HX Series HX750 750W ATX12V Antec LanBoy Air 5 switch fan controller 
CPUMotherboardGraphicsRAM
AMD Phenom X4 965 Black Edition MSI NF750-G55 AM3 NVIDIA nForce 750a SLI HDMI ATX ASUS GTX 550TI 1GB 8GB 1333 DDR3 G. Skill (2x 4GB) 
Hard DriveOptical DriveCoolingOS
1x 500 GB Western Digital Caviar Black 7200RPM Samsung DVD  Stock air Windows 7 Professional x64 
PowerCaseAudio
700 Watt Rosewill Rosewill CHALLENGER Black Gaming ATX Mid Tower ... Integrated  
  hide details  
Reply
post #64 of 67
Thread Starter 
Quote:
Originally Posted by hawkeye071292 View Post

All of the monitoring would be done on the host system. So basically, it would be a system wide health (host machine+VMs)

Do you want further monitoring than that? I mean the only way I know if having a raid array setup for each one would be to have its own drives/raid card. What is your HDD configuration? Basically what I think you are trying to say is you would like a VM to keep running even if the raid on one fails? Without being on different drives, that really isnt possible.

No no, what I'm trying to do is find out what hypervisor would allow me to monitor and configure the card like using the MegaRAID software
post #65 of 67
Quote:
Originally Posted by michael_sj123 View Post

No no, what I'm trying to do is find out what hypervisor would allow me to monitor and configure the card like using the MegaRAID software

Windows Server 2012 or 2008 R2 with the Hyper-V role installed.

On ESXi, you can do hardware passthrough for the RAID controller to a Windows or Linux VM that will allow you to manage the controller using the OEM software.
VH001
(17 items)
 
VH002
(15 items)
 
VH003
(16 items)
 
CPUCPUMotherboardGraphics
Intel Xeon E5-2670 Intel Xeon E5-2670 SuperMicro X9DR7-LN4F Onboard Graphics 
RAMHard DriveHard DriveHard Drive
128GB (16 x 8GB) 1333MHz ECC Registered DDR3 4 x Micron M500 480GB SSD 4 x Hitachi 450GB 10K SAS 8 x Toshiba 5TB 
Hard DriveCoolingCoolingOS
Intel 750 400GB NVME SSD 2 x Dynatron R22 6 x SuperMicro 5K RPM Fans VMWare vSphere 6 
MonitorPowerCaseOther
IPMI SuperMicro 650W PSU SuperMicro CSE-833T-650B Black 3U Rackmount Ser... Intel X520-T2 Dual Port 10GbE Server Adapter 
Other
HP P420 1GB Smart Array Controller 
CPUCPUMotherboardGraphics
Intel Xeon E5-2670 Intel Xeon E5-2670 Intel S2600CP2J Onboard Graphics 
RAMHard DriveHard DriveHard Drive
128GB (16 x 8GB) 1333MHz ECC Registered DDR3 4 x Micron M500 480GB SSD 4 x Hitachi 450GB 10K SAS Intel 750 400GB NVME SSD 
CoolingOSMonitorPower
2 x Intel AUPSRCBTP VMWare vSphere 6 IPMI Intel 750W PSU 
CaseOtherOther
Intel P4216XXMHGR 4U Server Chassis Intel X520-T2 Dual Port 10GbE Server Adapter HP P420 1GB Smart Array Controller 
CPUCPUMotherboardGraphics
Intel Xeon E5-2670 Intel Xeon E5-2670 SuperMicro X9DR3-F Onboard Graphics 
RAMHard DriveHard DriveHard Drive
128GB (16 x 8GB) 1333MHz ECC Registered DDR3 4 x Micron M500 480GB SSD 4 x Hitachi 450GB 10K SAS Intel 750 400GB NVME SSD 
CoolingCoolingOSMonitor
2 x Dynatron R22 3 x SuperMicro 5K RPM Fans VMWare vSphere 6 IPMI 
PowerCaseOtherOther
SuperMicro 563W PSU SuperMicro CSE-825TQ-563LPB 2U Rackmount Server... Intel X520-T2 Dual Port 10GbE Server Adapter HP P420 1GB Smart Array Controller 
  hide details  
Reply
VH001
(17 items)
 
VH002
(15 items)
 
VH003
(16 items)
 
CPUCPUMotherboardGraphics
Intel Xeon E5-2670 Intel Xeon E5-2670 SuperMicro X9DR7-LN4F Onboard Graphics 
RAMHard DriveHard DriveHard Drive
128GB (16 x 8GB) 1333MHz ECC Registered DDR3 4 x Micron M500 480GB SSD 4 x Hitachi 450GB 10K SAS 8 x Toshiba 5TB 
Hard DriveCoolingCoolingOS
Intel 750 400GB NVME SSD 2 x Dynatron R22 6 x SuperMicro 5K RPM Fans VMWare vSphere 6 
MonitorPowerCaseOther
IPMI SuperMicro 650W PSU SuperMicro CSE-833T-650B Black 3U Rackmount Ser... Intel X520-T2 Dual Port 10GbE Server Adapter 
Other
HP P420 1GB Smart Array Controller 
CPUCPUMotherboardGraphics
Intel Xeon E5-2670 Intel Xeon E5-2670 Intel S2600CP2J Onboard Graphics 
RAMHard DriveHard DriveHard Drive
128GB (16 x 8GB) 1333MHz ECC Registered DDR3 4 x Micron M500 480GB SSD 4 x Hitachi 450GB 10K SAS Intel 750 400GB NVME SSD 
CoolingOSMonitorPower
2 x Intel AUPSRCBTP VMWare vSphere 6 IPMI Intel 750W PSU 
CaseOtherOther
Intel P4216XXMHGR 4U Server Chassis Intel X520-T2 Dual Port 10GbE Server Adapter HP P420 1GB Smart Array Controller 
CPUCPUMotherboardGraphics
Intel Xeon E5-2670 Intel Xeon E5-2670 SuperMicro X9DR3-F Onboard Graphics 
RAMHard DriveHard DriveHard Drive
128GB (16 x 8GB) 1333MHz ECC Registered DDR3 4 x Micron M500 480GB SSD 4 x Hitachi 450GB 10K SAS Intel 750 400GB NVME SSD 
CoolingCoolingOSMonitor
2 x Dynatron R22 3 x SuperMicro 5K RPM Fans VMWare vSphere 6 IPMI 
PowerCaseOtherOther
SuperMicro 563W PSU SuperMicro CSE-825TQ-563LPB 2U Rackmount Server... Intel X520-T2 Dual Port 10GbE Server Adapter HP P420 1GB Smart Array Controller 
  hide details  
Reply
post #66 of 67
Thread Starter 
Quote:
Originally Posted by jibesh View Post

Windows Server 2012 or 2008 R2 with the Hyper-V role installed.

On ESXi, you can do hardware passthrough for the RAID controller to a Windows or Linux VM that will allow you to manage the controller using the OEM software.

Yeah, I know about the hardware passthrough, the thing is the option is greyed out, which means its not supported on the motherboard I guess. Is Hyper-V as "secure" and erm, separate as ESXi?
post #67 of 67
Thread Starter 
Right, so I've done some testing and I installed the LSI VIB for getting the controller to show up under Health Status in ESXi, which worked nicely. After that I setup a VM and installed the MegaRAID Storage Manager, which again detected the controller, so no passthrough required. I also did some hacky stuff by just RDM'ing the logical device the controller presented into the storage VM, it's hacky indeed, but it does the job nicely and I get good performance. Is there anything I should do regarding the cache settings and whatnot on the actual controller? Is there anything I should worry about, like, what could happen when I do RDM the disks?
Edited by michael_sj123 - 5/29/13 at 1:50am
New Posts  All Forums:Forum Nav:
  Return Home
  Back to Forum: Servers
Overclock.net › Forums › Specialty Builds › Servers › Storage server - need some advice