Overclock.net › Forums › Specialty Builds › Servers › Advice on New Server Build
New Posts  All Forums:Forum Nav:

Advice on New Server Build

post #1 of 10
Thread Starter 
My current ESXi server just isn't capable of expanding so its time to build a new home server.
I'm planning to go with Hyper-V vs ESXi installed as a role on Server 2012.

Currently planned VM's:
WDS
WS2012E (Also primary DC)
WSUS
Second DC
3-4 x Win7 for various items (not heavy)

I will be expanding that eventually, but that's just for beginners.

Here is what I currently have put together for a possible build:

1x SUPERMICRO MBD-X9DR7-LN4F-O Extended ATX Server Motherboard Dual LGA 2011
1x Intel Xeon E5-2620 Sandy Bridge-EP 2.0GHz
1x Kingston 64GB (4 x 16GB) 240-Pin DDR3 SDRAM ECC Registered DDR3 1600
1x Rosewill RSV-L4411 12 SATA Hot-swap Drives
1x CORSAIR HX Series HX750 750W ATX12V 2.3 / EPS12V 2.91
1x SUPERMICRO SNK-P0050AP4 Heatsink
1x USB 3.0 Card

This comes out to about $1894.94
I'm debating on going with a single LGA 2011 vs dual and if I need to expand to just build a duplicate second server when the time comes.
Also, not too sure about the Rosewill case, but I really do want one with hot swap bays within reason price wise.

Rough outline of HDD configuration:

2x 160GB OS (Raid 1)
1x 512GB SDD - Will host WS2012E and maybe others
4x 3TB Storage in Raid 5
3x 1.5TB - 2 for VM storage in Raid 1 and 1 extra for anything else
UPDATE:
This is most likely what I decided to go with (thanks tycoonbob for suggesting these)

2 x C1100 w/72GB RAM each
2 x 512GB Datastore - 1 in each
2 x 1.5TB Datastore - 1 in each (eventually will replace these with another 512GB SSD)
2 x 128GB (or 64GB) SSD for Server 2012 as the OS

Re-purpose my old ESXi box to run Server 2012 as the storage server.
4 x 3 or 2 TB drives via storage spaces shared out as ISCSI target(s).
1 x 1.5TB VM backups
Edited by Dnic41 - 5/17/13 at 6:33am
White Knight
(19 items)
 
ESXi Host
(8 items)
 
HTPC
(5 items)
 
CPUMotherboardGraphicsRAM
Intel i7-7700K SABERTOOTH Z170 S GeForce GTX 780 Corsair Vengeance LPX 
RAMRAMRAMHard Drive
Corsair Vengeance LPX Corsair Vengeance LPX Corsair Vengeance LPX Samsung 960 Evo 
Hard DriveCoolingCoolingCooling
Samsung 960 Evo CRYORIG H7 Fractal Design GP14-WT Fractal Design GP14-WT 
CoolingCoolingPowerCase
Fractal Design GP14-WT Fractal Design FD-FAN-SSR2-40 EVGA SuperNOVA G2 650W Fractal Design Define R5 
OtherOtherOther
Lycom DT-120 M.2 PCIe to PCIe 3.0 x4 Adapter NZXT CB-LED20-WT BitFenix ALCHEMY 2.0 PSU CABLE KIT 
CPUCPURAMHard Drive
L5630 L5630 72GB DDR3 3x 1.5TB 
Hard DriveHard DriveHard DriveOS
2x 2TB 4x 3TB 2x 500GB SSD ESXi 6 
CPUMotherboardGraphicsRAM
Intel i5-4250U D54250WYK Intel(R) HD Graphics 5000 G.Skill Ripjaws DDR3 1600 
Hard Drive
SAMSUNG 840 EVO mSATA 
  hide details  
Reply
White Knight
(19 items)
 
ESXi Host
(8 items)
 
HTPC
(5 items)
 
CPUMotherboardGraphicsRAM
Intel i7-7700K SABERTOOTH Z170 S GeForce GTX 780 Corsair Vengeance LPX 
RAMRAMRAMHard Drive
Corsair Vengeance LPX Corsair Vengeance LPX Corsair Vengeance LPX Samsung 960 Evo 
Hard DriveCoolingCoolingCooling
Samsung 960 Evo CRYORIG H7 Fractal Design GP14-WT Fractal Design GP14-WT 
CoolingCoolingPowerCase
Fractal Design GP14-WT Fractal Design FD-FAN-SSR2-40 EVGA SuperNOVA G2 650W Fractal Design Define R5 
OtherOtherOther
Lycom DT-120 M.2 PCIe to PCIe 3.0 x4 Adapter NZXT CB-LED20-WT BitFenix ALCHEMY 2.0 PSU CABLE KIT 
CPUCPURAMHard Drive
L5630 L5630 72GB DDR3 3x 1.5TB 
Hard DriveHard DriveHard DriveOS
2x 2TB 4x 3TB 2x 500GB SSD ESXi 6 
CPUMotherboardGraphicsRAM
Intel i5-4250U D54250WYK Intel(R) HD Graphics 5000 G.Skill Ripjaws DDR3 1600 
Hard Drive
SAMSUNG 840 EVO mSATA 
  hide details  
Reply
post #2 of 10
I see nothing wrong with the config. In a single host virtual environment, Hyper-V has the advantage of being 100% free with no strings attached (unlike ESX which is free but with strings attached), at the cost of a much larger footprint and attack surface. I guess you're not too concerned about attack surface, but the RAM and HDD footprint should be kept in mind. You might consider Citrix XenServer as an alternative smile.gif

I don't see the purpose of having two DCs on the same virtual host, kind of a waste of resources unless you're running two domains and therefore need two DCs. Since this is for home and not business/production, I guess it doesn't matter an awful lot, but if your client machines are joined to the domain and the host goes down with both DCs, you're still going to have a problem.

You might want not to set two 1.5 TB drives in RAID 1. Instead, use one drive for VM storage and the other drive for VM backups. The free version of Veeam does a fine job so long as you keep up with your backups, as you'll have to manage them manually. That way if something gets corrupted, not using RAID 1 will prevent corruption from getting mirrored across drives. Just a suggestion.

As for choosing between single or dual LGA2011, well, it looks like a single E5-2620 will be more than adequate to run all that, and if you ever decided you needed an upgrade, a second host would allow you to run your two DCs separately from one another, as well as play with Hyper-V's Live Migration.

Also, make sure all your hard drives are compatible with whatever SATA/SAS controller your motherboard ends up having, I've had issues with that in the past tongue.gif
Edited by Shub - 5/16/13 at 4:50pm
post #3 of 10
So your primary domain controller is running Windows Server Essentials, and you want a secondary DC running Server 2012 Std (I assume)? The problem with that is all of your FSMO roles will live on the WSE2012 box, and if that VM died (for whatever reason) you are still in trouble. If you are looking to run several Windows Servers, I wouldn't bother with WSE for your domain, but instead just use Server 2012 Std. If you want WSE experience, you can still run a non-domain joined version of it.

I like the idea of a RAID 1 for VM storage, versus a standalone 7200RPM drive. Your read performance will increase slightly, and you have the redundancy. Use the third 1.5TB for backups.

Have you considered buying OEM servers, used even? For $600 you could buy 2 used Dell C1100s (dual Xeon L5520, 36GB RAM), and buy 2 500GB SSDs for each. Run Windows Server 2012 on each with Hyper-V installed, and utilize the Hyper-V Replica role on one of them. This way you can have two DCs, one on each box, and all of your other VMs are replicated to the other. No need for iSCSI traffic or clustering, but still the benefits of replication.

Just a suggestions.
post #4 of 10
Thread Starter 
Your right that 2 DC's on one physical host is pointless, I was thinking more along he line in case the DC VM actualy failed (or I broke it playing with it).

I haven't really looked at getting used servers like that, that could be a good idea as well, definitely a cheaper option and I can get two physical boxes . The only issue I see with that is where would all the extra storage go? The 4x 3TB drives are for WS2012E which is replacing my Windows Home Server 2011 (hence the reason I"m going with that).
White Knight
(19 items)
 
ESXi Host
(8 items)
 
HTPC
(5 items)
 
CPUMotherboardGraphicsRAM
Intel i7-7700K SABERTOOTH Z170 S GeForce GTX 780 Corsair Vengeance LPX 
RAMRAMRAMHard Drive
Corsair Vengeance LPX Corsair Vengeance LPX Corsair Vengeance LPX Samsung 960 Evo 
Hard DriveCoolingCoolingCooling
Samsung 960 Evo CRYORIG H7 Fractal Design GP14-WT Fractal Design GP14-WT 
CoolingCoolingPowerCase
Fractal Design GP14-WT Fractal Design FD-FAN-SSR2-40 EVGA SuperNOVA G2 650W Fractal Design Define R5 
OtherOtherOther
Lycom DT-120 M.2 PCIe to PCIe 3.0 x4 Adapter NZXT CB-LED20-WT BitFenix ALCHEMY 2.0 PSU CABLE KIT 
CPUCPURAMHard Drive
L5630 L5630 72GB DDR3 3x 1.5TB 
Hard DriveHard DriveHard DriveOS
2x 2TB 4x 3TB 2x 500GB SSD ESXi 6 
CPUMotherboardGraphicsRAM
Intel i5-4250U D54250WYK Intel(R) HD Graphics 5000 G.Skill Ripjaws DDR3 1600 
Hard Drive
SAMSUNG 840 EVO mSATA 
  hide details  
Reply
White Knight
(19 items)
 
ESXi Host
(8 items)
 
HTPC
(5 items)
 
CPUMotherboardGraphicsRAM
Intel i7-7700K SABERTOOTH Z170 S GeForce GTX 780 Corsair Vengeance LPX 
RAMRAMRAMHard Drive
Corsair Vengeance LPX Corsair Vengeance LPX Corsair Vengeance LPX Samsung 960 Evo 
Hard DriveCoolingCoolingCooling
Samsung 960 Evo CRYORIG H7 Fractal Design GP14-WT Fractal Design GP14-WT 
CoolingCoolingPowerCase
Fractal Design GP14-WT Fractal Design FD-FAN-SSR2-40 EVGA SuperNOVA G2 650W Fractal Design Define R5 
OtherOtherOther
Lycom DT-120 M.2 PCIe to PCIe 3.0 x4 Adapter NZXT CB-LED20-WT BitFenix ALCHEMY 2.0 PSU CABLE KIT 
CPUCPURAMHard Drive
L5630 L5630 72GB DDR3 3x 1.5TB 
Hard DriveHard DriveHard DriveOS
2x 2TB 4x 3TB 2x 500GB SSD ESXi 6 
CPUMotherboardGraphicsRAM
Intel i5-4250U D54250WYK Intel(R) HD Graphics 5000 G.Skill Ripjaws DDR3 1600 
Hard Drive
SAMSUNG 840 EVO mSATA 
  hide details  
Reply
post #5 of 10
Thread Starter 
Here is another config I like only because Hyper-V replication can be used.

2 x Poweredge C1100 - ~$469.99
2 x 512GB (VM Datastore) - $399.99
2 x 1.5TB (VM Datastore) - Existing

This comes to about $1739

For storage I could use my existing ESXi box. I can put Server 2012 with storage spaces and 3-4 3TB/2TB drives and share it out.
Would the Phenom 9850 and 8GB DDR2 be enough for this?
White Knight
(19 items)
 
ESXi Host
(8 items)
 
HTPC
(5 items)
 
CPUMotherboardGraphicsRAM
Intel i7-7700K SABERTOOTH Z170 S GeForce GTX 780 Corsair Vengeance LPX 
RAMRAMRAMHard Drive
Corsair Vengeance LPX Corsair Vengeance LPX Corsair Vengeance LPX Samsung 960 Evo 
Hard DriveCoolingCoolingCooling
Samsung 960 Evo CRYORIG H7 Fractal Design GP14-WT Fractal Design GP14-WT 
CoolingCoolingPowerCase
Fractal Design GP14-WT Fractal Design FD-FAN-SSR2-40 EVGA SuperNOVA G2 650W Fractal Design Define R5 
OtherOtherOther
Lycom DT-120 M.2 PCIe to PCIe 3.0 x4 Adapter NZXT CB-LED20-WT BitFenix ALCHEMY 2.0 PSU CABLE KIT 
CPUCPURAMHard Drive
L5630 L5630 72GB DDR3 3x 1.5TB 
Hard DriveHard DriveHard DriveOS
2x 2TB 4x 3TB 2x 500GB SSD ESXi 6 
CPUMotherboardGraphicsRAM
Intel i5-4250U D54250WYK Intel(R) HD Graphics 5000 G.Skill Ripjaws DDR3 1600 
Hard Drive
SAMSUNG 840 EVO mSATA 
  hide details  
Reply
White Knight
(19 items)
 
ESXi Host
(8 items)
 
HTPC
(5 items)
 
CPUMotherboardGraphicsRAM
Intel i7-7700K SABERTOOTH Z170 S GeForce GTX 780 Corsair Vengeance LPX 
RAMRAMRAMHard Drive
Corsair Vengeance LPX Corsair Vengeance LPX Corsair Vengeance LPX Samsung 960 Evo 
Hard DriveCoolingCoolingCooling
Samsung 960 Evo CRYORIG H7 Fractal Design GP14-WT Fractal Design GP14-WT 
CoolingCoolingPowerCase
Fractal Design GP14-WT Fractal Design FD-FAN-SSR2-40 EVGA SuperNOVA G2 650W Fractal Design Define R5 
OtherOtherOther
Lycom DT-120 M.2 PCIe to PCIe 3.0 x4 Adapter NZXT CB-LED20-WT BitFenix ALCHEMY 2.0 PSU CABLE KIT 
CPUCPURAMHard Drive
L5630 L5630 72GB DDR3 3x 1.5TB 
Hard DriveHard DriveHard DriveOS
2x 2TB 4x 3TB 2x 500GB SSD ESXi 6 
CPUMotherboardGraphicsRAM
Intel i5-4250U D54250WYK Intel(R) HD Graphics 5000 G.Skill Ripjaws DDR3 1600 
Hard Drive
SAMSUNG 840 EVO mSATA 
  hide details  
Reply
post #6 of 10
Just wondering but why do you have 2x160GB for ESXI? it will happily run from a USB/SDHC memory card hell even the newer dells are specced this way so the physical drives are solely data storage tongue.gif

Also why not Raid 5 your 1.5TB's will give you the same usuable space
Ragnarok
(15 items)
 
Yggdrassil
(8 items)
 
 
CPUCPUMotherboardGraphics
Opteron 6272 Opteron 6272 Asus KGPE-D16 Sapphire R9 290X 
GraphicsRAMHard DriveCooling
Sapphire R9 290X 8x Samsung 8GB DDR3 1333 ECC 3TBx2 in Raid 1 Noctua NH-U12DO 
CoolingOSMonitorPower
120mm Fractal Design 1200rpm Case Fan Silent Se... Windows 7 Pro x64 1x24" 2x22" Corsair Professional HX1050 
CaseAudioOther
Fractal Design XL R2 Titanium Grey Asus MIO 892 Purple and white Braided/sleeved cables 
  hide details  
Reply
Ragnarok
(15 items)
 
Yggdrassil
(8 items)
 
 
CPUCPUMotherboardGraphics
Opteron 6272 Opteron 6272 Asus KGPE-D16 Sapphire R9 290X 
GraphicsRAMHard DriveCooling
Sapphire R9 290X 8x Samsung 8GB DDR3 1333 ECC 3TBx2 in Raid 1 Noctua NH-U12DO 
CoolingOSMonitorPower
120mm Fractal Design 1200rpm Case Fan Silent Se... Windows 7 Pro x64 1x24" 2x22" Corsair Professional HX1050 
CaseAudioOther
Fractal Design XL R2 Titanium Grey Asus MIO 892 Purple and white Braided/sleeved cables 
  hide details  
Reply
post #7 of 10
Thread Starter 
Quote:
Originally Posted by Norse View Post

Just wondering but why do you have 2x160GB for ESXI? it will happily run from a USB/SDHC memory card hell even the newer dells are specced this way so the physical drives are solely data storage tongue.gif

Also why not Raid 5 your 1.5TB's will give you the same usuable space

That's because I'm not going with ESXi, but with Hyper-V instead.

I'm leaning going towards the C1100 now vs my own build just for the simple fact that I can buy two of them with 72GB of RAM.
Updated the Original post with what I'm thinking.
White Knight
(19 items)
 
ESXi Host
(8 items)
 
HTPC
(5 items)
 
CPUMotherboardGraphicsRAM
Intel i7-7700K SABERTOOTH Z170 S GeForce GTX 780 Corsair Vengeance LPX 
RAMRAMRAMHard Drive
Corsair Vengeance LPX Corsair Vengeance LPX Corsair Vengeance LPX Samsung 960 Evo 
Hard DriveCoolingCoolingCooling
Samsung 960 Evo CRYORIG H7 Fractal Design GP14-WT Fractal Design GP14-WT 
CoolingCoolingPowerCase
Fractal Design GP14-WT Fractal Design FD-FAN-SSR2-40 EVGA SuperNOVA G2 650W Fractal Design Define R5 
OtherOtherOther
Lycom DT-120 M.2 PCIe to PCIe 3.0 x4 Adapter NZXT CB-LED20-WT BitFenix ALCHEMY 2.0 PSU CABLE KIT 
CPUCPURAMHard Drive
L5630 L5630 72GB DDR3 3x 1.5TB 
Hard DriveHard DriveHard DriveOS
2x 2TB 4x 3TB 2x 500GB SSD ESXi 6 
CPUMotherboardGraphicsRAM
Intel i5-4250U D54250WYK Intel(R) HD Graphics 5000 G.Skill Ripjaws DDR3 1600 
Hard Drive
SAMSUNG 840 EVO mSATA 
  hide details  
Reply
White Knight
(19 items)
 
ESXi Host
(8 items)
 
HTPC
(5 items)
 
CPUMotherboardGraphicsRAM
Intel i7-7700K SABERTOOTH Z170 S GeForce GTX 780 Corsair Vengeance LPX 
RAMRAMRAMHard Drive
Corsair Vengeance LPX Corsair Vengeance LPX Corsair Vengeance LPX Samsung 960 Evo 
Hard DriveCoolingCoolingCooling
Samsung 960 Evo CRYORIG H7 Fractal Design GP14-WT Fractal Design GP14-WT 
CoolingCoolingPowerCase
Fractal Design GP14-WT Fractal Design FD-FAN-SSR2-40 EVGA SuperNOVA G2 650W Fractal Design Define R5 
OtherOtherOther
Lycom DT-120 M.2 PCIe to PCIe 3.0 x4 Adapter NZXT CB-LED20-WT BitFenix ALCHEMY 2.0 PSU CABLE KIT 
CPUCPURAMHard Drive
L5630 L5630 72GB DDR3 3x 1.5TB 
Hard DriveHard DriveHard DriveOS
2x 2TB 4x 3TB 2x 500GB SSD ESXi 6 
CPUMotherboardGraphicsRAM
Intel i5-4250U D54250WYK Intel(R) HD Graphics 5000 G.Skill Ripjaws DDR3 1600 
Hard Drive
SAMSUNG 840 EVO mSATA 
  hide details  
Reply
post #8 of 10
Most people don't recommend using SSDs as a boot drive, but I personally like doing this myself. I can tell you that 128GB SSDs will not be needed for Server 2012 (as long as it's just a Hyper-V host) and is why I use a pair of 60GB drives in mine. In the case of using 2 Hyper-V hosts and a third as a Hyper-V Replica server, I also wouldn't bother doing a RAID 1 for the OS, since you only have 4 local drive bays.

60GB SSD for boot drive
500GB SSD for VM storage
2 x 2TB drives in a Storage Spaces Mirror for additional VM storage (VMs with low I/O requirements)

That is exactly what I recommend. Heck, doing this you can get by with two Hyper-V hosts, and having them both be the Hyper-V Replica to each other (Replicas could live on the Storage Spaces Mirror).

As far as your 500GB SSD for VMs, you can do better than $400. Samsung 840 (non-pro) can be had on sale for as little as $280, if you wait and look around.

Once I get the money, I am going to have 3 C1100s -- two will be 500GB SSDs for local VM storage, and a 1TB iSCSI LUN from my storage server (4 x 2TB in RAID 10), with a third C1100 as a Hyper-V Replica with 2 x 3TB Toshiba DT01ACA300s in a Storage Spaces Mirror.
***I have a storage server built already.

Just some ideas.
post #9 of 10
Thread Starter 
I'll go with the smaller SSD as it only will have Hypre-V role enabled on both.
Since the storage server (old ESXi box) doesn't have the resources as a replica I was planning on using the 1.5TB drive (may just go with 2x 1.5TB in a mirror on each) in each of the C1100 as each others replica space as well as additional VM's that don't need to sit on the 512GB SSD.
That said I may not even RAID the OS drives to save the extra bay since as you stated there are only 4. If the OS drive died on one its easy enough to replace and get up and running again.

Thanks for tossing some ideas out there as it gives me a better idea where I wanna go.
White Knight
(19 items)
 
ESXi Host
(8 items)
 
HTPC
(5 items)
 
CPUMotherboardGraphicsRAM
Intel i7-7700K SABERTOOTH Z170 S GeForce GTX 780 Corsair Vengeance LPX 
RAMRAMRAMHard Drive
Corsair Vengeance LPX Corsair Vengeance LPX Corsair Vengeance LPX Samsung 960 Evo 
Hard DriveCoolingCoolingCooling
Samsung 960 Evo CRYORIG H7 Fractal Design GP14-WT Fractal Design GP14-WT 
CoolingCoolingPowerCase
Fractal Design GP14-WT Fractal Design FD-FAN-SSR2-40 EVGA SuperNOVA G2 650W Fractal Design Define R5 
OtherOtherOther
Lycom DT-120 M.2 PCIe to PCIe 3.0 x4 Adapter NZXT CB-LED20-WT BitFenix ALCHEMY 2.0 PSU CABLE KIT 
CPUCPURAMHard Drive
L5630 L5630 72GB DDR3 3x 1.5TB 
Hard DriveHard DriveHard DriveOS
2x 2TB 4x 3TB 2x 500GB SSD ESXi 6 
CPUMotherboardGraphicsRAM
Intel i5-4250U D54250WYK Intel(R) HD Graphics 5000 G.Skill Ripjaws DDR3 1600 
Hard Drive
SAMSUNG 840 EVO mSATA 
  hide details  
Reply
White Knight
(19 items)
 
ESXi Host
(8 items)
 
HTPC
(5 items)
 
CPUMotherboardGraphicsRAM
Intel i7-7700K SABERTOOTH Z170 S GeForce GTX 780 Corsair Vengeance LPX 
RAMRAMRAMHard Drive
Corsair Vengeance LPX Corsair Vengeance LPX Corsair Vengeance LPX Samsung 960 Evo 
Hard DriveCoolingCoolingCooling
Samsung 960 Evo CRYORIG H7 Fractal Design GP14-WT Fractal Design GP14-WT 
CoolingCoolingPowerCase
Fractal Design GP14-WT Fractal Design FD-FAN-SSR2-40 EVGA SuperNOVA G2 650W Fractal Design Define R5 
OtherOtherOther
Lycom DT-120 M.2 PCIe to PCIe 3.0 x4 Adapter NZXT CB-LED20-WT BitFenix ALCHEMY 2.0 PSU CABLE KIT 
CPUCPURAMHard Drive
L5630 L5630 72GB DDR3 3x 1.5TB 
Hard DriveHard DriveHard DriveOS
2x 2TB 4x 3TB 2x 500GB SSD ESXi 6 
CPUMotherboardGraphicsRAM
Intel i5-4250U D54250WYK Intel(R) HD Graphics 5000 G.Skill Ripjaws DDR3 1600 
Hard Drive
SAMSUNG 840 EVO mSATA 
  hide details  
Reply
post #10 of 10
Quote:
Originally Posted by Dnic41 View Post

I'll go with the smaller SSD as it only will have Hypre-V role enabled on both.
Since the storage server (old ESXi box) doesn't have the resources as a replica I was planning on using the 1.5TB drive (may just go with 2x 1.5TB in a mirror on each) in each of the C1100 as each others replica space as well as additional VM's that don't need to sit on the 512GB SSD.
That said I may not even RAID the OS drives to save the extra bay since as you stated there are only 4. If the OS drive died on one its easy enough to replace and get up and running again.

Thanks for tossing some ideas out there as it gives me a better idea where I wanna go.

That sounds like a great idea.

So if a Hyper-V host died, all you would have to do is rebuild the OS, install Hyper-V, and failback all of the VMs it was running. Simple as that!
New Posts  All Forums:Forum Nav:
  Return Home
  Back to Forum: Servers
Overclock.net › Forums › Specialty Builds › Servers › Advice on New Server Build