Overclock.net › Forums › Specialty Builds › Servers › Vmware server build with >32GB memory?
New Posts  All Forums:Forum Nav:

Vmware server build with >32GB memory?

post #1 of 23
Thread Starter 
Seems I am hitting the limits of my current Vsphere server as I am running 27 virtual machines and need moar power!!
What is the cheapest way to get more than 32gb memory? AMD? Intel?

I am running the following at the moment:

MSI Z77MA-G45 mATX mainboard with VT-d support
Intel Xeon E3-1230 V2
G.SKILL Ripjaws Z Series 32GB (4 x 8GB) 240-Pin DDR3 SDRAM 1600Mhz (PC3 12800)
256GB crucial M4 SSD

I also have an i7-2600k and an AMD Phenom II X4 975 Black Edition gathering some dust around here.

The more cores the merrier but its really the memory that I need most.

Any advice appreciated biggrin.gif
TJ08 - Ninja
(10 items)
 
  
CPUMotherboardGraphicsRAM
3570k Asrock Z77 Professional-M Gigabyte GTX 670 Samsung Low Voltage 
Hard DriveCoolingMonitorPower
OCZ Vertex4 Custom Water Cooling Catleap Q270 Seasonic M12II 620 
CaseAudio
Silverstone Temjin TJ08-E Sound Blaster Z 
  hide details  
Reply
TJ08 - Ninja
(10 items)
 
  
CPUMotherboardGraphicsRAM
3570k Asrock Z77 Professional-M Gigabyte GTX 670 Samsung Low Voltage 
Hard DriveCoolingMonitorPower
OCZ Vertex4 Custom Water Cooling Catleap Q270 Seasonic M12II 620 
CaseAudio
Silverstone Temjin TJ08-E Sound Blaster Z 
  hide details  
Reply
post #2 of 23
Need a board with more than 4 dimms. In the AMD world, that means a server board but I think there are some high end Intel boards that have 6 dimms.

If going with AMD, you will be getting either a Socket C32 or G34, so your Phenom II won't be useful. Intel world, you can go either Socket LGA 1155 or 2011, ideally. If you got a LGA 1155 server board (SuperMicro, Intel, or ASUS brand are the ones I recommend looking at) you could use your 1230 V2 CPU, if it provides enough CPU power. May need to look at a Xeon-E5 CPU.
post #3 of 23
Thread Starter 
Quote:
Originally Posted by tycoonbob View Post

Need a board with more than 4 dimms. In the AMD world, that means a server board but I think there are some high end Intel boards that have 6 dimms.

If going with AMD, you will be getting either a Socket C32 or G34, so your Phenom II won't be useful. Intel world, you can go either Socket LGA 1155 or 2011, ideally. If you got a LGA 1155 server board (SuperMicro, Intel, or ASUS brand are the ones I recommend looking at) you could use your 1230 V2 CPU, if it provides enough CPU power. May need to look at a Xeon-E5 CPU.

I am not seeing any LGA1155 boards with more than 4 dimm slots. Either enthusiast or server frown.gif

On the AMD side I tried to make a dual socket G34 setup and came up with this:

Asus KGPE-D16 - $419
2 x AMD Opteron 6212 - $289 each
64gb non-ECC SDRAM - $400 or less

Total for a 16 core/64gb setup = $978

To get any more memory it looks like I would need ECC ram which drives the cost way up frown.gif
Edited by zer0sum - 2/1/13 at 4:27pm
TJ08 - Ninja
(10 items)
 
  
CPUMotherboardGraphicsRAM
3570k Asrock Z77 Professional-M Gigabyte GTX 670 Samsung Low Voltage 
Hard DriveCoolingMonitorPower
OCZ Vertex4 Custom Water Cooling Catleap Q270 Seasonic M12II 620 
CaseAudio
Silverstone Temjin TJ08-E Sound Blaster Z 
  hide details  
Reply
TJ08 - Ninja
(10 items)
 
  
CPUMotherboardGraphicsRAM
3570k Asrock Z77 Professional-M Gigabyte GTX 670 Samsung Low Voltage 
Hard DriveCoolingMonitorPower
OCZ Vertex4 Custom Water Cooling Catleap Q270 Seasonic M12II 620 
CaseAudio
Silverstone Temjin TJ08-E Sound Blaster Z 
  hide details  
Reply
post #4 of 23
Thread Starter 
Hmmm...seems you can find AMD Opteron 6128 2 GHz Eight Core processors on ebay for only $55 used.
A little older but still thats still 16 cores biggrin.gif
TJ08 - Ninja
(10 items)
 
  
CPUMotherboardGraphicsRAM
3570k Asrock Z77 Professional-M Gigabyte GTX 670 Samsung Low Voltage 
Hard DriveCoolingMonitorPower
OCZ Vertex4 Custom Water Cooling Catleap Q270 Seasonic M12II 620 
CaseAudio
Silverstone Temjin TJ08-E Sound Blaster Z 
  hide details  
Reply
TJ08 - Ninja
(10 items)
 
  
CPUMotherboardGraphicsRAM
3570k Asrock Z77 Professional-M Gigabyte GTX 670 Samsung Low Voltage 
Hard DriveCoolingMonitorPower
OCZ Vertex4 Custom Water Cooling Catleap Q270 Seasonic M12II 620 
CaseAudio
Silverstone Temjin TJ08-E Sound Blaster Z 
  hide details  
Reply
post #5 of 23
it Depends if you want new or old tech, you can get a HP DL585 G2 pretty cheap and its identical to the G5 and G6, so you can put quad cores in it like i did with mine (i installed 4 8347 HE 1.9ghz) and currently have 16x2GB sticks in the thing totalling 32GB of memory, i have 16 dimm slots spare that i could populate with 1, 2 4 or 8GB dimms
Ragnarok
(15 items)
 
Yggdrassil
(8 items)
 
 
CPUCPUMotherboardGraphics
Opteron 6272 Opteron 6272 Asus KGPE-D16 Sapphire R9 290X 
GraphicsRAMHard DriveCooling
Sapphire R9 290X 8x Samsung 8GB DDR3 1333 ECC 3TBx2 in Raid 1 Noctua NH-U12DO 
CoolingOSMonitorPower
120mm Fractal Design 1200rpm Case Fan Silent Se... Windows 7 Pro x64 1x24" 2x22" Corsair Professional HX1050 
CaseAudioOther
Fractal Design XL R2 Titanium Grey Asus MIO 892 Purple and white Braided/sleeved cables 
  hide details  
Reply
Ragnarok
(15 items)
 
Yggdrassil
(8 items)
 
 
CPUCPUMotherboardGraphics
Opteron 6272 Opteron 6272 Asus KGPE-D16 Sapphire R9 290X 
GraphicsRAMHard DriveCooling
Sapphire R9 290X 8x Samsung 8GB DDR3 1333 ECC 3TBx2 in Raid 1 Noctua NH-U12DO 
CoolingOSMonitorPower
120mm Fractal Design 1200rpm Case Fan Silent Se... Windows 7 Pro x64 1x24" 2x22" Corsair Professional HX1050 
CaseAudioOther
Fractal Design XL R2 Titanium Grey Asus MIO 892 Purple and white Braided/sleeved cables 
  hide details  
Reply
post #6 of 23
Thread Starter 
Quote:
Originally Posted by Norse View Post

it Depends if you want new or old tech, you can get a HP DL585 G2 pretty cheap and its identical to the G5 and G6, so you can put quad cores in it like i did with mine (i installed 4 8347 HE 1.9ghz) and currently have 16x2GB sticks in the thing totalling 32GB of memory, i have 16 dimm slots spare that i could populate with 1, 2 4 or 8GB dimms

I would love to pick up an old rack mount server as they are great value but I live in NYC and have limited space. Not to mention the noise that thing would make biggrin.gif
TJ08 - Ninja
(10 items)
 
  
CPUMotherboardGraphicsRAM
3570k Asrock Z77 Professional-M Gigabyte GTX 670 Samsung Low Voltage 
Hard DriveCoolingMonitorPower
OCZ Vertex4 Custom Water Cooling Catleap Q270 Seasonic M12II 620 
CaseAudio
Silverstone Temjin TJ08-E Sound Blaster Z 
  hide details  
Reply
TJ08 - Ninja
(10 items)
 
  
CPUMotherboardGraphicsRAM
3570k Asrock Z77 Professional-M Gigabyte GTX 670 Samsung Low Voltage 
Hard DriveCoolingMonitorPower
OCZ Vertex4 Custom Water Cooling Catleap Q270 Seasonic M12II 620 
CaseAudio
Silverstone Temjin TJ08-E Sound Blaster Z 
  hide details  
Reply
post #7 of 23
27 VMs on a single 256GB SSD?
    
CPUMotherboardGraphicsRAM
2x intel Xeon E5-2650 Supermicro MBD-X9DR3-F-O Onboard awesomeness 8 x 8GB Kingston DDR3 1333 ECC 
Hard DriveCoolingOSMonitor
4x WD Green 2TB in RAID 10 2x Coolermaster Hyper 212 EVOs Windows Server 2012 Datacenter 3x Dell Ultrasharp U2410s 
PowerCase
Corsair AX1200 Case Labs TX10-D 
  hide details  
Reply
    
CPUMotherboardGraphicsRAM
2x intel Xeon E5-2650 Supermicro MBD-X9DR3-F-O Onboard awesomeness 8 x 8GB Kingston DDR3 1333 ECC 
Hard DriveCoolingOSMonitor
4x WD Green 2TB in RAID 10 2x Coolermaster Hyper 212 EVOs Windows Server 2012 Datacenter 3x Dell Ultrasharp U2410s 
PowerCase
Corsair AX1200 Case Labs TX10-D 
  hide details  
Reply
post #8 of 23
Quote:
Originally Posted by Oedipus View Post

27 VMs on a single 256GB SSD?
Was wondering that myself. Wouldn't it be better to throw them on a 2TB drive or are they lightweight web servers that need the speed but not the space?
post #9 of 23
You are looking at an Opteron C32 board, or an Intel LGA-1366 or 2011 setup, if you want to stay within a budget.

LGA-1366 is the cheapest, but also essentially a dead-end.

C32 is more expensive and not faster at the lower end, but you can get dual socket setups fairly affordably with it.

LGA-2011 is probably the best option for the amount of memory and performance you are looking for, if you are willing to stay single socket.

The Socket F setups people are recommending are getting pretty old, slow, and the memory they use is expensive. Might be a cheap way to get the bare minimum you need used, but it's way more dead than LGA-1366.
Quote:
Originally Posted by Oedipus View Post

27 VMs on a single 256GB SSD?

It's doable, depending on OSed used.
Quote:
Originally Posted by zer0sum View Post

Hmmm...seems you can find AMD Opteron 6128 2 GHz Eight Core processors on ebay for only $55 used.
A little older but still thats still 16 cores biggrin.gif

He'd still need a dual G34 board. Might be workable though.
Primary
(15 items)
 
Secondary
(13 items)
 
In progress
(10 items)
 
CPUMotherboardGraphicsRAM
5820K @ 4.3/3.6GHz core/uncore, 1.225/1.2v Gigabyte X99 SOC Champion (F22n) 2x Sapphire R9 290X Tri-X OC New Edition (10036... 4x4GiB Crucial @ 2667, 12-11-12-27-T1, 1.37v 
Hard DriveHard DriveHard DriveCooling
Plextor M6e 128GB (fw 1.05) M.2 (PCI-E 2.0 2x) 2x Crucial M4 256GB 4x WD Scorpio Black 500GB Cooler Master Nepton 280L 
OSMonitorKeyboardPower
Windows 7 Professional x64 SP1 BenQ BL3200PT Filco Majestouch Tenkeyless (MX Brown) Corsair RM1000x 
CaseMouseAudio
Fractal Design Define R4 Logitech G402 Realtek ALC1150 + M-Audio AV40 
CPUMotherboardGraphicsRAM
X5670 @ 4.4/3.2GHz core/uncore, 1.36 vcore, 1.2... Gigabyte X58A-UD5 r2.0 w/FF3mod10 BIOS Reference R9 290X w/Stilt's MLU 1000e / 1375m E... 2x Samsung MV-3V4G3D/US @ 2000, 10-11-11-30-T1,... 
RAMHard DriveHard DriveHard Drive
1x Crucial BLT4G3D1608ET3LX0 @ 2000, 10-11-11-3... OCZ (Toshiba) Trion 150 120GB Hyundai Sapphire 120GB 3x Hitachi Deskstar 7k1000.C 1TB 
CoolingOSPowerCase
Noctua NH-D14 Windows 7 Pro x64 SP1 Antec TP-750 Fractal Design R5 
Audio
ASUS Xonar DS 
CPUMotherboardGraphicsRAM
i7-6800K @ 4.3/3.5GHz core/uncore, 1.36/1.2v ASRock X99 OC Formula (P3.10) GTX 780 (temporary) 4x4GiB Crucial DDR4-2400 @ 11-13-12-28-T2, 1.33v 
Hard DriveHard DriveCoolingOS
Intel 600p 256GB NVMe 2x HGST Travelstar 7k1000 1TB Corsair H55 (temporary) Windows Server 2016 Datacenter 
PowerCase
Seasonic SS-860XP2 Corsair Carbide Air 540 
  hide details  
Reply
Primary
(15 items)
 
Secondary
(13 items)
 
In progress
(10 items)
 
CPUMotherboardGraphicsRAM
5820K @ 4.3/3.6GHz core/uncore, 1.225/1.2v Gigabyte X99 SOC Champion (F22n) 2x Sapphire R9 290X Tri-X OC New Edition (10036... 4x4GiB Crucial @ 2667, 12-11-12-27-T1, 1.37v 
Hard DriveHard DriveHard DriveCooling
Plextor M6e 128GB (fw 1.05) M.2 (PCI-E 2.0 2x) 2x Crucial M4 256GB 4x WD Scorpio Black 500GB Cooler Master Nepton 280L 
OSMonitorKeyboardPower
Windows 7 Professional x64 SP1 BenQ BL3200PT Filco Majestouch Tenkeyless (MX Brown) Corsair RM1000x 
CaseMouseAudio
Fractal Design Define R4 Logitech G402 Realtek ALC1150 + M-Audio AV40 
CPUMotherboardGraphicsRAM
X5670 @ 4.4/3.2GHz core/uncore, 1.36 vcore, 1.2... Gigabyte X58A-UD5 r2.0 w/FF3mod10 BIOS Reference R9 290X w/Stilt's MLU 1000e / 1375m E... 2x Samsung MV-3V4G3D/US @ 2000, 10-11-11-30-T1,... 
RAMHard DriveHard DriveHard Drive
1x Crucial BLT4G3D1608ET3LX0 @ 2000, 10-11-11-3... OCZ (Toshiba) Trion 150 120GB Hyundai Sapphire 120GB 3x Hitachi Deskstar 7k1000.C 1TB 
CoolingOSPowerCase
Noctua NH-D14 Windows 7 Pro x64 SP1 Antec TP-750 Fractal Design R5 
Audio
ASUS Xonar DS 
CPUMotherboardGraphicsRAM
i7-6800K @ 4.3/3.5GHz core/uncore, 1.36/1.2v ASRock X99 OC Formula (P3.10) GTX 780 (temporary) 4x4GiB Crucial DDR4-2400 @ 11-13-12-28-T2, 1.33v 
Hard DriveHard DriveCoolingOS
Intel 600p 256GB NVMe 2x HGST Travelstar 7k1000 1TB Corsair H55 (temporary) Windows Server 2016 Datacenter 
PowerCase
Seasonic SS-860XP2 Corsair Carbide Air 540 
  hide details  
Reply
post #10 of 23
So I guess LGA 1155 is out of the question then. Here is a spreadsheet I had been working on with planning on my new Hyper-V hosts. These are all Intel boxes, even though I'm more of an AMD guy. These prices are all new, from Newegg.

Motherboard Socket CPU Speed (GHz) Sockets Cores Per Threads Per Total Threads RAM Slots RAM full of 4GB RAM full of 8GB Cost
ASUS Z8PE-D18 LGA 1366 Xeon E5620 2.4 2 4 8 16 18 72 144 1209.97
ASUS Z8PE-D18 LGA 1366 Xeon E5645 2.4 2 6 12 24 18 72 144 1545.97
ASUS Z8PE-D12 LGA 1366 Xeon E5620 2.4 2 4 8 16 12 48 96 1149.97
ASUS Z8PE-D12 LGA 1366 Xeon E5645 2.4 2 6 12 24 12 48 96 1485.97
ASUS Z9PE-D16/2L LGA 2011 Xeon E5-2620 2.0 (2.5) 2 6 12 24 16 64 128 1219.97
ASUS Z9PE-D16/2L LGA 2011 Xeon E5-2630 2.3 (2.8) 2 6 12 24 16 64 128 1649.97
ASUS Z9PE-D16/2L LGA 2011 Xeon E5-2609 2.4 2 4 8 16 16 64 128 979.97
ASUS Z9PA-D8 LGA 2011 Xeon E5-2620 2.0 (2.5) 2 6 12 24 8 32 64 1209.97
ASUS Z9PA-D8 LGA 2011 Xeon E5-2630 2.3 (2.8) 2 6 12 24 8 32 64 1639.97
ASUS Z9PA-D8 LGA 2011 Xeon E5-2609 2.4 2 4 8 16 8 32 64 969.97

Item Costs
ASUS Z8PE-D18 429.99
ASUS Z8PE-D12 369.99
ASUS Z9PE-D16/2L 379.99
ASUS Z9PA-D8 369.99
Intel Xeon E5620 389.99
Intel Xeon E5645 557.99
Intel Xeon E5-2620 419.99
Intel Xeon E5-2630 634.99
Intel Xeon E5-2609 299.99
8GB DDR3 RDIMM 50-60
4GB DDR3 RDIMM 20-30

Probably have to copy/paste to Excel to read it better, but this will give you several ideal options. However, those Opteron 6218's on eBay for $55? Geez, that has me itching to buy a pair and a board to match.
New Posts  All Forums:Forum Nav:
  Return Home
  Back to Forum: Servers
Overclock.net › Forums › Specialty Builds › Servers › Vmware server build with >32GB memory?