Overclock.net › Forums › Specialty Builds › Servers › ESXi Server for Home
New Posts  All Forums:Forum Nav:

ESXi Server for Home

post #1 of 33
Thread Starter 
I want to build a ESXi server to run a "router distro", Windows 7, Ubuntu, Free NAS 8, and Windows 8. I want to do video editing on the server and would like the guest OS's to perform as close to natively as possible. I had spec'd out a build on newegg earlier today.

CPU: 2x Intel Xeon E5-2620
RAM: 4x Wintec 16GB (2 x 8GB) 240-Pin DDR3 SDRAM ECC Registered DDR3 1600
MOBO/CASE/PSU: SUPERMICRO SYS-6027R-TRF 2U Server Barebone
HDD: Western Digital RE4 WD2003FYYS 2TB
RAID CARD: Adaptec RAID 5805 2244100-R SATA/SAS 8 internal ports w/ 512MB cache

This is about $2000 more then I would like to spend though. What can I change.
post #2 of 33
Why'd you spec out something $2000 over your budget tongue.gif

Anyway, you could do without the dual cpus, just get a single Xeon E3 setup
Server
(13 items)
 
  
CPUMotherboardGraphicsRAM
Intel Core i7 2600k Intel H67DE PNY Verto 9600GT (Thanks to ihasfip!) 16GB G.Skill Ripjaws 1333Mhz 
Hard DriveOSMonitorPower
(3) Seagate 7200K 1TB (2) Hitachi 7200K.12 1TB Proxmox Samsung 17" Corsair GS600 
Case
Chenbro tower 
  hide details  
Reply
Server
(13 items)
 
  
CPUMotherboardGraphicsRAM
Intel Core i7 2600k Intel H67DE PNY Verto 9600GT (Thanks to ihasfip!) 16GB G.Skill Ripjaws 1333Mhz 
Hard DriveOSMonitorPower
(3) Seagate 7200K 1TB (2) Hitachi 7200K.12 1TB Proxmox Samsung 17" Corsair GS600 
Case
Chenbro tower 
  hide details  
Reply
post #3 of 33
Thread Starter 
Quote:
Originally Posted by ZFedora View Post

Why'd you spec out something $2000 over your budget tongue.gif
Anyway, you could do without the dual cpus, just get a single Xeon E3 setup

I just added everything I thought I needed and looked at the final price at the end. See I think I went overboard because I want to use the Windows 7 guest OS to edit and encode videos and the more threads you have have available the faster encoding process will go.
post #4 of 33
Quote:
Originally Posted by Lt.JD View Post

I just added everything I thought I needed and looked at the final price at the end. See I think I went overboard because I want to use the Windows 7 guest OS to edit and encode videos and the more threads you have have available the faster encoding process will go.

That's true. Have you thought about puttin ga GPU in the system as well?
Server
(13 items)
 
  
CPUMotherboardGraphicsRAM
Intel Core i7 2600k Intel H67DE PNY Verto 9600GT (Thanks to ihasfip!) 16GB G.Skill Ripjaws 1333Mhz 
Hard DriveOSMonitorPower
(3) Seagate 7200K 1TB (2) Hitachi 7200K.12 1TB Proxmox Samsung 17" Corsair GS600 
Case
Chenbro tower 
  hide details  
Reply
Server
(13 items)
 
  
CPUMotherboardGraphicsRAM
Intel Core i7 2600k Intel H67DE PNY Verto 9600GT (Thanks to ihasfip!) 16GB G.Skill Ripjaws 1333Mhz 
Hard DriveOSMonitorPower
(3) Seagate 7200K 1TB (2) Hitachi 7200K.12 1TB Proxmox Samsung 17" Corsair GS600 
Case
Chenbro tower 
  hide details  
Reply
post #5 of 33
Thread Starter 
Quote:
Originally Posted by ZFedora View Post

That's true. Have you thought about puttin ga GPU in the system as well?

I have not because GPU's are not supported by handbrake. If someone could show me a cheaper build that would meet specifications that be greatly appreciated.
Edited by Lt.JD - 5/31/12 at 6:23pm
post #6 of 33
My first question is why so much RAM? I don't see anywhere near the need for 64GB.

How many HDDs are you going to use? Do you absolutely need the RE4 benefits? What is your total storage requirement?
    
CPUMotherboardGraphicsRAM
Core i7 970 @ 4.0 GHz 1.22 Vcore Asus Rampage II Gene GTX 260 216SP G.SKILL PI 3x2gb DDR3 1600 @ 7-8-7-24 
Hard DriveOSMonitorPower
2x 500gb Seagates RAID 0, 1x 500gb non-RAID Windows 7 Professional x64 ASUS 24'' VH242H / Spectre 24'' WS Corsair 750TX 
Case
Corsair 300R 
  hide details  
Reply
    
CPUMotherboardGraphicsRAM
Core i7 970 @ 4.0 GHz 1.22 Vcore Asus Rampage II Gene GTX 260 216SP G.SKILL PI 3x2gb DDR3 1600 @ 7-8-7-24 
Hard DriveOSMonitorPower
2x 500gb Seagates RAID 0, 1x 500gb non-RAID Windows 7 Professional x64 ASUS 24'' VH242H / Spectre 24'' WS Corsair 750TX 
Case
Corsair 300R 
  hide details  
Reply
post #7 of 33
Thread Starter 
Quote:
Originally Posted by TurboTurtle View Post

My first question is why so much RAM? I don't see anywhere near the need for 64GB.
How many HDDs are you going to use? Do you absolutely need the RE4 benefits? What is your total storage requirement?

Heard that VmWare was RAM hungry plus needed four sticks per CPU for quad channel. I do not absolutely need the benefits of the RE4s but picked them because Western Digital asserts that they are designed for RAID arrays. For the FreeNAS virtual OS I would like 8TB of storage with redundancy. Planning on running RAIDZ2 on FreeNAS 8. For Ubuntu, Windows, and "Router" 1TB between all three would suffice. 9TB would be my total storage requirement. I would like to have 8 drives in total or less if that saves money.
post #8 of 33
ESXi in itself isnt RAM hungry, only when you're running VMs that use the RAM biggrin.gif
Server
(13 items)
 
  
CPUMotherboardGraphicsRAM
Intel Core i7 2600k Intel H67DE PNY Verto 9600GT (Thanks to ihasfip!) 16GB G.Skill Ripjaws 1333Mhz 
Hard DriveOSMonitorPower
(3) Seagate 7200K 1TB (2) Hitachi 7200K.12 1TB Proxmox Samsung 17" Corsair GS600 
Case
Chenbro tower 
  hide details  
Reply
Server
(13 items)
 
  
CPUMotherboardGraphicsRAM
Intel Core i7 2600k Intel H67DE PNY Verto 9600GT (Thanks to ihasfip!) 16GB G.Skill Ripjaws 1333Mhz 
Hard DriveOSMonitorPower
(3) Seagate 7200K 1TB (2) Hitachi 7200K.12 1TB Proxmox Samsung 17" Corsair GS600 
Case
Chenbro tower 
  hide details  
Reply
post #9 of 33
Quote:
Originally Posted by ZFedora View Post

ESXi in itself isnt RAM hungry, only when you're running VMs that use the RAM biggrin.gif

This. I built a vsphere test server for my job, with a single i7 3820, 4*8GB ram, 3 NICs and a bunch of HDDs, and it works great for running 12+ VMs.

With say, 8 VMs are running, its using less than 10GB of ram. The VMs use however much RAM you put for them, plus like 24MB per 1GB extra for overhead.


Deffinately go with a single CPU, still socket 2011, and get a RAID card. thats the ONE thing I know the build I have is lacking in, have to spread around VMs so they actually run without choking each other. I went socket 2011 for the quad channel as well, but honestly dual CPU is majorly overkill unless you plan on doing processing almost constantly. We have another dual 1366 6cores rig that pretty much sits at 1% or less CPU usage because its running a ton of webservers. (almost no research went into buying the server, that was before me tongue.gif )

My suggestion:

i7 3930 http://www.newegg.com/Product/Product.aspx?Item=N82E16819116492
Whatever mobo you want (I personally picked an AsRock Extreme4 and its working great so far)
4*8GB RAM, you can always add more later!
Then those HDDs and the Raid card, whatever case that fits the mobo, and a good PSU.

vSphere is pretty damn good at balancing CPU loads, so if youre rendering on one OS while working in another, depending on HDD usage you shouldnt see too much slow down, but going single CPU will save a LOT of money, though sacrificing a LOT of power, but I don't think as much as you might think.


EDIT: so just noticed this...
Quote:
Originally Posted by Lt.JD View Post

Heard that VmWare was RAM hungry plus needed four sticks per CPU for quad channel. I do not absolutely need the benefits of the RE4s but picked them because Western Digital asserts that they are designed for RAID arrays. For the FreeNAS virtual OS I would like 8TB of storage with redundancy. Planning on running RAIDZ2 on FreeNAS 8. For Ubuntu, Windows, and "Router" 1TB between all three would suffice. 9TB would be my total storage requirement. I would like to have 8 drives in total or less if that saves money.

You REALLY dont want to do FreeNAS in vsphere. better to build a seperate server for that. really.

vSphere works with datastores, not the physical drives, and as of right now datastores cannot be larger than 2TB, meaning with a single large RAID group it may be quite a pain in the butt, so trying to get them working in vsphere alongside other VMs... well... it would be very interesting. Just wanted to warn you before you started solidifying your purchase plans.
Edited by Fooxz - 5/31/12 at 7:38pm
Fooxz Gamer
(18 items)
 
Sager 8130
(16 items)
 
MAXIMUM Server
(19 items)
 
CPUMotherboardGraphicsRAM
i5 2500K AsRock Extreme3 Gen3 GTX 470 Corsair Vengance (2x4GB) DDR3 
Hard DriveHard DriveHard DriveHard Drive
80GB Intel 320 SSD (Boot) 640GB WD Black (apps) 1TB WD Green (Fraps drive) MAXIMUS Server 
CoolingOSMonitorKeyboard
Corsair H50 Windows 7 Pro x64 HP 25" 1920x1080 Filco Majestouch Tenkeyless Cherry MX Black 
PowerCaseMouseMouse Pad
Antec TP-550 "New" NZXT Switch 810 Razer Mamba Steel Series 9HD 
AudioAudio
Logitech G930 Logitech 2.0 Speakers 
CPUMotherboardGraphicsRAM
i7-2670QM Clevo P151HM1 Base nVidia 560m 8GB 
Hard DriveOptical DriveCoolingOS
Corsair Force 3 240GB Combo Way too weak. Win 7 Pro x64 
MonitorKeyboardPowerCase
15.6” LED Backlit 1920x1080 Super Clear Matte Laptop Keyboard 120W Power Brick Chrome Buran Stealth Black messenger bag 
MouseMouse PadAudioAudio
Logitech G700 Steel Series 4HD Onboard > JDS Labs CMoy > Yuin PK1s or AKG K271s Logitech G930 
CPUMotherboardGraphicsRAM
i7 870 ASUS MAXIMUS III GENE nVidia 440GT GSkill 2x4GB 1600mhz 
Hard DriveHard DriveHard DriveHard Drive
Random 120GB Hitachi 2.5in 500GB  Western Digital Green 1TB Western Digital Green 2TB 
Hard DriveOptical DriveCoolingOS
Western Digital Green 3TB USB3 Samsung SATA BluRay Drive Noctua D14 Win 7 Pro x64 
MonitorKeyboardPowerCase
RDP RDP FSP 350w Fractal Design Define Mini 
MouseMouse PadAudio
RDP Nada Optical Out to 5.0 stereo  
  hide details  
Reply
Fooxz Gamer
(18 items)
 
Sager 8130
(16 items)
 
MAXIMUM Server
(19 items)
 
CPUMotherboardGraphicsRAM
i5 2500K AsRock Extreme3 Gen3 GTX 470 Corsair Vengance (2x4GB) DDR3 
Hard DriveHard DriveHard DriveHard Drive
80GB Intel 320 SSD (Boot) 640GB WD Black (apps) 1TB WD Green (Fraps drive) MAXIMUS Server 
CoolingOSMonitorKeyboard
Corsair H50 Windows 7 Pro x64 HP 25" 1920x1080 Filco Majestouch Tenkeyless Cherry MX Black 
PowerCaseMouseMouse Pad
Antec TP-550 "New" NZXT Switch 810 Razer Mamba Steel Series 9HD 
AudioAudio
Logitech G930 Logitech 2.0 Speakers 
CPUMotherboardGraphicsRAM
i7-2670QM Clevo P151HM1 Base nVidia 560m 8GB 
Hard DriveOptical DriveCoolingOS
Corsair Force 3 240GB Combo Way too weak. Win 7 Pro x64 
MonitorKeyboardPowerCase
15.6” LED Backlit 1920x1080 Super Clear Matte Laptop Keyboard 120W Power Brick Chrome Buran Stealth Black messenger bag 
MouseMouse PadAudioAudio
Logitech G700 Steel Series 4HD Onboard > JDS Labs CMoy > Yuin PK1s or AKG K271s Logitech G930 
CPUMotherboardGraphicsRAM
i7 870 ASUS MAXIMUS III GENE nVidia 440GT GSkill 2x4GB 1600mhz 
Hard DriveHard DriveHard DriveHard Drive
Random 120GB Hitachi 2.5in 500GB  Western Digital Green 1TB Western Digital Green 2TB 
Hard DriveOptical DriveCoolingOS
Western Digital Green 3TB USB3 Samsung SATA BluRay Drive Noctua D14 Win 7 Pro x64 
MonitorKeyboardPowerCase
RDP RDP FSP 350w Fractal Design Define Mini 
MouseMouse PadAudio
RDP Nada Optical Out to 5.0 stereo  
  hide details  
Reply
post #10 of 33
Ah, I was wondering if you'd be using ZFS.

Problem there is that usually a home environment doesn't have enough load to warrant the caching features of ZFS. Don't get me wrong, once I went ZFS on my home server I've been in love with it - but the use of the memory cache is severely limited in a home environment. 8GB would be plenty I would think, if not slightly overkill unless you are constantly accessing specific information.

Off the top of my head I'd say 2GB for the router, 2-4 for Ubuntu/W8 depending on purpose. As for the W7 guest for the encoding - how much editing to you actually do? The times I've re-encoded with HandBrake RAM usage didn't go much above 4GB on a 1080p video file. So, all in total you could get by easily with 32GB. Could drop a nice amount in the price, especially considering if you want quad channel you'd drop from 8GB ECC DIMMs to 4GB.

If you need 9TB of usable space and RAIDZ2, you'd need 8 drives, and that would give you ~10TB of usable space. Using 6 drives instead would give you 8TB of usable space. However, I do not believe you'd need a dedicated RAID card since you'd be running (effectively) software RAID within the guests. What you'd need instead is a decent controller card (which in most cases would still be a RAID card at ~8 ports available). For example, check out this RocketRAID 2320 card. Still a RAID card, yes, but you're looking for a decent controller not a decent piece of hardware RAID. RocketRAID makes very solid controllers, and this would shave a few hundred off.

Alternatively, you could get a few ~$50 4-port SATA controller cards. Performance might vary there, I honestly don't know but it could still save some cash.


EDIT:
Quote:
vSphere works with datastores, not the physical drives

Fooxz, I was under the impression VMWare could pass the physical block device on Intel platforms if the processor supports VT-d, which the Xeons do. Is that not correct, or is there more to it?
Edited by TurboTurtle - 5/31/12 at 7:48pm
    
CPUMotherboardGraphicsRAM
Core i7 970 @ 4.0 GHz 1.22 Vcore Asus Rampage II Gene GTX 260 216SP G.SKILL PI 3x2gb DDR3 1600 @ 7-8-7-24 
Hard DriveOSMonitorPower
2x 500gb Seagates RAID 0, 1x 500gb non-RAID Windows 7 Professional x64 ASUS 24'' VH242H / Spectre 24'' WS Corsair 750TX 
Case
Corsair 300R 
  hide details  
Reply
    
CPUMotherboardGraphicsRAM
Core i7 970 @ 4.0 GHz 1.22 Vcore Asus Rampage II Gene GTX 260 216SP G.SKILL PI 3x2gb DDR3 1600 @ 7-8-7-24 
Hard DriveOSMonitorPower
2x 500gb Seagates RAID 0, 1x 500gb non-RAID Windows 7 Professional x64 ASUS 24'' VH242H / Spectre 24'' WS Corsair 750TX 
Case
Corsair 300R 
  hide details  
Reply
New Posts  All Forums:Forum Nav:
  Return Home
  Back to Forum: Servers
Overclock.net › Forums › Specialty Builds › Servers › ESXi Server for Home