Thanks for the tip, unfortunately here in Germany I cannot get ANY '-X' Supermicro for Haswell EP, yet.
How did you get DDR4 to run at 3200 MHz, did the board allow you to set the DDR4 voltage?
RIght now, after reading the Z10PE D8 WS manual, I am really starting to doubt that this board has any advantages compared to e.g. Supermicro offerings
This used to be different in the past, but unless the manual is wrong, and if somebody lucky has the board already, please correct me if I am wrong: but the Z10PE-D8 WS board does not even allow memory voltage control anymore. Is this true?
Also, PCI Express configuration of the ASUS board is not spectacular I must see, despite ASUS having 80 PCIe lanes on their disposal
Add to this limited number of DDR4 slots (just 8), which forces people to use very expensive 32 GB LRDIMMs or, not yet available publically, 64 GB LRDIMMs if they want to have 256 or 512 GB of RAM in their worstation.
I don't know, but all of this is making the board less and less worthy IMO. Which is a pity, I was a big ASUS fan for their "WS" boards, as in the past they offered quite a lot more compared to the regular server boards. Unfortunately, it does not seem to be the case anymore.
Therefore, I am really considering X10DAX from Supermicro.
While it has only 3 PCIe x16 ports, making connecting 4 TITAN/TESLA GPUs not impossible but requiring the PCIe x8->x16 riser and making room inside the case. However, since, as far as I see, Z10PE D8 WS anyway cannot run the cards in x16/x16/x16/x16 mode, apart from the need for the riser/adapter, performance-wise there is no loss.
Why is there no vendor making a really "ultimate" dual socket (or even quad socket? one can dream...) motherboard?
My wish list would be:
- All PCIe x16 connectors, ability to run 4 GPUs in PCIe x16 mode
- 8 DDR4 slots per CPU (so 16 or 32, for dual/quad CPU socket)
- SSI EEB / e-ATX size (if quad socket, obviously this would need to be bigger e.g. SSI MEB
- As much SATA/SAS ports as possible
- Hardened components (as with consumer "overclocking" boards) and good heatsinks
- SKU with 2 x Gbit or 2 x 10GBe LAN
- BIOS/UEFI with tweaking for: BCLK, DDR4 (voltage, speed, timings), multipliers, voltages in addition to usual Xeon options available from the reference code
- Dual BIOS/UEFI or easy "flashback" (not requiring CPU to be present for board updates for new CPU SKUs even if supported CPU is not at hand)
- Of course, IPMI, 7.1 Audio, etc.
Of course, such board is really for a "niche" market ("extreme" enthusiasts), but hell.. so is Z10PE D8 WS. And I think it can be done much much better.
I suppose, motherboard vendors do not feel there would be demand for such board, since there are no unlocked 2S/4S Xeon SKUs that would necessitate such "extreme" board, and the cost of such board would easily be four-digit $.
Too bad, but one can dream