Overclock.net - An Overclocking Community - View Single Post - Asus Z9PE-D8 Owner's thread
View Single Post
post #1 of (permalink) Old 05-23-2012, 09:02 PM - Thread Starter
Looking Ahead
TheBlademaster01's Avatar
Join Date: Dec 2008
Location: Cluain Dolcáin, Leinster (Ireland)
Posts: 13,043
Rep: 785 (Unique: 536)
Asus Z9PE-D8 WS

Intel(R) JPEG Library, version 1,5,4,36
Intel(R) JPEG Library, version 1,5,4,36

Asus Z9PE-D8 WS website

Motherboard features & specs Warning: Spoiler! (Click to show)
Intel® Socket 2011 Processors
Dual Intel® Socket 2011 for Xeon® processor E5-2600/E5-2600 v2 product family
Supports Intel® Turbo Boost Technology 2.0
* Refer to www.asus.com for CPU support list
Intel® C602
8 x DIMM, Max. 64GB, DDR3 2133(O.C.)/2000(O.C.)/1866/1600/1333/1066 MHz ECC, Non-ECC, Un-buffered Memory *1
Quad Channel Memory Architecture
*For Registered Memory, Max. 256GB DDR3 1866/1600/1333/1066/800 MHz
* Refer to www.asus.com for the Memory QVL (Qualified Vendors Lists).
System Bus
8.0/7.2/6.4 GT/s Intel® QuickPath Interconnect
Multi-GPU Support
Supports NVIDIA® 4-Way SLI™ Technology
Supports AMD Quad-GPU CrossFireX™ Technology
Expansion Slots
4 x PCIe 3.0/2.0 x16 (dual x16 or quad x8) *2
2 x PCIe 3.0/2.0 x16 *2
1 x PCIe 3.0/2.0 x16 (x8 mode) *2
Intel® C602 chipset :
2 x SATA 6Gb/s port(s), blue
8 x SATA 3Gb/s port(s), black
Support Raid 0, 1, 5, 10
Marvell® PCIe 9230 controller :
4 x SATA 6Gb/s port(s), gray
Support Raid 0, 1, 10
Intel® 82574L, 2 x Gigabit LAN Controller(s)
Realtek® ALC898 8-Channel High Definition Audio CODEC
- Supports : Jack-detection, Multi-streaming, Front Panel Jack-retasking
Audio Feature :
- Absolute Pitch 192kHz/ 24-bit True BD Lossless Sound
- DTS Ultra PC II
- Optical S/PDIF out port(s) at back panel
USB Ports
ASMedia® USB 3.0 controller :
4 x USB port(s) (2 at back panel, , 2 at mid-board)
Workstation Feature
Quick Gate: 2 x vertical USB 2.0 on board
ASWM Enterprise
ASMB6-iKVM Remote Management Tool
Special Features
ASUS Digital Power Design :
- Industry leading Digital 7 +1 Phase Power Design
- Industry leading Digital 2 Phase DRAM Power Design
ASUS Exclusive Features :
- Front Panel USB 3.0 Support
- ASUS SSD Caching II
ASUS Quiet Thermal Solution :
- Stylish Fanless Design Heat-pipe solution
- ASUS CrashFree BIOS 3
- ASUS EZ Flash 2
- ASUS MyLogo 2
- Multi-language BIOS
ASUS Q-Design :
- ASUS Q-Shield
- ASUS Q-Code
- ASUS Q-Slot
Back I/O Ports
1 x PS/2 keyboard/mouse combo port(s)
2 x LAN (RJ45) port(s)
2 x USB 3.0
6 x USB 2.0
1 x Optical S/PDIF out
6 x Audio jack(s)
Internal I/O Ports
1 x USB 3.0 connector(s) support(s) additional 0 USB 3.0 port(s)
2 x USB 2.0 connector(s) support(s) additional 4 USB 2.0 port(s)
2 x USB 2.0/1.1 vertical port(s)
2 x COM port(s) connector(s)
2 x IEEE 1394a connector(s)
2 x CPU Fan connector(s) (2 x 4 -pin)
6 x Chassis Fan connector(s)
1 x S/PDIF out header(s)
1 x 24-pin EATX Power connector(s)
2 x 8-pin ATX 12V Power connector(s)
1 x 4-pin EZ_PLUG Power connector(s)
1 x ASMB6-iKVM connector(s)
1 x VGA connector(s)
1 x Front panel audio connector(s) (AAFP)
1 x AUX panel header(s)
1 x SMBus header(s)
1 x System panel(s)
1 x Power-on button(s)
1 x Reset button(s)
1 x Clear CMOS jumper(s)
User's manual
ASUS Q-Shield
2 x COM port cable(s)
8 x SATA 3Gb/s cable(s)
6 x SATA 6Gb/s cable(s)
1 x 3-Way SLI bridge(s)
1 x 4-Way SLI bridge(s)
1 x SLI bridge(s)
0 x 1-port 1394a module(s)
64 Mb Flash ROM, UEFI BIOS, PnP, DMI2.0, WfM2.0, SM BIOS 2.6, ACPI 2.0a, Multi-language BIOS, ASUS EZ Flash 2, ASUS CrashFree BIOS 3
WfM 2.0, DMI 2.0, WOL by PME, WOR by PME, PXE
Support Disc
ASUS Utilities
ASUS Update
Operating System
Windows® Server 2008 R2 Enterprise
Windows® Server 2008 Enterprise SP2 64-bit
Windows® 8 64-bit
Windows® Server 2012
Windows® 7 32/64-bit
Form Factor
EEB Form Factor
12 inch x 13 inch ( 30.5 cm x 33 cm )
1* E5-2600 series CPU support DDR3-2133(O.C)/2000(O.C)/1866(O.C)/1600/1333/1066 MHz
1* E5-2600 V2 series CPU support DDR3-1866/1600/1333/1066 MHz
*2: This motherboard is ready to support PCIe 3.0 SPEC. Functions will be available when using PCIe 3.0-compliant devices. Please refer to www.asus.com for updated details.

E5 ES compatibility listing Warning: Spoiler! (Click to show)
Troubleshooting Warning: Spoiler! (Click to show)
Originally Posted by BlackenedTush View Post

Coolers too tight...?
I mentioned to PhxTriode that my coolers are Dynatron R17s. I had never installed a Sandy Brdge CPU cooler before and I got a little enthusiastic with the spring loaded mounting screws - I had torked them a tad too tight. As a result I was having problems getting any video signals out of my EVGA GeForce 670 GPU. On a hunch Chris at EVGA told me to try loosening the CPU cooler screws. I did and Voila!, everything worked. Evidently the CPU seats on many motherboards are susceptible to very slight warpage under these conditions... leading to just enough distortion to cause marginal CPU Pin connection in the seat, and many potential symptoms. Just a thot...

Originally Posted by BlackenedTush View Post
My GTX670 is the EVGA SuperClocked 4GB w/ Backplane (NVIDIA driver version, It looks like a reference card. Not sure if brand or model makes much difference with our board since it follows the NVIDIA reference design for the most part, but it is generally touchy with these Keplers. My BIOS is v0503.

Fixing Posting and GPU Issue

After putting my beast together I also had problems getting my board to post. Not seeing any 64GB kits out there I had purchased two 32GB Vengeance RAM kits. I assumed that they would play well together. At the time I was clueless as to the cause of the posting issue. But by swapping RAM sticks in positions1 & 2. I was able to get posting to happen; but then my monitors only came to life maybe 2 out of the next 10 attempts and then not at all. My monitors kept complaining of no HDMI signal. I put the GTX670 in various PCIe slots with no better results. EVGA helped me. The problem there turned out to be the fact I had tightened my Dynatron CPU coolers too tight. Evidently the excess tightness was warping the CPU seats on the board just enough to cause PCIe anomalies. So I loosened them up to the point that they weren't pressuring the CPUs at all; but not so much that there was play between the CPUs and seats. I then tugged very gently on the CPUs to equalize pressures and re-tightened the coolers a small amount. My system posted, booted into Windows, and my monitors worked!
After the scramble to get it to post, my GPU had ended up in slot 3, so I moved it to slot 5 where I had planned to put it for better cooling distribution and because it doesn't switch down to 8x based on the presence of other cards in even numbered slots. Further tests confirmed that everything was still working.
Now at this point I was thinking that my problems were only due to CPU seat warping causing issues with the PCIe and RAM channels. I hadn't realized that I had also been dealing with some intermittent problems in the RAM itself.

My Advice

Not knowing what you've done or not and what you know or don't know... I don't wish to insult anyone's intelligence. Given that this board seems haunted at times or at least hormonal, this is what I would do taking each subsequent step if posting doesn't happen:
Clear RTC RAM. Make sure jumper ends up in correct position
Check and verify that CPU coolers are minimally tight
Reduce PCIe occupation to only the GPU. Try GPU in odd-numbered slot 5 or 7 (both are 16x, driven by CPU2, and not subject to speed switching complications)
Try GPU in odd-numbered slot 1 or 3 (both 16x/8x, driven by CPU1, and subject to speed switching complications)
Reduce RAM to a single stick in slot DIMM_A1 (the leftmost slot for for CPU1)
Swap alternate RAM sticks into DIMM_A1
Swap GPU into the alternate PCIe slot (5 or 7)
Reduce to most minimal config: only one CPU, one stick of RAM, and one PCIe card (GPU).
Single CPU must be in seat CPU1 (upper right), Single RAM stick must be in slot DIMM_A1 , and GPU must be in odd-numbered PCIe slot 1 or 3 (where it's driven by CPU1).
Try swapping in other RAM sticks into DIMM_A1 and moving GPU to the other odd-numbered slot

If you get it to post at most minimal config, then populate with additional RAM (from one kit). Begin by making a 2x config - add DIMM_B1 and test it, Then make a 4x config by adding both DIMM_C1 & DIMM_D1 and test. If that works, try adding the second CPU.

Originally Posted by AndyE View Post

1) The Q-Codes are listed in the manual and provide at least a solution to know until when the POST run ok. Good that the system is now starting
A good summary for initial boot issues:

2) If memory is "missing" then the first thing I would do is to reset the CMOS memory. Potentially, in trying to get the system starting, you changed essential settings and impacted this part of POST

3) ME is the Intel Management Engine which is part of Intels vPro offering. Basically it is a small computer on the motherboard supervising the operation of the system, even if the main CPUs are turned off - i.e. you can remotely start the Asus MB via this mechanism

4) With default CMOS settings, the MB shows the tarbet base frequency, which is in your case 3100MHz. If perf mode and similar things are changed, it could be different (haven't personally tried it)

5) This is normaly behavior. Even if the workload of AIDA, HWInfo etc is not big, you are executing software on your system. There is no hard affinity between the executing thread in an application abnd the physical core in the socket - shows up as a kind of random pattern. Benchmark software potentiall wakes up the CPU to get the timing operation right. I would *only* be concerned, if the system with good benchmark software under load would not go to either 3100MHz or better 3400 MHz (depending on your cooler). 3400 MHZ is the max frequency for all cores in Turbo mode. For 1-2 core under load the speed can go up to 3800 MHz. Good benchmark software for such a system is Intel's Linpack, be more critical of the results of the usual known benchmark apps - they are not optimized for NUMA boards like yours.

Memory amount: This is normal
Memory is used for all kind of things like I/O devices are mapped into physical memory space. Some utilities see one POV, some have other approaches. 48 MB difference look like a PCI express card is mapped into memory space.

4 x 8 GB memory is a suboptimal configuration for this system. One of the reasons for a dual socket MB is a the increased bandwidth you might get. In this configuration the 16 cores of the 2xE5-2687W will starve for memory bandwidth to achive their regular performance. Basically, you run the 8 core socket with the memory bandwidth of a 4 core i7-3770. Either switch to 8x4 GB or 8x8GB. Systems like this are NOT designed to achieve low latency /high speed for individual threads, for these kind of apps an OC system with fewer cores is the better solution. If you need THROUGHPUT, then this system will shine and and leave all single socket systems in the dust. As an example: It is possible to read a 100GB file within 5 seconds into main memory (this is actually what I am doing with mine). Try this with an OC i7-3770K or i7-3930K, it wouldn't be possible.

To identify possible errors, I'd start with one populated socket, and go with 1 RAM DIMM and start there. Run the system under load for a few hours (linpack i.e.) and check the stability in its minimal config. Move from there by adding more memory Dimms to one socket. If all goes well, THEN add the second. If problems arise, change back to a single socket config with the "faulty" CPU and re-check stability. If stability is there, your setup might have been screwed for dual socket ops (or one CPU is indeed defect. Clear the CMOS and re-check with 2 sockets.

As said, many classic benchmark utilities are "confused" with NUMA systems or if the performance goes in regions beyond the design of the software. Some of them get actual slower (as data has to be moved via the QPI interconnect and there are WAY too many cores to choose from. Software which does not explicitly control the mapping of threads and memory to the indivual sockets and cores, will never achieve top performance on a 32 core NUMA system. Most benchmark utilities are not written in this way, which regularily might people belief that the single socket system gives more bang for the buck. This is correct if the assessement is done with these kind of software, it is not correct with properly developed software.

This is especially true for memory bandwidth performance checks .Your decline might come from the utility's inability to properly understand your topology. Check with stream benchmark. A system with 1600MHz memory should be in the 80 GB/sec range


TheBlademaster01 is offline