Overclock.net › Forums › Industry News › Software News › [Various] Ashes of the Singularity DX12 Benchmarks
New Posts  All Forums:Forum Nav:

[Various] Ashes of the Singularity DX12 Benchmarks  

post #1 of 2682
Thread Starter 
A relevant blog post from the game's creators,Oxide: The birth of a new API


PCPerspective

ExtremeTech

EuroGamer

Legit Reviews

Computerbase.de



Thanks to @Mahigan for the insights and legwork!

An Oxide rep responds to address the various discrepancies seen in the benchmark:
Quote:
Originally Posted by Kollock View Post

Wow, there are lots of posts here, so I'll only respond to the last one. The interest in this subject is higher then we thought. The primary evolution of the benchmark is for our own internal testing, so it's pretty important that it be representative of the gameplay. To keep things clean, I'm not going to make very many comments on the concept of bias and fairness, as it can completely go down a rat hole.

Certainly I could see how one might see that we are working closer with one hardware vendor then the other, but the numbers don't really bare that out. Since we've started, I think we've had about 3 site visits from NVidia, 3 from AMD, and 2 from Intel ( and 0 from Microsoft, but they never come visit anyone ;(). Nvidia was actually a far more active collaborator over the summer then AMD was, If you judged from email traffic and code-checkins, you'd draw the conclusion we were working closer with Nvidia rather than AMD wink.gif As you've pointed out, there does exist a marketing agreement between Stardock (our publisher) for Ashes with AMD. But this is typical of almost every major PC game I've ever worked on (Civ 5 had a marketing agreement with NVidia, for example). Without getting into the specifics, I believe the primary goal of AMD is to promote D3D12 titles as they have also lined up a few other D3D12 games.

If you use this metric, however, given Nvidia's promotions with Unreal (and integration with Gameworks) you'd have to say that every Unreal game is biased, not to mention virtually every game that's commonly used as a benchmark since most of them have a promotion agreement with someone. Certainly, one might argue that Unreal being an engine with many titles should give it particular weight, and I wouldn't disagree. However, Ashes is not the only game being developed with Nitrous. It is also being used in several additional titles right now, the only announced one being the Star Control reboot. (Which I am super excited about! But that's a completely other topic wink.gif).

Personally, I think one could just as easily make the claim that we were biased toward Nvidia as the only 'vendor' specific code is for Nvidia where we had to shutdown async compute. By vendor specific, I mean a case where we look at the Vendor ID and make changes to our rendering path. Curiously, their driver reported this feature was functional but attempting to use it was an unmitigated disaster in terms of performance and conformance so we shut it down on their hardware. As far as I know, Maxwell doesn't really have Async Compute so I don't know why their driver was trying to expose that. The only other thing that is different between them is that Nvidia does fall into Tier 2 class binding hardware instead of Tier 3 like AMD which requires a little bit more CPU overhead in D3D12, but I don't think it ended up being very significant. This isn't a vendor specific path, as it's responding to capabilities the driver reports.

From our perspective, one of the surprising things about the results is just how good Nvidia's DX11 perf is. But that's a very recent development, with huge CPU perf improvements over the last month. Still, DX12 CPU overhead is still far far better on Nvidia, and we haven't even tuned it as much as DX11. The other surprise is that of the min frame times having the 290X beat out the 980 Ti (as reported on Ars Techinica). Unlike DX11, minimum frame times are mostly an application controlled feature so I was expecting it to be close to identical. This would appear to be GPU side variance, rather then software variance. We'll have to dig into this one.

I suspect that one thing that is helping AMD on GPU performance is D3D12 exposes Async Compute, which D3D11 did not. Ashes uses a modest amount of it, which gave us a noticeable perf improvement. It was mostly opportunistic where we just took a few compute tasks we were already doing and made them asynchronous, Ashes really isn't a poster-child for advanced GCN features.

Our use of Async Compute, however, pales with comparisons to some of the things which the console guys are starting to do. Most of those haven't made their way to the PC yet, but I've heard of developers getting 30% GPU performance by using Async Compute. Too early to tell, of course, but it could end being pretty disruptive in a year or so as these GCN built and optimized engines start coming to the PC. I don't think Unreal titles will show this very much though, so likely we'll have to wait to see. Has anyone profiled Ark yet?

In the end, I think everyone has to give AMD alot of credit for not objecting to our collaborative effort with Nvidia even though the game had a marketing deal with them. They never once complained about it, and it certainly would have been within their right to do so. (Complain, anyway, we would have still done it, wink.gif)

--
P.S. There is no war of words between us and Nvidia. Nvidia made some incorrect statements, and at this point they will not dispute our position if you ask their PR. That is, they are not disputing anything in our blog. I believe the initial confusion was because Nvidia PR was putting pressure on us to disable certain settings in the benchmark, when we refused, I think they took it a little too personally.

Edited by p4inkill3r - 8/29/15 at 9:37pm
Lil' Roy Taylor
(11 items)
 
  
Lil' Roy Taylor
(11 items)
 
  
post #2 of 2682
ExtremeTech FPS charts for DX11 vs DX12, Fury X vs 980Ti.

You could put this link up in the OP as well.
    
CPUMotherboardGraphicsRAM
AMD Phenom II x6 1055T [3.932GHz, 2.56GHz NB] ASUS M4A89GTD PRO/USB3 GTX 960 G1 4GB 1500MHz / 8000MHz (+65mV) Kingston HyperX 2x4 GB @ 1493MHz 8-8-8-27-1T 
Hard DriveHard DriveOptical DriveCooling
WD Caviar Blue 500GB 7200 RPM 16MB Samsung 850 EVO 120GB LG RW Noctua NH-D14 
OSMonitorMonitorKeyboard
Windows 7 Ultimate x64 37" FHD TV (Native 1080p) LG 22MP47 1080p - IPS Generic Genius Keyboard 
PowerCaseMouseMouse Pad
SilverStone Strider (SST-ST75F-P) 750W Modular,... Thermaltake SopranoRS (Side Panel Off) Redragon M601 Centrophorus Razer Goliathus Control (M) 
  hide details  
    
CPUMotherboardGraphicsRAM
AMD Phenom II x6 1055T [3.932GHz, 2.56GHz NB] ASUS M4A89GTD PRO/USB3 GTX 960 G1 4GB 1500MHz / 8000MHz (+65mV) Kingston HyperX 2x4 GB @ 1493MHz 8-8-8-27-1T 
Hard DriveHard DriveOptical DriveCooling
WD Caviar Blue 500GB 7200 RPM 16MB Samsung 850 EVO 120GB LG RW Noctua NH-D14 
OSMonitorMonitorKeyboard
Windows 7 Ultimate x64 37" FHD TV (Native 1080p) LG 22MP47 1080p - IPS Generic Genius Keyboard 
PowerCaseMouseMouse Pad
SilverStone Strider (SST-ST75F-P) 750W Modular,... Thermaltake SopranoRS (Side Panel Off) Redragon M601 Centrophorus Razer Goliathus Control (M) 
  hide details  
post #3 of 2682
Those gains from the 390x are insane
post #4 of 2682
I did a quick test with TITANX, results below. DX12 was about 10FPS faster on my test. The performance seems related to number of CPU cores though. Going to do some more testing.

PS: Latest version of PrecisionX has full OSD support tongue.gif



DX12:


DX11:

Edited by EVGA-JacobF - 8/17/15 at 9:54am
jfreeZr
(11 items)
 
hadronGTX
(6 items)
 
 
CPUMotherboardGraphicsRAM
4770K @ 5.2GHz EVGA Z87 Classified EVGA GTX 980 ACX2 2666MHz CL12 DDR3 
Hard DriveCoolingOSMonitor
2x Samsung EVO RAID0 Phase Change Win8.1 64 Catleap 27" 2560x1440 110Hz 
PowerCaseAudio
EVGA SuperNOVA 1000 P2 Primochill Wet Bench Core3D + Sennheiser HD595 + iBasso Amp 
CPUMotherboardRAMHard Drive
Intel 3770K EVGA Z77 Stinger EVGA GeForce GTX 780 Ti ACX 2x Vertex3 SSD 480GB RAID0 
CoolingCase
Corsair H60 EVGA Hadron Hydro 
  hide details  
jfreeZr
(11 items)
 
hadronGTX
(6 items)
 
 
CPUMotherboardGraphicsRAM
4770K @ 5.2GHz EVGA Z87 Classified EVGA GTX 980 ACX2 2666MHz CL12 DDR3 
Hard DriveCoolingOSMonitor
2x Samsung EVO RAID0 Phase Change Win8.1 64 Catleap 27" 2560x1440 110Hz 
PowerCaseAudio
EVGA SuperNOVA 1000 P2 Primochill Wet Bench Core3D + Sennheiser HD595 + iBasso Amp 
CPUMotherboardRAMHard Drive
Intel 3770K EVGA Z77 Stinger EVGA GeForce GTX 780 Ti ACX 2x Vertex3 SSD 480GB RAID0 
CoolingCase
Corsair H60 EVGA Hadron Hydro 
  hide details  
post #5 of 2682
Is there a stand alone benchmark or do you have to buy the game?

edit: thanks JacopF
Office rig
(25 items)
 
   
CPUMotherboardGraphicsRAM
Intel Core i7 6700K @ 4.5GHz MSI Z170A Gaming M9ACK EVGA Titan X Corsair Vengeance LPX 16GB DDR4  
Hard DriveHard DriveHard DriveOptical Drive
Samsung Evo 840 1TB WD Black WD6401AALS WD Scorpio Blue WD3200BEVT Samsung SH-S223Q DVD-R/W 
CoolingCoolingCoolingCooling
EK Titan X block AlphaCool XT45 360 AlphaCool UT60 240 Swiftech MCP655-PWM 
CoolingCoolingCoolingCooling
EK D5 x-res XSPC RayStorm Aquacomputer Aquaero 5 Series Waterblock Aquacomputer Aquaero 5 LT 
OSMonitorKeyboardPower
Win10 BenQ BL3200PT (32" 2560x1440) Corsair K70 RGB Corsair AX860 
CaseMouseMouse PadOther
NZXT Switch 810 Corsair M65 CIG Aegis Goliath Epson Home Cinema 8350 w/92" 16:9 screen 
Other
HTC Vive 
CPUMotherboardGraphicsRAM
Ryzen 5 1600X Asrock X370 Professional Gaming Gigabyte Aorus 1080Ti Xtreme Edition G.Skill TridentZ 3200 
Hard DriveHard DriveHard DriveCooling
850 EVO 1TB WD 500GB Velociraptor Crucial MX300 1TB Corsair H105 
OSMonitorPowerCase
Windows 10 4k TV Corsair AX860 Cooler Master HAF XB EVO 
MouseMouse PadAudioOther
Logitech M510 Corsair Lapdog Pioneer SC-81 Epson Home Cinema 8350 
  hide details  
Office rig
(25 items)
 
   
CPUMotherboardGraphicsRAM
Intel Core i7 6700K @ 4.5GHz MSI Z170A Gaming M9ACK EVGA Titan X Corsair Vengeance LPX 16GB DDR4  
Hard DriveHard DriveHard DriveOptical Drive
Samsung Evo 840 1TB WD Black WD6401AALS WD Scorpio Blue WD3200BEVT Samsung SH-S223Q DVD-R/W 
CoolingCoolingCoolingCooling
EK Titan X block AlphaCool XT45 360 AlphaCool UT60 240 Swiftech MCP655-PWM 
CoolingCoolingCoolingCooling
EK D5 x-res XSPC RayStorm Aquacomputer Aquaero 5 Series Waterblock Aquacomputer Aquaero 5 LT 
OSMonitorKeyboardPower
Win10 BenQ BL3200PT (32" 2560x1440) Corsair K70 RGB Corsair AX860 
CaseMouseMouse PadOther
NZXT Switch 810 Corsair M65 CIG Aegis Goliath Epson Home Cinema 8350 w/92" 16:9 screen 
Other
HTC Vive 
CPUMotherboardGraphicsRAM
Ryzen 5 1600X Asrock X370 Professional Gaming Gigabyte Aorus 1080Ti Xtreme Edition G.Skill TridentZ 3200 
Hard DriveHard DriveHard DriveCooling
850 EVO 1TB WD 500GB Velociraptor Crucial MX300 1TB Corsair H105 
OSMonitorPowerCase
Windows 10 4k TV Corsair AX860 Cooler Master HAF XB EVO 
MouseMouse PadAudioOther
Logitech M510 Corsair Lapdog Pioneer SC-81 Epson Home Cinema 8350 
  hide details  
post #6 of 2682
up to more than 2x faster compared to dx11, 390x. Very nice
Edited by Ha-Nocri - 9/6/15 at 1:58pm
post #7 of 2682
Fury X and 980Ti neck and neck in the DX12 scores, compared to the Ti being 1.4x faster at 4K and 1.8x faster at 1080p in DX11.
Puter
(16 items)
 
Silent HTPC
(8 items)
 
 
CPUMotherboardGraphicsRAM
4670k Maxuimus Hero VI Gigabyte G1 Gaming GTX1080 Corsair Vengeance Pro 16GB 2400Mhz 
Hard DriveHard DriveCoolingMonitor
Samsung 840 Pro Samsung 840 Evo Corsair H110i GTX Asus PG278Q ROG Swift 
MonitorKeyboardPowerCase
Asus VG248QE CMStorm Quickfire Rapid EVGA 1000 P2 Fractal Design R4 
MouseMouse PadAudioAudio
Zowie FK2 SteelSeries QCK+ Creative Soundblaster Z Sennheiser G4ME Zero 
CPUMotherboardRAMHard Drive
Intel i3-4150 MSI H97I AC Corsair Vengeance LP 8gb 1600Mhz Samsung 840 Evo 120gb 
Optical DriveKeyboardPowerCase
Blu-Ray slim ODD Logitech K400r Streacom 150w nanoPSU Streacom FC8 EVO black fanless ITX case 
  hide details  
Puter
(16 items)
 
Silent HTPC
(8 items)
 
 
CPUMotherboardGraphicsRAM
4670k Maxuimus Hero VI Gigabyte G1 Gaming GTX1080 Corsair Vengeance Pro 16GB 2400Mhz 
Hard DriveHard DriveCoolingMonitor
Samsung 840 Pro Samsung 840 Evo Corsair H110i GTX Asus PG278Q ROG Swift 
MonitorKeyboardPowerCase
Asus VG248QE CMStorm Quickfire Rapid EVGA 1000 P2 Fractal Design R4 
MouseMouse PadAudioAudio
Zowie FK2 SteelSeries QCK+ Creative Soundblaster Z Sennheiser G4ME Zero 
CPUMotherboardRAMHard Drive
Intel i3-4150 MSI H97I AC Corsair Vengeance LP 8gb 1600Mhz Samsung 840 Evo 120gb 
Optical DriveKeyboardPowerCase
Blu-Ray slim ODD Logitech K400r Streacom 150w nanoPSU Streacom FC8 EVO black fanless ITX case 
  hide details  
post #8 of 2682
Still seems like it relies on strong single core performance. Wonder if that's just the engine?
Big Timmah
(13 items)
 
  
CPUMotherboardGraphicsRAM
Ryzen 5 1600 Asrock x370 Killer SLI/AC Sapphire Radeon Nitro Fury CORSAIR Vengeance LPX 16GB 3200mhz 
Hard DriveCoolingOSMonitor
PNY 480GB SSD PH-TC12DX Black Windows 10 Pro LG 29inch Ultrawide 
KeyboardPowerCaseMouse
Corsair K70 Thermaltake SMART M Series 850W NZXT S340 White Steel ATX Mid Tower Case Wireless Logitech thing 
Mouse Pad
With a supple pad  
  hide details  
Big Timmah
(13 items)
 
  
CPUMotherboardGraphicsRAM
Ryzen 5 1600 Asrock x370 Killer SLI/AC Sapphire Radeon Nitro Fury CORSAIR Vengeance LPX 16GB 3200mhz 
Hard DriveCoolingOSMonitor
PNY 480GB SSD PH-TC12DX Black Windows 10 Pro LG 29inch Ultrawide 
KeyboardPowerCaseMouse
Corsair K70 Thermaltake SMART M Series 850W NZXT S340 White Steel ATX Mid Tower Case Wireless Logitech thing 
Mouse Pad
With a supple pad  
  hide details  
post #9 of 2682
Insane gains, I'll tell you that.
This looks promising.
    
CPUMotherboardGraphicsRAM
AMD Phenom II x6 1055T [3.932GHz, 2.56GHz NB] ASUS M4A89GTD PRO/USB3 GTX 960 G1 4GB 1500MHz / 8000MHz (+65mV) Kingston HyperX 2x4 GB @ 1493MHz 8-8-8-27-1T 
Hard DriveHard DriveOptical DriveCooling
WD Caviar Blue 500GB 7200 RPM 16MB Samsung 850 EVO 120GB LG RW Noctua NH-D14 
OSMonitorMonitorKeyboard
Windows 7 Ultimate x64 37" FHD TV (Native 1080p) LG 22MP47 1080p - IPS Generic Genius Keyboard 
PowerCaseMouseMouse Pad
SilverStone Strider (SST-ST75F-P) 750W Modular,... Thermaltake SopranoRS (Side Panel Off) Redragon M601 Centrophorus Razer Goliathus Control (M) 
  hide details  
    
CPUMotherboardGraphicsRAM
AMD Phenom II x6 1055T [3.932GHz, 2.56GHz NB] ASUS M4A89GTD PRO/USB3 GTX 960 G1 4GB 1500MHz / 8000MHz (+65mV) Kingston HyperX 2x4 GB @ 1493MHz 8-8-8-27-1T 
Hard DriveHard DriveOptical DriveCooling
WD Caviar Blue 500GB 7200 RPM 16MB Samsung 850 EVO 120GB LG RW Noctua NH-D14 
OSMonitorMonitorKeyboard
Windows 7 Ultimate x64 37" FHD TV (Native 1080p) LG 22MP47 1080p - IPS Generic Genius Keyboard 
PowerCaseMouseMouse Pad
SilverStone Strider (SST-ST75F-P) 750W Modular,... Thermaltake SopranoRS (Side Panel Off) Redragon M601 Centrophorus Razer Goliathus Control (M) 
  hide details  
post #10 of 2682
I am almost suspect of the gains for AMD. They bring up more questions than they answer, at least for myself.

Why are they so massive? Is AMD just that bad at writing drivers for DX 11? Is it intentional? Or does it happen to be that lower level APIs like the particular AMD architecture design? Are the results even valid?
    
CPUMotherboardGraphicsRAM
Intel i7 5820K AsRock Extreme6 X99 Gigabyte GTX 980 Ti Windforce OC 16 GB Corsair Vengeance LPX 
Hard DriveHard DriveCoolingOS
Samsung 840 EVO 250GB - HDD Speed Edtition Samsung SM951 512 GB - I still hate Samsung!  Noctua NHD14 Windows 10 
MonitorMonitorMonitorKeyboard
Achieva Shimian QH270-Lite Overlord Computer Tempest X27OC  Acer Predator XB270HU Filco Majestouch 2 Ninja 
PowerCaseMouseMouse Pad
Seasonic X-1250 Fractal Design R5 Razer Naga Razer Goliathus Alpha 
AudioAudio
AKG K702 65th Anniversary Edition Creative Sound Blaster Zx 
  hide details  
    
CPUMotherboardGraphicsRAM
Intel i7 5820K AsRock Extreme6 X99 Gigabyte GTX 980 Ti Windforce OC 16 GB Corsair Vengeance LPX 
Hard DriveHard DriveCoolingOS
Samsung 840 EVO 250GB - HDD Speed Edtition Samsung SM951 512 GB - I still hate Samsung!  Noctua NHD14 Windows 10 
MonitorMonitorMonitorKeyboard
Achieva Shimian QH270-Lite Overlord Computer Tempest X27OC  Acer Predator XB270HU Filco Majestouch 2 Ninja 
PowerCaseMouseMouse Pad
Seasonic X-1250 Fractal Design R5 Razer Naga Razer Goliathus Alpha 
AudioAudio
AKG K702 65th Anniversary Edition Creative Sound Blaster Zx 
  hide details  
New Posts  All Forums:Forum Nav:
  Return Home
  Back to Forum: Software News
This thread is locked  
Overclock.net › Forums › Industry News › Software News › [Various] Ashes of the Singularity DX12 Benchmarks