[Various] Ashes of the Singularity DX12 Benchmarks - Overclock.net - An Overclocking Community

Forum Jump: 

[Various] Ashes of the Singularity DX12 Benchmarks

Closed Thread
 
Thread Tools
post #1 of 2682 (permalink) Old 08-17-2015, 09:36 AM - Thread Starter
pass the lortabs
 
p4inkill3r's Avatar
 
Join Date: Feb 2014
Location: Rusk, TX
Posts: 4,988
Rep: 513 (Unique: 311)
A relevant blog post from the game's creators,Oxide: The birth of a new API


PCPerspective

ExtremeTech

EuroGamer

Legit Reviews

Computerbase.de



Thanks to @Mahigan for the insights and legwork!

An Oxide rep responds to address the various discrepancies seen in the benchmark:
Quote:
Originally Posted by Kollock View Post

Wow, there are lots of posts here, so I'll only respond to the last one. The interest in this subject is higher then we thought. The primary evolution of the benchmark is for our own internal testing, so it's pretty important that it be representative of the gameplay. To keep things clean, I'm not going to make very many comments on the concept of bias and fairness, as it can completely go down a rat hole.

Certainly I could see how one might see that we are working closer with one hardware vendor then the other, but the numbers don't really bare that out. Since we've started, I think we've had about 3 site visits from NVidia, 3 from AMD, and 2 from Intel ( and 0 from Microsoft, but they never come visit anyone ;(). Nvidia was actually a far more active collaborator over the summer then AMD was, If you judged from email traffic and code-checkins, you'd draw the conclusion we were working closer with Nvidia rather than AMD wink.gif As you've pointed out, there does exist a marketing agreement between Stardock (our publisher) for Ashes with AMD. But this is typical of almost every major PC game I've ever worked on (Civ 5 had a marketing agreement with NVidia, for example). Without getting into the specifics, I believe the primary goal of AMD is to promote D3D12 titles as they have also lined up a few other D3D12 games.

If you use this metric, however, given Nvidia's promotions with Unreal (and integration with Gameworks) you'd have to say that every Unreal game is biased, not to mention virtually every game that's commonly used as a benchmark since most of them have a promotion agreement with someone. Certainly, one might argue that Unreal being an engine with many titles should give it particular weight, and I wouldn't disagree. However, Ashes is not the only game being developed with Nitrous. It is also being used in several additional titles right now, the only announced one being the Star Control reboot. (Which I am super excited about! But that's a completely other topic wink.gif).

Personally, I think one could just as easily make the claim that we were biased toward Nvidia as the only 'vendor' specific code is for Nvidia where we had to shutdown async compute. By vendor specific, I mean a case where we look at the Vendor ID and make changes to our rendering path. Curiously, their driver reported this feature was functional but attempting to use it was an unmitigated disaster in terms of performance and conformance so we shut it down on their hardware. As far as I know, Maxwell doesn't really have Async Compute so I don't know why their driver was trying to expose that. The only other thing that is different between them is that Nvidia does fall into Tier 2 class binding hardware instead of Tier 3 like AMD which requires a little bit more CPU overhead in D3D12, but I don't think it ended up being very significant. This isn't a vendor specific path, as it's responding to capabilities the driver reports.

From our perspective, one of the surprising things about the results is just how good Nvidia's DX11 perf is. But that's a very recent development, with huge CPU perf improvements over the last month. Still, DX12 CPU overhead is still far far better on Nvidia, and we haven't even tuned it as much as DX11. The other surprise is that of the min frame times having the 290X beat out the 980 Ti (as reported on Ars Techinica). Unlike DX11, minimum frame times are mostly an application controlled feature so I was expecting it to be close to identical. This would appear to be GPU side variance, rather then software variance. We'll have to dig into this one.

I suspect that one thing that is helping AMD on GPU performance is D3D12 exposes Async Compute, which D3D11 did not. Ashes uses a modest amount of it, which gave us a noticeable perf improvement. It was mostly opportunistic where we just took a few compute tasks we were already doing and made them asynchronous, Ashes really isn't a poster-child for advanced GCN features.

Our use of Async Compute, however, pales with comparisons to some of the things which the console guys are starting to do. Most of those haven't made their way to the PC yet, but I've heard of developers getting 30% GPU performance by using Async Compute. Too early to tell, of course, but it could end being pretty disruptive in a year or so as these GCN built and optimized engines start coming to the PC. I don't think Unreal titles will show this very much though, so likely we'll have to wait to see. Has anyone profiled Ark yet?

In the end, I think everyone has to give AMD alot of credit for not objecting to our collaborative effort with Nvidia even though the game had a marketing deal with them. They never once complained about it, and it certainly would have been within their right to do so. (Complain, anyway, we would have still done it, wink.gif)

--
P.S. There is no war of words between us and Nvidia. Nvidia made some incorrect statements, and at this point they will not dispute our position if you ask their PR. That is, they are not disputing anything in our blog. I believe the initial confusion was because Nvidia PR was putting pressure on us to disable certain settings in the benchmark, when we refused, I think they took it a little too personally.

p4inkill3r is offline  
Sponsored Links
Advertisement
 
post #2 of 2682 (permalink) Old 08-17-2015, 09:38 AM
New to Overclock.net
 
Redzo's Avatar
 
Join Date: Jun 2015
Location: Tuzla, Bosnia and Herzegovina
Posts: 629
Rep: 41 (Unique: 34)
ExtremeTech FPS charts for DX11 vs DX12, Fury X vs 980Ti.

You could put this link up in the OP as well.

1055T since 2010 typer.gif
My life for the medieval.gif Horde ! medieval.gif
Redzo is offline  
post #3 of 2682 (permalink) Old 08-17-2015, 09:49 AM
New to Overclock.net
 
DampMonkey's Avatar
 
Join Date: Sep 2013
Location: Somewhere in the middla 'murica
Posts: 1,526
Rep: 64 (Unique: 56)
Those gains from the 390x are insane

Function over Form
DampMonkey is offline  
Sponsored Links
Advertisement
 
post #4 of 2682 (permalink) Old 08-17-2015, 09:50 AM
Hardware Rep
 
EVGA-JacobF's Avatar
 
Join Date: Jan 2012
Location: Brea, CA
Posts: 1,899
Rep: 207 (Unique: 159)
I did a quick test with TITANX, results below. DX12 was about 10FPS faster on my test. The performance seems related to number of CPU cores though. Going to do some more testing.

PS: Latest version of PrecisionX has full OSD support tongue.gif



DX12:


DX11:
EVGA-JacobF is offline  
post #5 of 2682 (permalink) Old 08-17-2015, 09:51 AM
New to Overclock.net
 
CasualCat's Avatar
 
Join Date: Jan 2014
Posts: 1,114
Rep: 45 (Unique: 33)
Is there a stand alone benchmark or do you have to buy the game?

edit: thanks JacopF



Prior GPUs (Click to show)
Uknown EVGA card, Uknown VGA card (Possibly ATI VGA Wonder), ATI [email protected], ATI Rage Fury Pro, ATI Radeon 9600 -died, ATI Radeon 9700 Pro -died, ATI Radeon 9800 Pro -died, ATI Radeon X800, ASUS GeForce 9800GTX+, MSI 660Ti Power Edition, ASUS 660Ti DirectCU

Prior CPUs (Click to show)
286?, 486?, (possibly additional CPUs forgotten here), Athlon64 3500+, Athlon64 X2 3800+?, Phenom II X3 720BE (still have not in use), i7 2600K (still have not in use), i7-5820k
CasualCat is offline  
post #6 of 2682 (permalink) Old 08-17-2015, 09:52 AM
New to Overclock.net
 
Ha-Nocri's Avatar
 
Join Date: Jan 2010
Posts: 3,172
Rep: 110 (Unique: 71)
up to more than 2x faster compared to dx11, 390x. Very nice

Ha-Nocri is offline  
post #7 of 2682 (permalink) Old 08-17-2015, 09:57 AM
New to Overclock.net
 
DFroN's Avatar
 
Join Date: Apr 2014
Location: UK
Posts: 433
Rep: 34 (Unique: 28)
Fury X and 980Ti neck and neck in the DX12 scores, compared to the Ti being 1.4x faster at 4K and 1.8x faster at 1080p in DX11.

DFroN is offline  
post #8 of 2682 (permalink) Old 08-17-2015, 10:05 AM
 
Join Date: Jul 2013
Posts: 1,287
Still seems like it relies on strong single core performance. Wonder if that's just the engine?
Robenger is offline  
post #9 of 2682 (permalink) Old 08-17-2015, 10:06 AM
New to Overclock.net
 
Redzo's Avatar
 
Join Date: Jun 2015
Location: Tuzla, Bosnia and Herzegovina
Posts: 629
Rep: 41 (Unique: 34)
Insane gains, I'll tell you that.
This looks promising.

1055T since 2010 typer.gif
My life for the medieval.gif Horde ! medieval.gif
Redzo is offline  
post #10 of 2682 (permalink) Old 08-17-2015, 10:25 AM
You broke it!
 
PostalTwinkie's Avatar
 
Join Date: Apr 2012
Location: U.S.A
Posts: 14,194
Rep: 1090 (Unique: 561)
I am almost suspect of the gains for AMD. They bring up more questions than they answer, at least for myself.

Why are they so massive? Is AMD just that bad at writing drivers for DX 11? Is it intentional? Or does it happen to be that lower level APIs like the particular AMD architecture design? Are the results even valid?
PostalTwinkie is offline  
Closed Thread

Quick Reply
Message:
Options

Register Now

In order to be able to post messages on the Overclock.net - An Overclocking Community forums, you must first register.
Please enter your desired user name, your email address and other required details in the form below.
User Name:
If you do not want to register, fill this field only and the name will be used as user name for your post.
Password
Please enter a password for your user account. Note that passwords are case-sensitive.
Password:
Confirm Password:
Email Address
Please enter a valid email address for yourself.
Email Address:

Log-in



Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Show Printable Version Show Printable Version
Email this Page Email this Page


Forum Jump: 

Posting Rules  
You may post new threads
You may post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off