Overclock.net › Forums › Industry News › Hardware News › [THG] Challenging FPS: Testing SLI And CrossFire Using Video Capture
New Posts  All Forums:Forum Nav:

[THG] Challenging FPS: Testing SLI And CrossFire Using Video Capture

post #1 of 86
Thread Starter 
Quote:
What if the performance data you used for deciding which graphics card to buy was flawed? We're taking a deeper look at some of the problems with benchmarking multi-GPU configs using conventional tools. Nvidia's new FCAT suite helps us collect more info.

"You take the red pill - you stay in Wonderland, and I show you how deep the rabbit hole goes."
- Morpheus, The Matrix

SOURCE
loon 3.2
(18 items)
 
  
CPUMotherboardGraphicsRAM
i7-3770K Asus P8Z77-V Pro EVGA 980TI SC+ 16Gb PNY ddr3 1866 
Hard DriveHard DriveHard DriveOptical Drive
PNY 1311 240Gb 1 TB Seagate 3 TB WD Blue DVD DVDRW+/- 
CoolingCoolingOSMonitor
EKWB P280 kit EK-VGA supremacy Win X LG 24MC57HQ-P 
KeyboardPowerCaseMouse
Ducky Zero [blues] EVGA SuperNova 750 G2 Stryker M [hammered and drilled] corsair M65 
AudioAudio
SB Recon3D Klipsch ProMedia 2.1  
  hide details  
Reply
loon 3.2
(18 items)
 
  
CPUMotherboardGraphicsRAM
i7-3770K Asus P8Z77-V Pro EVGA 980TI SC+ 16Gb PNY ddr3 1866 
Hard DriveHard DriveHard DriveOptical Drive
PNY 1311 240Gb 1 TB Seagate 3 TB WD Blue DVD DVDRW+/- 
CoolingCoolingOSMonitor
EKWB P280 kit EK-VGA supremacy Win X LG 24MC57HQ-P 
KeyboardPowerCaseMouse
Ducky Zero [blues] EVGA SuperNova 750 G2 Stryker M [hammered and drilled] corsair M65 
AudioAudio
SB Recon3D Klipsch ProMedia 2.1  
  hide details  
Reply
post #2 of 86
Props to TR for bringing these issues to light. I still remember a lot of AMD fans blasting TR for "making stuff up", and calling it a "myth" or non-existent issue.










Quote:
As we expected, both from The Tech Report's background with this and Nvidia's in-house examples, we see that AMD's Radeon HD 7870s in CrossFire tend to suffer more dropped and runt frames than a pair of GeForce GTX 660 Tis in SLI. This addresses much of the trepidation about multi-card configurations expressed in Best Graphics Cards for the Money, confirming that two of Nvidia's boards appear more appealing. AMD even admits it's playing catch-up in this area, and is addressing its shortcomings through successive driver improvements.

In any case, it's telling that Nvidia put in all of this effort to quantifying graphics performance in a scientifically sound way. The company deserves credit for putting resources into something we wouldn't have been able to develop on our own, even if its motivation wasn't altruistic. The fact is that FCAT gives us a tool for evaluating something we couldn't accurately measure before. We now have two Tom's Hardware labs enabled with the hardware and software to run tests using FCAT, and we're already in the process of testing for a much more comprehensive Part 2.

If you look at FPS alone, you never see the bigger picture.


Edited by 2010rig - 3/27/13 at 9:05am
2010rig
(14 items)
 
Galaxy S3
(8 items)
 
 
CPUMotherboardGraphicsRAM
X5660 @ 4.5  ASUS P6X58D-E 980TI? 12GB OCZ Platinum - 7-7-7-21 
Hard DriveCoolingOSMonitor
1 80GB SSD x25m - 3TB F3 + F4 NH-D14 Windows 7 Ultimate LG 47LH55 
KeyboardPowerCaseMouse
Natural Wireless Keyboard Corsair 750HX CM 690 II Advanced MX 518 
CPUGraphicsRAMHard Drive
Snapdragon S4 Dual core 1500mhz Adreno 225 Samsung 2GB 16GB Onboard Flash 
OSMonitorPowerCase
Android 4.4.2 - CM11 4.8" AMOLED 1280x720 2100 mAh battery Otterbox Defender 
  hide details  
Reply
2010rig
(14 items)
 
Galaxy S3
(8 items)
 
 
CPUMotherboardGraphicsRAM
X5660 @ 4.5  ASUS P6X58D-E 980TI? 12GB OCZ Platinum - 7-7-7-21 
Hard DriveCoolingOSMonitor
1 80GB SSD x25m - 3TB F3 + F4 NH-D14 Windows 7 Ultimate LG 47LH55 
KeyboardPowerCaseMouse
Natural Wireless Keyboard Corsair 750HX CM 690 II Advanced MX 518 
CPUGraphicsRAMHard Drive
Snapdragon S4 Dual core 1500mhz Adreno 225 Samsung 2GB 16GB Onboard Flash 
OSMonitorPowerCase
Android 4.4.2 - CM11 4.8" AMOLED 1280x720 2100 mAh battery Otterbox Defender 
  hide details  
Reply
post #3 of 86
TR, yes. But I trust Tom's Hardware about as far as I can throw them.


Looks interesting, possibly legit, but I've read far too many flawed/bogus articles from them.
Bruce
(20 items)
 
  
CPUMotherboardGraphicsRAM
4670k Asus Z87 Pro HIS 7950 IceQ X2 2x2gb + 2x4gb DDR3 1333 
Hard DriveHard DriveHard DriveOptical Drive
Seagate 1TB 7200RPM OCZ Agility 4 128GB PNY 240GB LG Blu Ray Burner 
CoolingOSMonitorKeyboard
Hyper 212+ with extra fan Windows 10 Education x64 Shimian QH270 @110hz Medieval Dell OEM Keyboard 
PowerCaseMouseAudio
Corsair TX750 V1 Antec 300 Black Illusion  Logitech G400s Xonar ST 
AudioOtherOtherOther
Fostex T50rp with BMF mod Archer T9E Wifi adapter 2x Yate Loon D12SL-12D 120x38mm fans Thermalright TY-143 fan 
  hide details  
Reply
Bruce
(20 items)
 
  
CPUMotherboardGraphicsRAM
4670k Asus Z87 Pro HIS 7950 IceQ X2 2x2gb + 2x4gb DDR3 1333 
Hard DriveHard DriveHard DriveOptical Drive
Seagate 1TB 7200RPM OCZ Agility 4 128GB PNY 240GB LG Blu Ray Burner 
CoolingOSMonitorKeyboard
Hyper 212+ with extra fan Windows 10 Education x64 Shimian QH270 @110hz Medieval Dell OEM Keyboard 
PowerCaseMouseAudio
Corsair TX750 V1 Antec 300 Black Illusion  Logitech G400s Xonar ST 
AudioOtherOtherOther
Fostex T50rp with BMF mod Archer T9E Wifi adapter 2x Yate Loon D12SL-12D 120x38mm fans Thermalright TY-143 fan 
  hide details  
Reply
post #4 of 86
its a solid article, though it will prove nothing in the end because it's using a nvidia benchmark. even if it's a 100% on the level benchmark, no one will trust it.
 
Deep-6
(14 items)
 
 
CPUMotherboardGraphicsRAM
Core I5-4690K Asus Maximus VI Gene MSI GAMING 4G GTX 970 gskill sniper 
Hard DriveHard DriveCoolingOS
Samsung 850 evo  Samsung 850 evo Thermalright HR-02 Macho Rev.B Windows 10 Pro 
MonitorKeyboardPowerCase
Acer K242hl Corsair Raptor K30 Seasonic X-650 Fractal Design Arc Mini R2 
MouseAudio
Logitech MX518 Sennheiser - MOMENTUM Over-the-Ear Headphones 
  hide details  
Reply
 
Deep-6
(14 items)
 
 
CPUMotherboardGraphicsRAM
Core I5-4690K Asus Maximus VI Gene MSI GAMING 4G GTX 970 gskill sniper 
Hard DriveHard DriveCoolingOS
Samsung 850 evo  Samsung 850 evo Thermalright HR-02 Macho Rev.B Windows 10 Pro 
MonitorKeyboardPowerCase
Acer K242hl Corsair Raptor K30 Seasonic X-650 Fractal Design Arc Mini R2 
MouseAudio
Logitech MX518 Sennheiser - MOMENTUM Over-the-Ear Headphones 
  hide details  
Reply
post #5 of 86
Quote:
Originally Posted by brucethemoose View Post

TR, yes. But I trust Tom's Hardware about as far as I can throw them.


Looks interesting, possibly legit, but I've read far too many flawed/bogus articles from them.

Quote:
Originally Posted by azanimefan View Post

its a solid article, though it will prove nothing in the end because it's using a nvidia benchmark. even if it's a 100% on the level benchmark, no one will trust it.

No matter, it is the truth. AMD has a lot of catching up to do.
Super P's rig
(21 items)
 
  
CPUMotherboardGraphicsRAM
i7-6800K @ 4.4GHZ 1.37v / 3.6GHZ Cache 1.2v ASUS X99-A II Zotac GTX 1070FE @ 2088/9216 Corsair Vengeance DDR4 3000 
Hard DriveHard DriveHard DriveOptical Drive
MyDigitalSSD BPX NVMe Samsung 850 EVO Seagate Momentus XT 500 GB External DVDRW 
CoolingCoolingCoolingOS
EK-XLC Predator 240 GTX 1070 XSPC Full Cover Blade Swiftech 240mm Radiator Windows 10 
MonitorKeyboardPowerCase
Samsung 40" 4K - UN40KU6290 G710+ EVGA SuperNOVA 850G2 Fractal Design Define S 
MouseMouse PadAudioAudio
G700s Vipamz Extended XXXL Asus U7 M-Audio AV40 
Audio
Sennheiser HD 439 
  hide details  
Reply
Super P's rig
(21 items)
 
  
CPUMotherboardGraphicsRAM
i7-6800K @ 4.4GHZ 1.37v / 3.6GHZ Cache 1.2v ASUS X99-A II Zotac GTX 1070FE @ 2088/9216 Corsair Vengeance DDR4 3000 
Hard DriveHard DriveHard DriveOptical Drive
MyDigitalSSD BPX NVMe Samsung 850 EVO Seagate Momentus XT 500 GB External DVDRW 
CoolingCoolingCoolingOS
EK-XLC Predator 240 GTX 1070 XSPC Full Cover Blade Swiftech 240mm Radiator Windows 10 
MonitorKeyboardPowerCase
Samsung 40" 4K - UN40KU6290 G710+ EVGA SuperNOVA 850G2 Fractal Design Define S 
MouseMouse PadAudioAudio
G700s Vipamz Extended XXXL Asus U7 M-Audio AV40 
Audio
Sennheiser HD 439 
  hide details  
Reply
post #6 of 86
Quote:
Originally Posted by criminal View Post


No matter, it is the truth. AMD has a lot of catching up to do.

If there's even a slightest reason to discredit something, people will find it.

When TR reported it, there were people that called it a "conspiracy". Too much to quote here.
http://www.overclock.net/t/1337751/tr-geforce-versus-radeon-captured-on-high-speed-video/

I don't know why people make excuses for AMD all the time, if it wasn't for these reports, and AMD being forced to acknowledge the issues, they wouldn't be getting a smoother gaming experience in the end.
http://www.anandtech.com/show/6857/amd-stuttering-issues-driver-roadmap-fraps
Edited by 2010rig - 3/27/13 at 9:38am
2010rig
(14 items)
 
Galaxy S3
(8 items)
 
 
CPUMotherboardGraphicsRAM
X5660 @ 4.5  ASUS P6X58D-E 980TI? 12GB OCZ Platinum - 7-7-7-21 
Hard DriveCoolingOSMonitor
1 80GB SSD x25m - 3TB F3 + F4 NH-D14 Windows 7 Ultimate LG 47LH55 
KeyboardPowerCaseMouse
Natural Wireless Keyboard Corsair 750HX CM 690 II Advanced MX 518 
CPUGraphicsRAMHard Drive
Snapdragon S4 Dual core 1500mhz Adreno 225 Samsung 2GB 16GB Onboard Flash 
OSMonitorPowerCase
Android 4.4.2 - CM11 4.8" AMOLED 1280x720 2100 mAh battery Otterbox Defender 
  hide details  
Reply
2010rig
(14 items)
 
Galaxy S3
(8 items)
 
 
CPUMotherboardGraphicsRAM
X5660 @ 4.5  ASUS P6X58D-E 980TI? 12GB OCZ Platinum - 7-7-7-21 
Hard DriveCoolingOSMonitor
1 80GB SSD x25m - 3TB F3 + F4 NH-D14 Windows 7 Ultimate LG 47LH55 
KeyboardPowerCaseMouse
Natural Wireless Keyboard Corsair 750HX CM 690 II Advanced MX 518 
CPUGraphicsRAMHard Drive
Snapdragon S4 Dual core 1500mhz Adreno 225 Samsung 2GB 16GB Onboard Flash 
OSMonitorPowerCase
Android 4.4.2 - CM11 4.8" AMOLED 1280x720 2100 mAh battery Otterbox Defender 
  hide details  
Reply
post #7 of 86
Quote:
Originally Posted by criminal View Post


No matter, it is the truth. AMD has a lot of catching up to do.

I love tom's... it gave me an advanced degree in computers back in the late 90s... how to build them, what parts work together... so on and so forth... yet in the last 5-8 years they've grown fairly unreliable.

I appreciate you like team green, and want this to be 100% fact for some reason... but for those of us without a horse in this race (i actually am currently using an nvidia gpu, and have owned radeon gpus as well) this remains an equivocal article. not fact. Highlighted by the fact the reviewer himself couldn't tell the difference between the two setups excepting in 2 of the 9 tests, one he felt the nvidia was choppier and the other he felt the radeon was.

by almost all anecdotal evidence SLi is smoother then XFire, however we still don't have a benchmark that validates this user experience. The benchmark in this article doesn't even do that. So this isn't a holy grail benchmark that will give us an accurate "user experience" number; from what i've seen this is an immature benchmark with a lot of problems that need ironing out, which is a step in the right direction for providing such an all encompassing "user experience" index.

Its a nice article, but it gives us little solid trustworthy information to use in future purchasing decisions
 
Deep-6
(14 items)
 
 
CPUMotherboardGraphicsRAM
Core I5-4690K Asus Maximus VI Gene MSI GAMING 4G GTX 970 gskill sniper 
Hard DriveHard DriveCoolingOS
Samsung 850 evo  Samsung 850 evo Thermalright HR-02 Macho Rev.B Windows 10 Pro 
MonitorKeyboardPowerCase
Acer K242hl Corsair Raptor K30 Seasonic X-650 Fractal Design Arc Mini R2 
MouseAudio
Logitech MX518 Sennheiser - MOMENTUM Over-the-Ear Headphones 
  hide details  
Reply
 
Deep-6
(14 items)
 
 
CPUMotherboardGraphicsRAM
Core I5-4690K Asus Maximus VI Gene MSI GAMING 4G GTX 970 gskill sniper 
Hard DriveHard DriveCoolingOS
Samsung 850 evo  Samsung 850 evo Thermalright HR-02 Macho Rev.B Windows 10 Pro 
MonitorKeyboardPowerCase
Acer K242hl Corsair Raptor K30 Seasonic X-650 Fractal Design Arc Mini R2 
MouseAudio
Logitech MX518 Sennheiser - MOMENTUM Over-the-Ear Headphones 
  hide details  
Reply
post #8 of 86
Wow I hope we start to see performance results from more reviewers with Practical FPS instead of a FRAPS reading. The frames are pointless unless the end user can see them.
 
Test Rig
(14 items)
 
 
CPUMotherboardGraphicsRAM
Q6600 ASUS P5N-T EVGA GT 430 Patriot PDC24G6400ELK 
Hard DriveOptical DriveCoolingCooling
Western Digital Caviar Blue 1 TB LG Blu Ray/HD DVD Enzotech SCW-REV.A Swiftech MCR320-QP-K x2 
OSMonitorKeyboardPower
Windows7 Proffesional 64bit Acer 23" LCD Logitech G15 Corsair GS600 
CaseMouse
NZXT Phantom White Custom Mods Logitech G5 
CPUMotherboardGraphicsRAM
2500K ASUS P8P67 EVO Calibre GTX 480 Corsair Vengence 
Hard DriveOptical DriveCoolingOS
Vertex 2 LG DVD What ever is being tested Windows 7 professional 64bit 
MonitorKeyboardPowerCase
Acer 23" Generic High Power Astro PT 700w Antec 900/TBD 
MouseMouse Pad
ooold Microsoft POS Wood 
CPUMotherboardGraphicsRAM
3770K Gigabyte G1.Sniper 3 SLI GTX Titans Samsung Green 30nm 16GB 
Hard DriveHard DriveCoolingOS
Vertex 3 240GB raid0 WD Caviar Black 1TB Dual Loop Water Cooling Windows7 
MonitorMonitorKeyboardPower
Achieva Shimian 27" 1440p Acer 23" 1080p Razer Blackwidow Ultimate Mech Enermax Max Revo 1350 
CaseMouseMouse PadAudio
Enermax Fulmo GT Razer Naga EVGA Titan pad Logitec 5.1 
  hide details  
Reply
 
Test Rig
(14 items)
 
 
CPUMotherboardGraphicsRAM
Q6600 ASUS P5N-T EVGA GT 430 Patriot PDC24G6400ELK 
Hard DriveOptical DriveCoolingCooling
Western Digital Caviar Blue 1 TB LG Blu Ray/HD DVD Enzotech SCW-REV.A Swiftech MCR320-QP-K x2 
OSMonitorKeyboardPower
Windows7 Proffesional 64bit Acer 23" LCD Logitech G15 Corsair GS600 
CaseMouse
NZXT Phantom White Custom Mods Logitech G5 
CPUMotherboardGraphicsRAM
2500K ASUS P8P67 EVO Calibre GTX 480 Corsair Vengence 
Hard DriveOptical DriveCoolingOS
Vertex 2 LG DVD What ever is being tested Windows 7 professional 64bit 
MonitorKeyboardPowerCase
Acer 23" Generic High Power Astro PT 700w Antec 900/TBD 
MouseMouse Pad
ooold Microsoft POS Wood 
CPUMotherboardGraphicsRAM
3770K Gigabyte G1.Sniper 3 SLI GTX Titans Samsung Green 30nm 16GB 
Hard DriveHard DriveCoolingOS
Vertex 3 240GB raid0 WD Caviar Black 1TB Dual Loop Water Cooling Windows7 
MonitorMonitorKeyboardPower
Achieva Shimian 27" 1440p Acer 23" 1080p Razer Blackwidow Ultimate Mech Enermax Max Revo 1350 
CaseMouseMouse PadAudio
Enermax Fulmo GT Razer Naga EVGA Titan pad Logitec 5.1 
  hide details  
Reply
post #9 of 86
Thread Starter 
Quote:
Originally Posted by azanimefan View Post

its a solid article, though it will prove nothing in the end because it's using a nvidia benchmark. even if it's a 100% on the level benchmark, no one will trust it.

thats a rather sweeping generalization. if you didn't read this yesterday, you may find it rather informative.
AMD Comments on GPU Stuttering, Offers Driver Roadmap & Perspective on Benchmarking

actually there is a thread over here:
http://www.overclock.net/t/1375220/anand-amd-comments-on-gpu-stuttering-offers-driver-roadmap-perspective-on-benchmarking/0_50

read where nvidia had already knew about problems with multi card setups and was able to optimize their drivers while AMD was in the dark. then maybe you'll consider this as nvidia letting the cat out of the bag and wouldn't look good if they didn't share their technology.
loon 3.2
(18 items)
 
  
CPUMotherboardGraphicsRAM
i7-3770K Asus P8Z77-V Pro EVGA 980TI SC+ 16Gb PNY ddr3 1866 
Hard DriveHard DriveHard DriveOptical Drive
PNY 1311 240Gb 1 TB Seagate 3 TB WD Blue DVD DVDRW+/- 
CoolingCoolingOSMonitor
EKWB P280 kit EK-VGA supremacy Win X LG 24MC57HQ-P 
KeyboardPowerCaseMouse
Ducky Zero [blues] EVGA SuperNova 750 G2 Stryker M [hammered and drilled] corsair M65 
AudioAudio
SB Recon3D Klipsch ProMedia 2.1  
  hide details  
Reply
loon 3.2
(18 items)
 
  
CPUMotherboardGraphicsRAM
i7-3770K Asus P8Z77-V Pro EVGA 980TI SC+ 16Gb PNY ddr3 1866 
Hard DriveHard DriveHard DriveOptical Drive
PNY 1311 240Gb 1 TB Seagate 3 TB WD Blue DVD DVDRW+/- 
CoolingCoolingOSMonitor
EKWB P280 kit EK-VGA supremacy Win X LG 24MC57HQ-P 
KeyboardPowerCaseMouse
Ducky Zero [blues] EVGA SuperNova 750 G2 Stryker M [hammered and drilled] corsair M65 
AudioAudio
SB Recon3D Klipsch ProMedia 2.1  
  hide details  
Reply
post #10 of 86
Quote:
Originally Posted by azanimefan View Post

its a solid article, though it will prove nothing in the end because it's using a nvidia benchmark. even if it's a 100% on the level benchmark, no one will trust it.

not sure what you mean by this? If anything, AMD should have the biggest advantage in the tombraider benchmark
Main Rig
(13 items)
 
Secondary Rig
(15 items)
 
 
CPUMotherboardGraphicsGraphics
i7 3770k MSI Z77A-GD65 Gigabyte 780 OC Gigabyte 780 OC 
RAMHard DriveHard DriveOptical Drive
Ripjaw  Samsung F3  Samsung 830  Asus CD-Rom 
CoolingMonitorMonitorPower
Cooler master hyper 212+  Asus  27in 1440p Auria EQ276W 760 Watt Silencer 
Case
Haf 912 
CPUMotherboardGraphicsGraphics
i7 3770k ASRock Z77 Pro4-M 290 XFX DD R9 280X Gigabyte 
GraphicsGraphicsRAMHard Drive
R9 280X MSI Gaming R9 280X Power Cooler Crucial Ballistix  Samsung 830 series 
Hard DriveOptical DriveOSMonitor
WD Black Asus 24x Windows 7 Asus 24in  
MonitorPowerCase
27in 1440p Auria CM 750 600T 
  hide details  
Reply
Main Rig
(13 items)
 
Secondary Rig
(15 items)
 
 
CPUMotherboardGraphicsGraphics
i7 3770k MSI Z77A-GD65 Gigabyte 780 OC Gigabyte 780 OC 
RAMHard DriveHard DriveOptical Drive
Ripjaw  Samsung F3  Samsung 830  Asus CD-Rom 
CoolingMonitorMonitorPower
Cooler master hyper 212+  Asus  27in 1440p Auria EQ276W 760 Watt Silencer 
Case
Haf 912 
CPUMotherboardGraphicsGraphics
i7 3770k ASRock Z77 Pro4-M 290 XFX DD R9 280X Gigabyte 
GraphicsGraphicsRAMHard Drive
R9 280X MSI Gaming R9 280X Power Cooler Crucial Ballistix  Samsung 830 series 
Hard DriveOptical DriveOSMonitor
WD Black Asus 24x Windows 7 Asus 24in  
MonitorPowerCase
27in 1440p Auria CM 750 600T 
  hide details  
Reply
New Posts  All Forums:Forum Nav:
  Return Home
  Back to Forum: Hardware News
Overclock.net › Forums › Industry News › Hardware News › [THG] Challenging FPS: Testing SLI And CrossFire Using Video Capture