Overclock.net › Forums › Industry News › Hardware News › [PCPer] Frame Rating Part 3: First Results
New Posts  All Forums:Forum Nav:

[PCPer] Frame Rating Part 3: First Results

post #1 of 294
Thread Starter 
PC Perspective has posted the third in their series of articles detailing their new method of monitoring frame times using custom video capture hardware. This is just a preview to the main article, which initially was posted in their GTX Titan review, but it shows the initial results.
Quote:
If you haven't been following our sequence of stories that investigates a completely new testing methodology we are calling "frame rating", then you are really missing out. (Part 1 is here, part 2 is here.) The basic premise of Frame Rating is that the performance metrics that the industry is gathering using FRAPS are inaccurate in many cases and do not properly reflect the real-world gaming experience the user has.

Because of that, we are working on another method that uses high-end dual-link DVI capture equipment to directly record the raw output from the graphics card with an overlay technology that allows us to measure frame rates as they are presented on the screen, not as they are presented to the FRAPS software sub-system. With these tools we can measure average frame rates, frame times and stutter, all in a way that reflects exactly what the viewer sees from the game.

We aren't ready to show our full sets of results yet (soon!) but the problems lie in that AMD's CrossFire technology shows severe performance degradations when viewed under the Frame Rating microscope that do not show up nearly as dramatically under FRAPS.

Source

For reference, here's Part 1 and Part 2
Edited by Forceman - 2/24/13 at 1:17pm
post #2 of 294
pretty informative read.
looks like AMD CrossfireX is is not worthy of purchase for the forseeable future.
Dream PC
(17 items)
 
Surface Pro 3
(9 items)
 
 
CPUMotherboardGraphicsRAM
INTEL Core i7 6700K ASUS Maximus VIII Hero Z170 MSI Geforce GTX 980 Ti Gaming 6G G.SKILL Ripjaws 4 series 16GB DDR4 3000 
Hard DriveHard DriveCoolingOS
SAMSUNG SM951 NVMe 512GB SAMSUNG 850 EVO 1TB COOLER MASTER Nepton 280L MICROSOFT Windows 10 Pro x64 
MonitorMonitorKeyboardPower
BENQ XL2420TE DELL UltraSharp U2415 WASD V2 custom CORSAIR HX850i 
CaseMouseAudioOther
NZXT H440 white CORSAIR Vengeance M95 CREATIVE Sound Blaster Z CPU Delid 
Other
LED Lighting 
CPUMotherboardGraphicsRAM
Intel Core i5 4300U Microsoft Surface Intel HD Graphics 4400 8 GB DDR3L 
Hard DriveOSKeyboardMouse
256 GB SSD Windows 10 Pro x64 Surface Pro 4 Type Cover with Fingerprint ID Microsoft Arc Mouse Surface Edition 
  hide details  
Reply
Dream PC
(17 items)
 
Surface Pro 3
(9 items)
 
 
CPUMotherboardGraphicsRAM
INTEL Core i7 6700K ASUS Maximus VIII Hero Z170 MSI Geforce GTX 980 Ti Gaming 6G G.SKILL Ripjaws 4 series 16GB DDR4 3000 
Hard DriveHard DriveCoolingOS
SAMSUNG SM951 NVMe 512GB SAMSUNG 850 EVO 1TB COOLER MASTER Nepton 280L MICROSOFT Windows 10 Pro x64 
MonitorMonitorKeyboardPower
BENQ XL2420TE DELL UltraSharp U2415 WASD V2 custom CORSAIR HX850i 
CaseMouseAudioOther
NZXT H440 white CORSAIR Vengeance M95 CREATIVE Sound Blaster Z CPU Delid 
Other
LED Lighting 
CPUMotherboardGraphicsRAM
Intel Core i5 4300U Microsoft Surface Intel HD Graphics 4400 8 GB DDR3L 
Hard DriveOSKeyboardMouse
256 GB SSD Windows 10 Pro x64 Surface Pro 4 Type Cover with Fingerprint ID Microsoft Arc Mouse Surface Edition 
  hide details  
Reply
post #3 of 294
Quote:
Originally Posted by james8 View Post

pretty informative read.
looks like AMD CrossfireX is is not worthy of purchase for the forseeable future.

I'm actually really enjoying 7970 trifire right now.
MEGATRON
(13 items)
 
  
CPUMotherboardGraphicsRAM
Core i7 4710MQ P170-SM-A Nvidia GTX 980M @ 1470mhz 32GB DDR3L 1600mhz 
Hard DriveHard DriveHard DriveOptical Drive
Samsung SSD 840 EVO Msata 250GB SanDisk SDSSDX120GG25 HGST 1TB Blu-Ray 
CoolingOSMonitorKeyboard
OverCharged Cage fans Windows 8.1 + Virtual Machines Modified 1080P glossy IPS 60hz Stock 
Power
240 Watt Brick 
  hide details  
Reply
MEGATRON
(13 items)
 
  
CPUMotherboardGraphicsRAM
Core i7 4710MQ P170-SM-A Nvidia GTX 980M @ 1470mhz 32GB DDR3L 1600mhz 
Hard DriveHard DriveHard DriveOptical Drive
Samsung SSD 840 EVO Msata 250GB SanDisk SDSSDX120GG25 HGST 1TB Blu-Ray 
CoolingOSMonitorKeyboard
OverCharged Cage fans Windows 8.1 + Virtual Machines Modified 1080P glossy IPS 60hz Stock 
Power
240 Watt Brick 
  hide details  
Reply
post #4 of 294
^that's great. but it's known that 3 cards are usually very smooth, comparable to 1 card, for both SLI and CFX
it's the much more popular 2 card solution that is the problem
Dream PC
(17 items)
 
Surface Pro 3
(9 items)
 
 
CPUMotherboardGraphicsRAM
INTEL Core i7 6700K ASUS Maximus VIII Hero Z170 MSI Geforce GTX 980 Ti Gaming 6G G.SKILL Ripjaws 4 series 16GB DDR4 3000 
Hard DriveHard DriveCoolingOS
SAMSUNG SM951 NVMe 512GB SAMSUNG 850 EVO 1TB COOLER MASTER Nepton 280L MICROSOFT Windows 10 Pro x64 
MonitorMonitorKeyboardPower
BENQ XL2420TE DELL UltraSharp U2415 WASD V2 custom CORSAIR HX850i 
CaseMouseAudioOther
NZXT H440 white CORSAIR Vengeance M95 CREATIVE Sound Blaster Z CPU Delid 
Other
LED Lighting 
CPUMotherboardGraphicsRAM
Intel Core i5 4300U Microsoft Surface Intel HD Graphics 4400 8 GB DDR3L 
Hard DriveOSKeyboardMouse
256 GB SSD Windows 10 Pro x64 Surface Pro 4 Type Cover with Fingerprint ID Microsoft Arc Mouse Surface Edition 
  hide details  
Reply
Dream PC
(17 items)
 
Surface Pro 3
(9 items)
 
 
CPUMotherboardGraphicsRAM
INTEL Core i7 6700K ASUS Maximus VIII Hero Z170 MSI Geforce GTX 980 Ti Gaming 6G G.SKILL Ripjaws 4 series 16GB DDR4 3000 
Hard DriveHard DriveCoolingOS
SAMSUNG SM951 NVMe 512GB SAMSUNG 850 EVO 1TB COOLER MASTER Nepton 280L MICROSOFT Windows 10 Pro x64 
MonitorMonitorKeyboardPower
BENQ XL2420TE DELL UltraSharp U2415 WASD V2 custom CORSAIR HX850i 
CaseMouseAudioOther
NZXT H440 white CORSAIR Vengeance M95 CREATIVE Sound Blaster Z CPU Delid 
Other
LED Lighting 
CPUMotherboardGraphicsRAM
Intel Core i5 4300U Microsoft Surface Intel HD Graphics 4400 8 GB DDR3L 
Hard DriveOSKeyboardMouse
256 GB SSD Windows 10 Pro x64 Surface Pro 4 Type Cover with Fingerprint ID Microsoft Arc Mouse Surface Edition 
  hide details  
Reply
post #5 of 294
I dont understand this. What they are saying CF is fake?
Ishimura
(21 items)
 
Silent Knight
(13 items)
 
 
CPUMotherboardGraphicsRAM
Intel Core i7 3770K @ 4.6GHz ASRock Z77E-ITX eVGA GTX 1080 Ti Hybrid AMD Radeon R9 16GB DDR3-2400MHz  
Hard DriveHard DriveCoolingCooling
SanDisk Ultra II 960GB Toshiba X300 5TB Corsair H100i GTX eVGA Hybrid Water Cooler  
CoolingOSMonitorKeyboard
4x GentleTyphoon AP-15 Windows 10 Pro 64-Bit Philips Brilliance BDM4065UC 4K Razer BlackWidow Chroma  
PowerCaseMouseMouse Pad
eVGA SuperNOVA 750 G3 Define Nano S Logitech G502 Proteus Core PECHAM Gaming Mouse Pad XX-Large 
AudioAudioAudioAudio
Audioengine D1 DAC Mackie CR Series CR3 Audio-Technica ATH-M50 Sennheiser HD 598 
Audio
Sony XB950BT 
CPUMotherboardGraphicsRAM
AMD Phenom II X4 955 @ 4.2GHz ASUS M4A79XTD EVO AMD Radeon HD 7970 3GB @ 1200/1500 2x 4GB G.SKILL Ripjaws X DDR3-1600 
Hard DriveHard DriveHard DriveCooling
OCZ Agility 3 60GB WD Caviar Green 1.5TB 2 x Seagate Barracuda 2TB XSPC Raystorm 
CoolingCoolingOSPower
EK-FC7970 XSPC RS360 Windows 10 Pro 64-Bit Corsair TX750 
Case
NZXT Switch 810  
  hide details  
Reply
Ishimura
(21 items)
 
Silent Knight
(13 items)
 
 
CPUMotherboardGraphicsRAM
Intel Core i7 3770K @ 4.6GHz ASRock Z77E-ITX eVGA GTX 1080 Ti Hybrid AMD Radeon R9 16GB DDR3-2400MHz  
Hard DriveHard DriveCoolingCooling
SanDisk Ultra II 960GB Toshiba X300 5TB Corsair H100i GTX eVGA Hybrid Water Cooler  
CoolingOSMonitorKeyboard
4x GentleTyphoon AP-15 Windows 10 Pro 64-Bit Philips Brilliance BDM4065UC 4K Razer BlackWidow Chroma  
PowerCaseMouseMouse Pad
eVGA SuperNOVA 750 G3 Define Nano S Logitech G502 Proteus Core PECHAM Gaming Mouse Pad XX-Large 
AudioAudioAudioAudio
Audioengine D1 DAC Mackie CR Series CR3 Audio-Technica ATH-M50 Sennheiser HD 598 
Audio
Sony XB950BT 
CPUMotherboardGraphicsRAM
AMD Phenom II X4 955 @ 4.2GHz ASUS M4A79XTD EVO AMD Radeon HD 7970 3GB @ 1200/1500 2x 4GB G.SKILL Ripjaws X DDR3-1600 
Hard DriveHard DriveHard DriveCooling
OCZ Agility 3 60GB WD Caviar Green 1.5TB 2 x Seagate Barracuda 2TB XSPC Raystorm 
CoolingCoolingOSPower
EK-FC7970 XSPC RS360 Windows 10 Pro 64-Bit Corsair TX750 
Case
NZXT Switch 810  
  hide details  
Reply
post #6 of 294
This is just getting silly now... how convenient for Nvidia that they test this only when that ridiculously expensive card needs all the justification it can for it's price since it's performance isn't doing any.
Edited by th3illusiveman - 2/22/13 at 10:21pm
Bender
(18 items)
 
  
CPUMotherboardGraphicsGraphics
Core i5-2500k @ 4.6Ghz Gigabyte Z68X-UD3H-B3 Sapphire AMD R9 290X Tri-X (1050/1300mhz)  EVGA GeForce GTX 1080 (How do you OC?) 
RAMHard DriveHard DriveOS
8GB 1600Mhz OCZ Vertex 3 240GB SSD OCZ Vertex 3 240GB SSD windows 10 64bit 
MonitorKeyboardPowerCase
Asus MG279Q Logitech G510  Corsair TX750 CM II 690 Advanced 
MouseMouse PadAudioAudio
CM Sentinel Advance  some big corsair one beyerdynamic DT 770 Pro 250 Ohm SoundBlaster Z Soundcard 
  hide details  
Reply
Bender
(18 items)
 
  
CPUMotherboardGraphicsGraphics
Core i5-2500k @ 4.6Ghz Gigabyte Z68X-UD3H-B3 Sapphire AMD R9 290X Tri-X (1050/1300mhz)  EVGA GeForce GTX 1080 (How do you OC?) 
RAMHard DriveHard DriveOS
8GB 1600Mhz OCZ Vertex 3 240GB SSD OCZ Vertex 3 240GB SSD windows 10 64bit 
MonitorKeyboardPowerCase
Asus MG279Q Logitech G510  Corsair TX750 CM II 690 Advanced 
MouseMouse PadAudioAudio
CM Sentinel Advance  some big corsair one beyerdynamic DT 770 Pro 250 Ohm SoundBlaster Z Soundcard 
  hide details  
Reply
post #7 of 294
Quote:
Originally Posted by james8 View Post

pretty informative read.
looks like AMD CrossfireX is is not worthy of purchase for the forseeable future.

multi gpu setup has never been worth it ever
Ice Wings
(14 items)
 
  
CPUMotherboardGraphicsRAM
i5 3570K @ 4.5GHz Asus Sabertooth Z77 Asus Nvidia Geforce GTX 980 Samsung Green MV-3V4G3D/US 8GB 2x4GB DDR3 1600MHZ 
Hard DriveHard DriveCoolingOS
OCZ Agility 3 240GB  Samsung F4 HD204UI Noctua NH-D14 Windows 10 Pro 64 bit 
MonitorKeyboardPowerCase
Asus RoG Swift PG278Q Ducky One (DKON1687) MX Reds w/ PBT keycaps. SeaSonic X Series X650 Gold Fractal Design Define R4 
MouseMouse Pad
Logitech G303 Puretrak Talent  
  hide details  
Reply
Ice Wings
(14 items)
 
  
CPUMotherboardGraphicsRAM
i5 3570K @ 4.5GHz Asus Sabertooth Z77 Asus Nvidia Geforce GTX 980 Samsung Green MV-3V4G3D/US 8GB 2x4GB DDR3 1600MHZ 
Hard DriveHard DriveCoolingOS
OCZ Agility 3 240GB  Samsung F4 HD204UI Noctua NH-D14 Windows 10 Pro 64 bit 
MonitorKeyboardPowerCase
Asus RoG Swift PG278Q Ducky One (DKON1687) MX Reds w/ PBT keycaps. SeaSonic X Series X650 Gold Fractal Design Define R4 
MouseMouse Pad
Logitech G303 Puretrak Talent  
  hide details  
Reply
post #8 of 294
I'm curious as to how much one would notice the frametimes switching between 5ms and 15ms every other frame and if it actually is an issue or just numbers. Is it really something that can be noticed? Or is it just a graph that makes the AMD cards (especially cfx) look bad.

Good data overall I'm just not certain if it means all that much.
Edited by TwilightEscape - 2/22/13 at 10:27pm
Lawl Mark II
(12 items)
 
  
CPUMotherboardGraphicsRAM
Intel Core i5 @ 5ghz (air) Z77 Extreme6 SLI GTX 660 Ti SC 3GB (1228/1734) Patriot Viper 3 16GB 2133mhz 
Hard DriveCoolingOSKeyboard
OCZ Vertex 3 128GB XIGMATEK Dark Knight II Windows 7 Ultimate Razer Blackwidow Ultimate 
PowerMouseMouse PadAudio
CM Silent Pro 1000W Cyborg RAT 7 Razer Goliathus Xonar DG 
  hide details  
Reply
Lawl Mark II
(12 items)
 
  
CPUMotherboardGraphicsRAM
Intel Core i5 @ 5ghz (air) Z77 Extreme6 SLI GTX 660 Ti SC 3GB (1228/1734) Patriot Viper 3 16GB 2133mhz 
Hard DriveCoolingOSKeyboard
OCZ Vertex 3 128GB XIGMATEK Dark Knight II Windows 7 Ultimate Razer Blackwidow Ultimate 
PowerMouseMouse PadAudio
CM Silent Pro 1000W Cyborg RAT 7 Razer Goliathus Xonar DG 
  hide details  
Reply
post #9 of 294
Quote:
Originally Posted by TwilightEscape View Post

I'm curious as to how much one would notice the frametimes switching between 5ms and 15ms every other frame and if it actually is an issue or just numbers. Is it really something that can be noticed? Or is it just a graph that makes the AMD cards (especially cfx) look bad.

Good data overall I'm just not certain if it means all that much.

Not sure how much credit you can give them considering i have 2 x HD 7970 and id did a Fraps run in MP which is a lot more demanding and important. Frame Times did not look anywhere close to that they are getting.
Ishimura
(21 items)
 
Silent Knight
(13 items)
 
 
CPUMotherboardGraphicsRAM
Intel Core i7 3770K @ 4.6GHz ASRock Z77E-ITX eVGA GTX 1080 Ti Hybrid AMD Radeon R9 16GB DDR3-2400MHz  
Hard DriveHard DriveCoolingCooling
SanDisk Ultra II 960GB Toshiba X300 5TB Corsair H100i GTX eVGA Hybrid Water Cooler  
CoolingOSMonitorKeyboard
4x GentleTyphoon AP-15 Windows 10 Pro 64-Bit Philips Brilliance BDM4065UC 4K Razer BlackWidow Chroma  
PowerCaseMouseMouse Pad
eVGA SuperNOVA 750 G3 Define Nano S Logitech G502 Proteus Core PECHAM Gaming Mouse Pad XX-Large 
AudioAudioAudioAudio
Audioengine D1 DAC Mackie CR Series CR3 Audio-Technica ATH-M50 Sennheiser HD 598 
Audio
Sony XB950BT 
CPUMotherboardGraphicsRAM
AMD Phenom II X4 955 @ 4.2GHz ASUS M4A79XTD EVO AMD Radeon HD 7970 3GB @ 1200/1500 2x 4GB G.SKILL Ripjaws X DDR3-1600 
Hard DriveHard DriveHard DriveCooling
OCZ Agility 3 60GB WD Caviar Green 1.5TB 2 x Seagate Barracuda 2TB XSPC Raystorm 
CoolingCoolingOSPower
EK-FC7970 XSPC RS360 Windows 10 Pro 64-Bit Corsair TX750 
Case
NZXT Switch 810  
  hide details  
Reply
Ishimura
(21 items)
 
Silent Knight
(13 items)
 
 
CPUMotherboardGraphicsRAM
Intel Core i7 3770K @ 4.6GHz ASRock Z77E-ITX eVGA GTX 1080 Ti Hybrid AMD Radeon R9 16GB DDR3-2400MHz  
Hard DriveHard DriveCoolingCooling
SanDisk Ultra II 960GB Toshiba X300 5TB Corsair H100i GTX eVGA Hybrid Water Cooler  
CoolingOSMonitorKeyboard
4x GentleTyphoon AP-15 Windows 10 Pro 64-Bit Philips Brilliance BDM4065UC 4K Razer BlackWidow Chroma  
PowerCaseMouseMouse Pad
eVGA SuperNOVA 750 G3 Define Nano S Logitech G502 Proteus Core PECHAM Gaming Mouse Pad XX-Large 
AudioAudioAudioAudio
Audioengine D1 DAC Mackie CR Series CR3 Audio-Technica ATH-M50 Sennheiser HD 598 
Audio
Sony XB950BT 
CPUMotherboardGraphicsRAM
AMD Phenom II X4 955 @ 4.2GHz ASUS M4A79XTD EVO AMD Radeon HD 7970 3GB @ 1200/1500 2x 4GB G.SKILL Ripjaws X DDR3-1600 
Hard DriveHard DriveHard DriveCooling
OCZ Agility 3 60GB WD Caviar Green 1.5TB 2 x Seagate Barracuda 2TB XSPC Raystorm 
CoolingCoolingOSPower
EK-FC7970 XSPC RS360 Windows 10 Pro 64-Bit Corsair TX750 
Case
NZXT Switch 810  
  hide details  
Reply
post #10 of 294

lol, my monitor just had a period.

@TwilightEscape: as long as the microstutter/fps is above the refresh rate of the monitor, you won't see the latency. 20ms is equivalent of 50fps, and 16.7ms is equivalent of 60fps. This shows the 7970 CF inbetween the two values, so I'd say that the latency would be noticeable, but not as bad as it would be if the fps was lower. Turn on vsync, or use some type of frame limiter, and that should fix that.

EDIT: ZealotKi11er: They use a different method of testing frametime latency that uses some type of card that directly records the latency from a capture card.
Quote:

At the heart of our unique GPU testing method is this card, a high-end dual-link DVI capture card capable of handling 2560x1600 resolutions at 60 Hz. Essentially this card will act as a monitor to our GPU test bed and allow us to capture the actual display output that reaches the gamer's eyes. This method is the best possible way to measure frame rates, frame times, stutter, runts, smoothness, and any other graphics-related metrics.
Source

With that said, pcper should have the most accurate frame-time latency testing setup out there.
Edited by airisom2 - 2/22/13 at 10:35pm
New Posts  All Forums:Forum Nav:
  Return Home
  Back to Forum: Hardware News
Overclock.net › Forums › Industry News › Hardware News › [PCPer] Frame Rating Part 3: First Results