Overclock.net › Forums › Benchmarks › Benchmarking Software and Discussion › Benchmarks without minimum and maximum fps are useless for RTS
New Posts  All Forums:Forum Nav:

Benchmarks without minimum and maximum fps are useless for RTS

post #1 of 5
Thread Starter 
In a typical Crysis game my signature rig averaged 31fps (high quality, 1920x1200), with a range of 23fps to 48fps. In starcraft 2 (same resolution, graphics on "high", 2 notches down from ultra or extreme) fps averages 46, with a range of 6 to 99. 6 as in SIX.

For a competitive gamer, the primary benchmark should be minimum frames per second (since that is often when executing the maximum and most critical actions per second). Although sc2 will most-of-the-time look smoother than Crysis (because Crysis needs better hardware for the same average fps), I submit that starcraft 2 has higher hardware demands than Crysis. I suspect, but have not tested, that larger fps variance also applies to games like world of warcraft.

For reference I tested the same replay in sc2 on low and extreme graphics settings
Low: avg 88, low 19, high 165
Extreme: avg 36, low 6, high 74

I play Crysis rarely, finished the last sc2 season in grandmaster league.
Edited by avaya - 8/9/11 at 9:27am
Fanless Gaming PC
(12 items)
 
  
CPUMotherboardRAMHard Drive
i7 920 @ 3ghz Rampage II Gene mATX 4gb @ 1600mhz 80gb Intel ssd 
OSMonitorPowerCase
Windows 7 1600x1200 Nexus 850 Watt (disabled fan) p180 mini 
  hide details  
Reply
Fanless Gaming PC
(12 items)
 
  
CPUMotherboardRAMHard Drive
i7 920 @ 3ghz Rampage II Gene mATX 4gb @ 1600mhz 80gb Intel ssd 
OSMonitorPowerCase
Windows 7 1600x1200 Nexus 850 Watt (disabled fan) p180 mini 
  hide details  
Reply
post #2 of 5
Starcraft II is just more CPU dependent, as is WoW.

lUFAJ.png
Eff You Intel
(14 items)
 
FreeNAS
(9 items)
 
Beast
(14 items)
 
CPUMotherboardGraphicsRAM
AMD Ryzen 7 1700X AsRock X370 Taichi Sapphire R9 Fury Tri-X OC F4-3200C14D-32GTZR 
Hard DriveOptical DriveCoolingOS
Plextor M8Se(G) 1TB People still use these? lol Cryorig H7 Winblows 10 Professional X64 
MonitorKeyboardPowerCase
Pixio PX277 Logitech G510 Seasonic SS-860XP2 Fractal Design Define C TG 
MouseMouse Pad
Logitech G500 Xtrac Ripper 
CPUMotherboardGraphicsRAM
Intel Xeon E3-1245 v5 SuperMicro X11SSM-F-O C236 Integrated 2 x 16GB Kingston ValueRAM ECC KVR21E15D8/16 
Hard DriveCoolingOSPower
5 x 8TB Seagate IronWolf Pro in ZF2 Array CoolerMaster Hyper 212 Evo FreeNAS 11 EVGA SuperNOVA G2 550W Gold 
Case
Fractal Design Node 804 
CPUMotherboardGraphicsRAM
i7 4790k Asus Z97 Pro WIFI-AC Sapphire Nitro Radeon R9 Fury Tri-X OC+  G.Skill 4 x 8GB F3-2133C9D-16GXH 
Hard DriveOptical DriveCoolingOS
2 x Intel 730 480GB SSD in RAID 0 Asus DRW-24B1ST/BLK/B/AS Noctua NH-D15 Winblows 10 Pro x64 
MonitorKeyboardPowerCase
Pixio PX277 Logitech G510 Seasonic SS-660XP2 Fractal Design R4 Blackout 
MouseMouse Pad
Logitech G500 Xtrac Ripper 
  hide details  
Reply
Eff You Intel
(14 items)
 
FreeNAS
(9 items)
 
Beast
(14 items)
 
CPUMotherboardGraphicsRAM
AMD Ryzen 7 1700X AsRock X370 Taichi Sapphire R9 Fury Tri-X OC F4-3200C14D-32GTZR 
Hard DriveOptical DriveCoolingOS
Plextor M8Se(G) 1TB People still use these? lol Cryorig H7 Winblows 10 Professional X64 
MonitorKeyboardPowerCase
Pixio PX277 Logitech G510 Seasonic SS-860XP2 Fractal Design Define C TG 
MouseMouse Pad
Logitech G500 Xtrac Ripper 
CPUMotherboardGraphicsRAM
Intel Xeon E3-1245 v5 SuperMicro X11SSM-F-O C236 Integrated 2 x 16GB Kingston ValueRAM ECC KVR21E15D8/16 
Hard DriveCoolingOSPower
5 x 8TB Seagate IronWolf Pro in ZF2 Array CoolerMaster Hyper 212 Evo FreeNAS 11 EVGA SuperNOVA G2 550W Gold 
Case
Fractal Design Node 804 
CPUMotherboardGraphicsRAM
i7 4790k Asus Z97 Pro WIFI-AC Sapphire Nitro Radeon R9 Fury Tri-X OC+  G.Skill 4 x 8GB F3-2133C9D-16GXH 
Hard DriveOptical DriveCoolingOS
2 x Intel 730 480GB SSD in RAID 0 Asus DRW-24B1ST/BLK/B/AS Noctua NH-D15 Winblows 10 Pro x64 
MonitorKeyboardPowerCase
Pixio PX277 Logitech G510 Seasonic SS-660XP2 Fractal Design R4 Blackout 
MouseMouse Pad
Logitech G500 Xtrac Ripper 
  hide details  
Reply
post #3 of 5
Quote:
Originally Posted by avaya;14519885 
In a typical Crysis game my signature rig averaged 31fps (high quality, 1920x1200), with a range of 23fps to 48fps. In starcraft 2 (same resolution, graphics on "high", 2 notches down from ultra or extreme) fps averages 46, with a range of 6 to 99. 6 as in SIX.

For a competitive gamer, the primary benchmark should be minimum frames per second (since that is often when executing the maximum and most critical actions per second). Although sc2 will most-of-the-time look smoother than Crysis (because Crysis needs better hardware for the same average fps), I submit that starcraft 2 has higher hardware demands than Crysis. I suspect, but have not tested, that larger fps variance also applies to games like world of warcraft.

For reference I tested the same replay in sc2 on low and extreme graphics settings
Low: avg 88, low 19, high 165
Extreme: avg 36, low 6, high 74

I play Crysis rarely, finished the last sc2 season in grandmaster league.

Having a minimum fps as your "primary" benchmark is simply not realistic. While I agree a good benchmark should show lows, highs, and averages. Simply showing your lowest fps does you no good as it could be a spike, where the rest of the time FPS was in the upper 90s. How does that signify the performance off the rig focusing on the frame rate at one given instant?

Metro2033 / FarCry 2 have a good way of displaying results by graphs, letting you know exactly where it struggles.
Snowdevil
(16 items)
 
ASUS G750JM
(9 items)
 
 
CPUMotherboardGraphicsGraphics
[i7 4790K @ 4.4 GHz (1.186v)] [Asus Sabertooth Z97 Mark S] [nVidia Geforce GTX 1080] [nVidia Geforce GTX 1080] 
RAMHard DriveCoolingOS
[G.Skill 32GB DDR3 2133 MHz] [Crucial MX100 256GB] [Phanteks PH-TC12DX] [Win 10.1 Pro] 
MonitorMonitorKeyboardPower
[LG 29UM65 (2560x1080)] [QNIX Evo II LED (2560x1440)] [WASD v2 Tenkeyless] [NZXT Hale90 v2 ] 
CaseMouseMouse PadAudio
[ThermalTake GT10 Snow Edition] [Razer Mamba - Chroma] [Razer Kabuto] [Razer Man O' War] 
CPUMotherboardGraphicsRAM
i7 4770HQ Intel HM87 Express Chipset Geforce GTX 860M 8GB DDR3L 1600 MHz 
Hard DriveOptical DriveCoolingOS
Samsung SSD EVO DVD-RW Stock Windows 8.1 
Monitor
1920x1080 TN 
  hide details  
Reply
Snowdevil
(16 items)
 
ASUS G750JM
(9 items)
 
 
CPUMotherboardGraphicsGraphics
[i7 4790K @ 4.4 GHz (1.186v)] [Asus Sabertooth Z97 Mark S] [nVidia Geforce GTX 1080] [nVidia Geforce GTX 1080] 
RAMHard DriveCoolingOS
[G.Skill 32GB DDR3 2133 MHz] [Crucial MX100 256GB] [Phanteks PH-TC12DX] [Win 10.1 Pro] 
MonitorMonitorKeyboardPower
[LG 29UM65 (2560x1080)] [QNIX Evo II LED (2560x1440)] [WASD v2 Tenkeyless] [NZXT Hale90 v2 ] 
CaseMouseMouse PadAudio
[ThermalTake GT10 Snow Edition] [Razer Mamba - Chroma] [Razer Kabuto] [Razer Man O' War] 
CPUMotherboardGraphicsRAM
i7 4770HQ Intel HM87 Express Chipset Geforce GTX 860M 8GB DDR3L 1600 MHz 
Hard DriveOptical DriveCoolingOS
Samsung SSD EVO DVD-RW Stock Windows 8.1 
Monitor
1920x1080 TN 
  hide details  
Reply
post #4 of 5
Metro 2033's benchmark pulls random numbers from no where for min and max.

Best to fraps standardized benchmarks imo.
    
CPUMotherboardGraphicsGraphics
Intel Core i5 2500K P8P67 PRO NVIDIA GeForce GTX 470 NVIDIA GeForce GTX 470 
GraphicsRAMRAMRAM
NVIDIA GeForce 9800 GT G-Skill A-Data G-Skill 
RAMHard DriveOptical DriveOS
A-Data Crucial M4 64GB + 1TB F3 Spinpoint $155 LS/DL DVD RW $?? Windows 8 64-bit "Epic Registry" Edition 
MonitorPowerCase
ASUS 21.5 1920x1080 2ms $135 CORSAIR HX850 $120 Mother Earth $free 
  hide details  
Reply
    
CPUMotherboardGraphicsGraphics
Intel Core i5 2500K P8P67 PRO NVIDIA GeForce GTX 470 NVIDIA GeForce GTX 470 
GraphicsRAMRAMRAM
NVIDIA GeForce 9800 GT G-Skill A-Data G-Skill 
RAMHard DriveOptical DriveOS
A-Data Crucial M4 64GB + 1TB F3 Spinpoint $155 LS/DL DVD RW $?? Windows 8 64-bit "Epic Registry" Edition 
MonitorPowerCase
ASUS 21.5 1920x1080 2ms $135 CORSAIR HX850 $120 Mother Earth $free 
  hide details  
Reply
post #5 of 5
Quote:
Originally Posted by RagingCain View Post


Having a minimum fps as your "primary" benchmark is simply not realistic. While I agree a good benchmark should show lows, highs, and averages. Simply showing your lowest fps does you no good as it could be a spike, where the rest of the time FPS was in the upper 90s. How does that signify the performance off the rig focusing on the frame rate at one given instant?

Metro2033 / FarCry 2 have a good way of displaying results by graphs, letting you know exactly where it struggles.


Hi RagingCain,


Considering that avaya is a SC2 GrandMaster, I agree the MinFPS issue: in a SC2 huge battle, a bad MinFPS difficults your units micromanagement, what is fatal.

avaya: I'm testing SC2 in my new PC. Would you be so kind of sharing your hardware results? I'm a Platinum (1vs1) player and I'm a little bit concerned about my PC performance in some 2vs2 battles:

--
i5 2500K (not OC)
ASUS Maximus IV Gene-Z (Z68)
16Gb (1600) Corsair RAM
ASUS DCUII 6950 2Gb (today with 1536 Shaders)
128Gb Corsair Force GT SSD
--

With SC2 video options @1920*1080@Extreme I've had (in a recent 2vs2 match):

775/1250 >>> 33(Min)-59(Max)-47(Avge)
810/1250 >>> 33(Min)-61(Max)-49(Avge)
875/1300 >>> 34(Min)-62ax)-49(Avge)

Do you think that I should modify some CPU setups through BIOS?

Thank you in advance,


---
DoctorNenito
New Posts  All Forums:Forum Nav:
  Return Home
Overclock.net › Forums › Benchmarks › Benchmarking Software and Discussion › Benchmarks without minimum and maximum fps are useless for RTS