Overclock.net › Forums › Industry News › Hardware News › [Ars] Note 3’s benchmarking “adjustments” inflate scores by up to 20%
New Posts  All Forums:Forum Nav:

[Ars] Note 3’s benchmarking “adjustments” inflate scores by up to 20% - Page 9

post #81 of 89
HTC and LG also cheat in some benchmarks
http://www.anandtech.com/show/7384/state-of-cheating-in-android-benchmarks
post #82 of 89
Quote:
Originally Posted by Gigatel View Post

Name some other companies cheating their phone's scores.

Do you honestly believe all other companies are god sent angels that would never do such a thing?
Remember it's only cheating if you get caught.

I'm not only talking about cellphones either, i can't provide any benches but if you dig deep into your common sense i'm sure you will agree?
post #83 of 89
Quote:
Originally Posted by SKYMTL View Post

My point is that smartphones are more about an overall experience than raw performance. People don't care about the highest AnTuAnTu score if the phone's UI hesitates or their web browser takes forever to open. That makes most synthetic benchmarks pretty meaningless in this product space.

For example, my Z10 "feels" faster than my Note 2 regardless of the fact Samsung's uber-phone spanks it like a lazy donkey in benchmarks.

I'm not defending Samsung here. I'm just making an observation of how such a meaningless statistic can completely skew someone's opinion.
I agree with you there, reason why I'm still using the Nexus 4. It's just funny how these threads turn out since a lot of the people defending it attack Apple for it.
Rig
(15 items)
 
   
CPUMotherboardGraphicsRAM
i7 5820K MSI X99A SLI PLUS EVGA GTX 1070 FTW 4x8GB G.Skill Ripjaws  
Hard DriveHard DriveCoolingOS
Samsung 850 Pro Samsung 850 Evo Noctua NH-D15 Windows 10 
MonitorKeyboardPowerCase
Dell U2515H Happy Hacking Keyboard 2  EVGA Supernova 750 G2 Corsair 600Q 
MouseMouse PadAudio
Logitech G403 Steelseries QcK Mass M-Audio AV40 
CPUMotherboardGraphicsRAM
i7 930 @ 3.7 HT Gigabyte X58A-UD3R VisionTek 4870x2 3x4GB's G.Skill Ripjaws 1600 
Hard DriveOptical DriveOSMonitor
500GB AAKS, 2x 640GB AAKS, 2x 1TB Samsung SH-S203B Windows 7 Ultimate 64-bit Samsung 245BW 
KeyboardPowerCaseMouse
Happy Hacking Keyboard 2 Silverstone OP850 Antec 1200 [Three Nanoxia FX12] [Two San Ace 1011] Logitech G500 
Mouse Pad
Razer eXactMat 
CPUGraphicsRAMHard Drive
i7 3615QM GT 650M 16GB DDR3 256GB SSD 
OS
OS X Mountain Lion 
  hide details  
Reply
Rig
(15 items)
 
   
CPUMotherboardGraphicsRAM
i7 5820K MSI X99A SLI PLUS EVGA GTX 1070 FTW 4x8GB G.Skill Ripjaws  
Hard DriveHard DriveCoolingOS
Samsung 850 Pro Samsung 850 Evo Noctua NH-D15 Windows 10 
MonitorKeyboardPowerCase
Dell U2515H Happy Hacking Keyboard 2  EVGA Supernova 750 G2 Corsair 600Q 
MouseMouse PadAudio
Logitech G403 Steelseries QcK Mass M-Audio AV40 
CPUMotherboardGraphicsRAM
i7 930 @ 3.7 HT Gigabyte X58A-UD3R VisionTek 4870x2 3x4GB's G.Skill Ripjaws 1600 
Hard DriveOptical DriveOSMonitor
500GB AAKS, 2x 640GB AAKS, 2x 1TB Samsung SH-S203B Windows 7 Ultimate 64-bit Samsung 245BW 
KeyboardPowerCaseMouse
Happy Hacking Keyboard 2 Silverstone OP850 Antec 1200 [Three Nanoxia FX12] [Two San Ace 1011] Logitech G500 
Mouse Pad
Razer eXactMat 
CPUGraphicsRAMHard Drive
i7 3615QM GT 650M 16GB DDR3 256GB SSD 
OS
OS X Mountain Lion 
  hide details  
Reply
post #84 of 89
Quote:
Originally Posted by DiNet View Post

CPU turbo = cheat?
Giving boost to CPU power when it needs power = cheat?
Downclocking CPU when it's not needed to preserve battery = cheat?

Don't give a squat what score my phone got in benchmarks. Screen size + ram + battery = good phone. 4" phone doesn't suit modern world.

The bolded portion is one of the most daft things I've read on here. If you honestly feel that way then the GTX470 in your computer doesn't suit the modern gaming world. See how dumb that sounds?
Silent Screamer
(15 items)
 
SUPER SLACR
(14 items)
 
 
CPUMotherboardGraphicsRAM
Intel Core i5 2500K @ 4.8GHz 24/7 ASRock Z77 Extreme4 Gigabyte GTX 980ti G1 Gaming @1552MHz core/8250... 8GB Mushkin Enhanced Blackline 2133 
Hard DriveHard DriveCoolingOS
256GB Crucial M4 SSD 500GB Samsung Spinpoint XSPC Raystorm CPU & EKWB GPU w/ 140mm & 420mm Rads Windows 7 Pro 
MonitorKeyboardPowerCase
27" Yamakasi Catleap Logitech G710+ PC Power & Cooling 750W Enermax Fulmo GT 
MouseMouse PadAudio
Logitech G502 Logitech G640 ASUS XONAR 5.1 
CPUMotherboardGraphicsRAM
Q6600 @ 3.5GHz EVGA 780I EVGA 8800GT SLI OCZ 2x2GB 
Hard DriveOptical DriveCoolingOS
WD 2x500GB SATA II Samsung Noctua NH-D14 Windows 7 Professional 
MonitorKeyboardPowerCase
Samsung 226BW 22" Saitek Eclipse PC Power & Cooling Silencer 750W Antec P182 
MouseMouse Pad
Microsoft Steelseries 
  hide details  
Reply
Silent Screamer
(15 items)
 
SUPER SLACR
(14 items)
 
 
CPUMotherboardGraphicsRAM
Intel Core i5 2500K @ 4.8GHz 24/7 ASRock Z77 Extreme4 Gigabyte GTX 980ti G1 Gaming @1552MHz core/8250... 8GB Mushkin Enhanced Blackline 2133 
Hard DriveHard DriveCoolingOS
256GB Crucial M4 SSD 500GB Samsung Spinpoint XSPC Raystorm CPU & EKWB GPU w/ 140mm & 420mm Rads Windows 7 Pro 
MonitorKeyboardPowerCase
27" Yamakasi Catleap Logitech G710+ PC Power & Cooling 750W Enermax Fulmo GT 
MouseMouse PadAudio
Logitech G502 Logitech G640 ASUS XONAR 5.1 
CPUMotherboardGraphicsRAM
Q6600 @ 3.5GHz EVGA 780I EVGA 8800GT SLI OCZ 2x2GB 
Hard DriveOptical DriveCoolingOS
WD 2x500GB SATA II Samsung Noctua NH-D14 Windows 7 Professional 
MonitorKeyboardPowerCase
Samsung 226BW 22" Saitek Eclipse PC Power & Cooling Silencer 750W Antec P182 
MouseMouse Pad
Microsoft Steelseries 
  hide details  
Reply
post #85 of 89
Quote:
Originally Posted by Marin View Post

I agree with you there, reason why I'm still using the Nexus 4. It's just funny how these threads turn out since a lot of the people defending it attack Apple for it.

IKR. I find it funny the level of hypocrisy that is on OCN sometimes. If this title was "Apple cheats benchmarks" every single person defending Samsung would be blasting Apple. The same people that say "Id rather be dead than buy an apple product" When asked why they say "I hate Apple's business ethics" LMAO Yet Samsung has the same amount of blemishes on their record.

Gotta love that selective morality. rolleyes.gif
DOTA BOX
(7 items)
 
  
CPUGraphicsRAMHard Drive
Intel i3 4130 GTX 860M +135 Core +600Mem 16GB HyperX Impact 250GB Adata SSD 
MonitorAudio
DELL IPS 1920x1080 Logitech G933 
  hide details  
Reply
DOTA BOX
(7 items)
 
  
CPUGraphicsRAMHard Drive
Intel i3 4130 GTX 860M +135 Core +600Mem 16GB HyperX Impact 250GB Adata SSD 
MonitorAudio
DELL IPS 1920x1080 Logitech G933 
  hide details  
Reply
post #86 of 89
Samsung is stupid because it's not benchmarks that sell the Note3, it's that HUGE SCREEN. Samsung should focus on cheating on S5 scores or something. smile.gif
Spit in God's Eye
(16 items)
 
  
CPUMotherboardGraphicsRAM
i7-5960x @ 4.26 ghz core / 3.55 ghz uncore - 1.3v AsRock X99 Extreme3 EVGA GTX980 Ti 16gb (4x4gb) Crucial DDR4 2133 CL15 
Hard DriveHard DriveHard DriveOptical Drive
A-Data SP600 256gb SSD (C:) Samsung 840 EVO 1TB SSD (D:) Seagate 2TB Hybrid Drive (E:) LITE-ON 24x DVDRW 
CoolingOSMonitorKeyboard
Corsair H110 Win 10 x64 HP 2511x ( 25" 1080p ) AZIO L70 
PowerCaseMouseAudio
Corsair TX750 Antec 300 (Modded) Logitech M100 Onboard 
  hide details  
Reply
Spit in God's Eye
(16 items)
 
  
CPUMotherboardGraphicsRAM
i7-5960x @ 4.26 ghz core / 3.55 ghz uncore - 1.3v AsRock X99 Extreme3 EVGA GTX980 Ti 16gb (4x4gb) Crucial DDR4 2133 CL15 
Hard DriveHard DriveHard DriveOptical Drive
A-Data SP600 256gb SSD (C:) Samsung 840 EVO 1TB SSD (D:) Seagate 2TB Hybrid Drive (E:) LITE-ON 24x DVDRW 
CoolingOSMonitorKeyboard
Corsair H110 Win 10 x64 HP 2511x ( 25" 1080p ) AZIO L70 
PowerCaseMouseAudio
Corsair TX750 Antec 300 (Modded) Logitech M100 Onboard 
  hide details  
Reply
post #87 of 89
I'm curious as to why the Anandtech page didn't investigate properly.

http://www.anandtech.com/show/7187/looking-at-cpugpu-benchmark-optimizations-galaxy-s-4

This looks good and it seems convincing, but the proper tools were not used. A Hex editor/viewer is insufficient to actually see the code proper. The reviewer ought to have fully decompiled the .apk using apktool into the dalvik assembly code "Smali" which is human readable. At worst, they should have used dex2jar on the apk to get some Android Java readable code to see what was really going on.

In the article in the OP, it states also that the GPE phones are not "clean" but this isn't true, as there is no such code boosting scores on those phones (for instance, the "TwDVFS.apk" is missing completely) Samsung's and HTC's participation in the GPE phones is simply the propitiatory camera libraries & drivers and IR Blaster drivers and nothing much more.

It's also quite possible that Apple do this as well. In fact, I'll wager good money that they do. But, we'll never know because it's extremely hard to decompile the iOS system files and find this stuff out.

Just my 2c
post #88 of 89
Quote:
Originally Posted by SKYMTL View Post


As if benchmarks mean a darn thing in the overall smartphone experience..... rolleyes.gif

 

Well "real world" benchmarks give you a nice piece of the picture, but some people want the most powerful smartphone and may purchase the Note 3 over a competing smartphone with the same processor because of those benchmark results.

post #89 of 89
Quote:
Originally Posted by DiNet View Post

CPU turbo = cheat?
Giving boost to CPU power when it needs power = cheat?
Downclocking CPU when it's not needed to preserve battery = cheat?

Don't give a squat what score my phone got in benchmarks. Screen size + ram + battery = good phone. 4" phone doesn't suit modern world.

I like small phones so for me 4" is to big the iPhone is too big.
 
DD Portable
(12 items)
 
 
CPUMotherboardGraphicsRAM
i5 5675C Gigabyte GA-Z97X Gaming 5 XFX RX 480 GTR 32GB Corsair Vengeance 1600 
Hard DriveHard DriveHard DriveCooling
Samsung 840 Evo Western Digital Black RE4 2TB Western Digital Green 2TB Arctic Cooling Accelero S3 (Passive for GPU) 
CoolingCoolingCoolingCooling
bequiet! Silent Wings 2 140mm PWM bequiet! Silent Wings 2 140mm PWM bequiet! Shadow Wings SW1 120mm PWM bequiet! Dark Rock Pro 3 
OSMonitorKeyboardPower
Arch X64 / Gnome and OSX 10.11 Dell U2414H KBC Poker II be quiet! Straight Power 10 400W 
CaseMouse
bequiet! Silent Base 800 Speedlink Omni VI  
CPUMotherboardGraphicsRAM
i5 3427U The Googs HD4000 4GB DDR3 
Hard DriveOSMonitorKeyboard
32GB Flash / 128GB SanDisk Extreme SD card ChromeOS / Ubuntu 14.04 12" 2560x1700 bad 
PowerCaseMouseAudio
not much  Aluminium  Trackpad it makes noise I think  
  hide details  
Reply
 
DD Portable
(12 items)
 
 
CPUMotherboardGraphicsRAM
i5 5675C Gigabyte GA-Z97X Gaming 5 XFX RX 480 GTR 32GB Corsair Vengeance 1600 
Hard DriveHard DriveHard DriveCooling
Samsung 840 Evo Western Digital Black RE4 2TB Western Digital Green 2TB Arctic Cooling Accelero S3 (Passive for GPU) 
CoolingCoolingCoolingCooling
bequiet! Silent Wings 2 140mm PWM bequiet! Silent Wings 2 140mm PWM bequiet! Shadow Wings SW1 120mm PWM bequiet! Dark Rock Pro 3 
OSMonitorKeyboardPower
Arch X64 / Gnome and OSX 10.11 Dell U2414H KBC Poker II be quiet! Straight Power 10 400W 
CaseMouse
bequiet! Silent Base 800 Speedlink Omni VI  
CPUMotherboardGraphicsRAM
i5 3427U The Googs HD4000 4GB DDR3 
Hard DriveOSMonitorKeyboard
32GB Flash / 128GB SanDisk Extreme SD card ChromeOS / Ubuntu 14.04 12" 2560x1700 bad 
PowerCaseMouseAudio
not much  Aluminium  Trackpad it makes noise I think  
  hide details  
Reply
New Posts  All Forums:Forum Nav:
  Return Home
  Back to Forum: Hardware News
Overclock.net › Forums › Industry News › Hardware News › [Ars] Note 3’s benchmarking “adjustments” inflate scores by up to 20%