Overclock.net › Forums › Industry News › Hardware News › [ AA ] Analyst says Intel beating ARM in benchmarks was a sham
New Posts  All Forums:Forum Nav:

[ AA ] Analyst says Intel beating ARM in benchmarks was a sham  

post #1 of 9
Thread Starter 
SOURCE


Quote:
Earlier this month we brought you news that Intel had destroyed ARM in benchmarks. It was a pretty big deal. Not just because it beat out chips like the Snapdragon 800 and the Exynos 5 Octa, but because it beat them out by so much. In the original benchmarks, Intel beat out the Snapdragon 800 by 11000 points and the Exynos 5 Octa by 16000 in the widely used AnTuTu benchmark. As it turns out, it may have all been a sham.
Quote:
According to Neil McAllister of The Register, analyst Jim McGregor didn’t quite like those numbers. McGregor went on an investigation and concluded that the benchmarks didn’t show Intel being better because they were actually better. It was actually an error with AnTuTu.

During his investigation, he found that updates made to AnTuTu seemed to favor Intel chips over ARM chips. As he explains, the updates gave ARM processors a mere 50% upgrade in performance whereas Intel chips were seeing increases of up to 292%. This is what originally piqued McGregor’s interest to look more into the situation. It was a good thing he did, too, because he was completely right.
Quote:
So has this been fixed? Well, sort of. AnTuTu has released an update to fix the problem and Intel’s performance has since dropped dramatically. Check out the screen shot below for the new scores

Quad Damage
(16 items)
 
  
CPUMotherboardGraphicsGraphics
Intel i7 3930k @ 4.8Ghz Asus Rampage IV Extreme (Koolance Full WB) Zotac GTX 680 AMP Edition Waiting for HD 9970 QuadFire 
RAMHard DriveOptical DriveCooling
Corsair Dominator GT 2133 Ghz (16GB) (128GB Crucial M4 - 64 GB Patriot Pyro SSD) 1x1... LG Blue-Ray Burner Fully Custom 
OSMonitorKeyboardPower
Windows 7 Ultimate x64 3 x CrossOver 27Q Led-P 1440p (Eyefinity 3x1) Logitech G15 Lepa G 1600 (1600 Watts) 
CaseMouseMouse PadAudio
Corsair Obsidian Heavily Modded Logitech G700 RocketFish Speed/Control M-audio AV-40 (Logitech G-35) 
  hide details  
Quad Damage
(16 items)
 
  
CPUMotherboardGraphicsGraphics
Intel i7 3930k @ 4.8Ghz Asus Rampage IV Extreme (Koolance Full WB) Zotac GTX 680 AMP Edition Waiting for HD 9970 QuadFire 
RAMHard DriveOptical DriveCooling
Corsair Dominator GT 2133 Ghz (16GB) (128GB Crucial M4 - 64 GB Patriot Pyro SSD) 1x1... LG Blue-Ray Burner Fully Custom 
OSMonitorKeyboardPower
Windows 7 Ultimate x64 3 x CrossOver 27Q Led-P 1440p (Eyefinity 3x1) Logitech G15 Lepa G 1600 (1600 Watts) 
CaseMouseMouse PadAudio
Corsair Obsidian Heavily Modded Logitech G700 RocketFish Speed/Control M-audio AV-40 (Logitech G-35) 
  hide details  
post #2 of 9
well Intel is still faster but not by the stupidly large margin that would've put all other ARM makers bankrupt
what ARM is still faster than x86? unbelievable.
Edited by james8 - 7/14/13 at 2:22pm
Dream PC
(17 items)
 
Surface Pro 3
(9 items)
 
 
CPUMotherboardGraphicsRAM
INTEL Core i7 6700K ASUS Maximus VIII Hero Z170 MSI Geforce GTX 980 Ti Gaming 6G G.SKILL Ripjaws 4 series 16GB DDR4 3000 
Hard DriveHard DriveCoolingOS
SAMSUNG SM951 NVMe 512GB SAMSUNG 850 EVO 1TB Cooler Master Nepton 280L Microsoft Windows 10 Pro x64 
MonitorMonitorKeyboardPower
BenQ XL2420TE Dell UltraSharp U2415 WASD V2 custom CORSAIR HX850i 
CaseMouseAudioOther
NZXT H440 white CORSAIR Vengeance M95 CREATIVE Sound Blaster Z CPU Delid 
Other
LED Lighting 
CPUMotherboardGraphicsRAM
Intel Core i5 4300U Microsoft Surface Intel HD Graphics 4400 8 GB DDR3L 
Hard DriveOSKeyboardMouse
256 GB SSD Windows 10 Pro x64 Surface Pro 4 Type Cover with Fingerprint ID Microsoft Arc Mouse Surface Edition 
  hide details  
Dream PC
(17 items)
 
Surface Pro 3
(9 items)
 
 
CPUMotherboardGraphicsRAM
INTEL Core i7 6700K ASUS Maximus VIII Hero Z170 MSI Geforce GTX 980 Ti Gaming 6G G.SKILL Ripjaws 4 series 16GB DDR4 3000 
Hard DriveHard DriveCoolingOS
SAMSUNG SM951 NVMe 512GB SAMSUNG 850 EVO 1TB Cooler Master Nepton 280L Microsoft Windows 10 Pro x64 
MonitorMonitorKeyboardPower
BenQ XL2420TE Dell UltraSharp U2415 WASD V2 custom CORSAIR HX850i 
CaseMouseAudioOther
NZXT H440 white CORSAIR Vengeance M95 CREATIVE Sound Blaster Z CPU Delid 
Other
LED Lighting 
CPUMotherboardGraphicsRAM
Intel Core i5 4300U Microsoft Surface Intel HD Graphics 4400 8 GB DDR3L 
Hard DriveOSKeyboardMouse
256 GB SSD Windows 10 Pro x64 Surface Pro 4 Type Cover with Fingerprint ID Microsoft Arc Mouse Surface Edition 
  hide details  
post #3 of 9
post #4 of 9
Quote:
Originally Posted by Durquavian View Post

http://www.overclock.net/t/1409201/eetimes-has-intel-really-beaten-arm Is this the same article/discussion?

Yes, that article is the main source for this article.
SUPERPWN
(12 items)
 
  
CPUMotherboardGraphicsRAM
Core i5 4670K Asus z87-Pro MSI GTX 1080 Aero 32GB DDR3 Gskill Ripjaws 
Hard DriveOSMonitorMonitor
4TB Seagate Windows 8 x64 Overlord x270 OC HP ZR27 
MonitorKeyboardPowerAudio
LG34UM94 G-Tune Topre Realforce 800w Yulong D100 DAC with Denon D7000 headphones 
  hide details  
SUPERPWN
(12 items)
 
  
CPUMotherboardGraphicsRAM
Core i5 4670K Asus z87-Pro MSI GTX 1080 Aero 32GB DDR3 Gskill Ripjaws 
Hard DriveOSMonitorMonitor
4TB Seagate Windows 8 x64 Overlord x270 OC HP ZR27 
MonitorKeyboardPowerAudio
LG34UM94 G-Tune Topre Realforce 800w Yulong D100 DAC with Denon D7000 headphones 
  hide details  
post #5 of 9
Quote:
Originally Posted by james8 View Post

well Intel is still faster but not by the stupidly large margin that would've put all other ARM makers bankrupt
what ARM is still faster than x86? unbelievable.

Intel isnt going to be taking much if any smartphone market share anytime soon. Apple has its A series chips, samsung has exynos that its slowly bringing to its smartphone lineup, and then you have qualcomm, producing cheap chips to everyone, that are extremely efficient and powerful. Intel plans to announce a reference smartphone with merrifield in 2014 with LTE. And seeing how long it usually takes for a company to move from a reference design to having their chips in consumer devices, i wouldnt expect intel to have LTE in a consumer smartphone till 2015. Till they get LTE, nobody will adopt them. Hopefully by then they will work out all the kins that are currently in the x86 build of android.
post #6 of 9
Quote:
Starting at AnTuTu 2.9.4, they began compiling using a unique compiler designed by Intel. This allowed Intel chips to bypass certain parts of the test to inflate their score. In other words, AnTuTu made a mistake and Intel’s chips cashed in. Due to this error and due to parts of the test being skipped, Intel was able to gain an unfair advantage in the test scores.

Intel and questionable benchmarks, shocking. Intel and their compilers.
Edited by FLCLimax - 7/14/13 at 3:09pm
post #7 of 9
Quote:
Originally Posted by FLCLimax View Post

Intel and questionable benchmark. shocking. Intel and their compilers.

The amount of sarcasm in your post is remarkable.
   
AGP bencher
(14 items)
 
CPUMotherboardGraphicsRAM
Phenom X6 1055T ASUS M4A89GTD Pro/USB3 Sapphire HD 6950 2GiB GSKill Ares 2x4GiB 
Hard DriveHard DriveHard DriveCooling
Crucial MX100 Seagate 7200.14 Samsung SpinPoint F3 EK Supreme HF 
CoolingCoolingCoolingCooling
EK CoolStream XT360 Alphacool Coolplex Pro 10LT Phobya DC12-400 XSPC Rasa GPU 
OSMonitorMonitorKeyboard
W10 Pro LG IPS235V LG E2250V KUL ES-87 
PowerCaseMouseAudio
NOX Sonar 780W (Kingwin 750W 80+) Lian Li PC-A05NB Logitech G9 ASUS Xonar DX 
AudioAudioAudioOther
Sennheiser HD555 SMSL SA S3 Desktop Amplifier Kenwood KFC S1394 + Custom 10L Bass Reflex cabi... Logitech G25 
CPUMotherboardRAMHard Drive
AMD A10-5700 Gigabyte F2A75M-HD2 G.SKILL Ares 2133 CL9 Hitachi 5K750 
CoolingOSMonitorPower
Noctua NH-L9a Citrix XenServer AUO B156HW01  PicoPSU-80-WI-25V 
CaseOther
AIO Aluminium Handmade Alfa Networks N-150 500mW 
CPUCPUCPUMotherboard
Core2Duo E6400 Core2Quad Q6600 Pentium Dual Core E5200 AsRock 4COREDUAL-SATA2 R2.0 
GraphicsRAMHard DriveOptical Drive
A dumpload of ancient AGP cards Kingston Value DDR2-667 CL4 2T @CL3 1T Seagate 160GB 7200.10 LG IDE DVD-ROM 
CoolingCoolingOSMonitor
Ghettomade CPU waterblock 49cc 2stroke engine copper radiator WinXP SP2 32bit ProView 17" 
PowerCase
Tacens Radix V 550W Ghetto aluminium bench 
  hide details  
   
AGP bencher
(14 items)
 
CPUMotherboardGraphicsRAM
Phenom X6 1055T ASUS M4A89GTD Pro/USB3 Sapphire HD 6950 2GiB GSKill Ares 2x4GiB 
Hard DriveHard DriveHard DriveCooling
Crucial MX100 Seagate 7200.14 Samsung SpinPoint F3 EK Supreme HF 
CoolingCoolingCoolingCooling
EK CoolStream XT360 Alphacool Coolplex Pro 10LT Phobya DC12-400 XSPC Rasa GPU 
OSMonitorMonitorKeyboard
W10 Pro LG IPS235V LG E2250V KUL ES-87 
PowerCaseMouseAudio
NOX Sonar 780W (Kingwin 750W 80+) Lian Li PC-A05NB Logitech G9 ASUS Xonar DX 
AudioAudioAudioOther
Sennheiser HD555 SMSL SA S3 Desktop Amplifier Kenwood KFC S1394 + Custom 10L Bass Reflex cabi... Logitech G25 
CPUMotherboardRAMHard Drive
AMD A10-5700 Gigabyte F2A75M-HD2 G.SKILL Ares 2133 CL9 Hitachi 5K750 
CoolingOSMonitorPower
Noctua NH-L9a Citrix XenServer AUO B156HW01  PicoPSU-80-WI-25V 
CaseOther
AIO Aluminium Handmade Alfa Networks N-150 500mW 
CPUCPUCPUMotherboard
Core2Duo E6400 Core2Quad Q6600 Pentium Dual Core E5200 AsRock 4COREDUAL-SATA2 R2.0 
GraphicsRAMHard DriveOptical Drive
A dumpload of ancient AGP cards Kingston Value DDR2-667 CL4 2T @CL3 1T Seagate 160GB 7200.10 LG IDE DVD-ROM 
CoolingCoolingOSMonitor
Ghettomade CPU waterblock 49cc 2stroke engine copper radiator WinXP SP2 32bit ProView 17" 
PowerCase
Tacens Radix V 550W Ghetto aluminium bench 
  hide details  
post #8 of 9
i was genuinely shocked.
post #9 of 9
New Posts  All Forums:Forum Nav:
  Return Home
  Back to Forum: Hardware News
This thread is locked  
Overclock.net › Forums › Industry News › Hardware News › [ AA ] Analyst says Intel beating ARM in benchmarks was a sham