Overclock.net › Forums › Industry News › Hardware News › [HardwareHeaven] Why many GPU reviews are not fit for purpose
New Posts  All Forums:Forum Nav:

[HardwareHeaven] Why many GPU reviews are not fit for purpose

post #1 of 117
Thread Starter 
Quote:
The simple fact is that manufacturers and consumers have been too accepting of reviews. Not caring about more than the basics of the results presented to them, or how the figures were achieved/recorded. Add to that the fact there are a huge number of review sites out there and to be frank they are filled with lazy writers who will do the minimum required to get an article out... and editors who only care about hits (money) and not the quality of the work. On occasion the same lazy writers are also the money focused editors and that is never a good mix. That's before we even consider those who fabricate testing and plagiarise others work.

SOURCE
loon 3.2
(18 items)
 
  
CPUMotherboardGraphicsRAM
i7-3770K Asus P8Z77-V Pro EVGA 980TI SC+ 16Gb PNY ddr3 1866 
Hard DriveHard DriveHard DriveOptical Drive
PNY 1311 240Gb 1 TB Seagate 3 TB WD Blue DVD DVDRW+/- 
CoolingCoolingOSMonitor
EKWB P280 kit EK-VGA supremacy Win X LG 24MC57HQ-P 
KeyboardPowerCaseMouse
Ducky Zero [blues] EVGA SuperNova 750 G2 Stryker M [hammered and drilled] corsair M65 
AudioAudio
SB Recon3D Klipsch ProMedia 2.1  
  hide details  
Reply
loon 3.2
(18 items)
 
  
CPUMotherboardGraphicsRAM
i7-3770K Asus P8Z77-V Pro EVGA 980TI SC+ 16Gb PNY ddr3 1866 
Hard DriveHard DriveHard DriveOptical Drive
PNY 1311 240Gb 1 TB Seagate 3 TB WD Blue DVD DVDRW+/- 
CoolingCoolingOSMonitor
EKWB P280 kit EK-VGA supremacy Win X LG 24MC57HQ-P 
KeyboardPowerCaseMouse
Ducky Zero [blues] EVGA SuperNova 750 G2 Stryker M [hammered and drilled] corsair M65 
AudioAudio
SB Recon3D Klipsch ProMedia 2.1  
  hide details  
Reply
post #2 of 117
I always check the many points they mke about a proper test setup. Lol @ titans on a i5.
post #3 of 117
I bet this site do the same things they are complaining about.
Intel Killer
(14 items)
 
  
CPUMotherboardGraphicsRAM
AMD 8320 4.4ghz Gigabyte 990fx XFX R9 290 (1100/1250) 8GB DDR3 1866 
Hard DriveCoolingOSMonitor
750GB Momentus XT Corsair H80i Windows 8 3x 23" 1080p 
KeyboardPower
Logitech Mk 710 OCZ 1000 watts 
  hide details  
Reply
Intel Killer
(14 items)
 
  
CPUMotherboardGraphicsRAM
AMD 8320 4.4ghz Gigabyte 990fx XFX R9 290 (1100/1250) 8GB DDR3 1866 
Hard DriveCoolingOSMonitor
750GB Momentus XT Corsair H80i Windows 8 3x 23" 1080p 
KeyboardPower
Logitech Mk 710 OCZ 1000 watts 
  hide details  
Reply
post #4 of 117
Very well written article. Thank you HardWare Heaven. Props to you guys. thumb.gif

Everything they say makes so much sense. Why do we test SLI Titans with an i5? Why would you pull Nvidia results from 6 months ago on old drivers? They point this out well.
Heisenberg
(10 items)
 
Redemption
(18 items)
 
 
CPUGraphicsRAMHard Drive
Intel Core 2 Extreme @ 2.8GHz (upgrade) Intel GMA 950 2 x 2 DDR2 667MHz (upgrade) 120GB Mushkin ECO2 
Optical DriveOSMonitorPower
Replaced with 42 W/hr aux battery Mint 17.3 1280x800 Dell 65w Dell Adapter 
CaseOther
Latitude D630 Chassis Intel 7260-802.11ac 2x2 
CPUMotherboardGraphicsRAM
Not telling AsRock something Pixel Pusher 2 x 8 GB AMD Radeon RAM @ 1600mhz (All the VM's) 
Hard DriveHard DriveHard DriveOptical Drive
Crucial M4 128GB (8 second boot) Western Digital RE4 1TB Western Digital RE4 2TB Pioneer Blu-Ray Reader/Writer 
CoolingOSMonitorKeyboard
Cooler Master Hyper 212 Evo Windows 8.1 Pro x64 Dell U2713HM IBM Model M (CLICKY!!) 
PowerCaseMouseAudio
Antec HCG-900 NZXT Source 210 (it was cheap) Logitech G502 Schiit Modi 
AudioAudio
Sennheiser HD 598 M-Audio AV40's 
CPUMotherboardGraphicsRAM
Intel Core i5-4200U Microsoft BGA1168 Intel HD 4400 8 GB LPDDR3 Dual Channel @ 1600mhz 
Hard DriveOSMonitorKeyboard
SK Hynix 256GB SSD Windows 8.1 Professional 1920 x 1080p IPS Display Microsoft Touch Cover 2 
Power
48w PSU 
  hide details  
Reply
Heisenberg
(10 items)
 
Redemption
(18 items)
 
 
CPUGraphicsRAMHard Drive
Intel Core 2 Extreme @ 2.8GHz (upgrade) Intel GMA 950 2 x 2 DDR2 667MHz (upgrade) 120GB Mushkin ECO2 
Optical DriveOSMonitorPower
Replaced with 42 W/hr aux battery Mint 17.3 1280x800 Dell 65w Dell Adapter 
CaseOther
Latitude D630 Chassis Intel 7260-802.11ac 2x2 
CPUMotherboardGraphicsRAM
Not telling AsRock something Pixel Pusher 2 x 8 GB AMD Radeon RAM @ 1600mhz (All the VM's) 
Hard DriveHard DriveHard DriveOptical Drive
Crucial M4 128GB (8 second boot) Western Digital RE4 1TB Western Digital RE4 2TB Pioneer Blu-Ray Reader/Writer 
CoolingOSMonitorKeyboard
Cooler Master Hyper 212 Evo Windows 8.1 Pro x64 Dell U2713HM IBM Model M (CLICKY!!) 
PowerCaseMouseAudio
Antec HCG-900 NZXT Source 210 (it was cheap) Logitech G502 Schiit Modi 
AudioAudio
Sennheiser HD 598 M-Audio AV40's 
CPUMotherboardGraphicsRAM
Intel Core i5-4200U Microsoft BGA1168 Intel HD 4400 8 GB LPDDR3 Dual Channel @ 1600mhz 
Hard DriveOSMonitorKeyboard
SK Hynix 256GB SSD Windows 8.1 Professional 1920 x 1080p IPS Display Microsoft Touch Cover 2 
Power
48w PSU 
  hide details  
Reply
post #5 of 117
Fairly basic knowledge. I mean, "make sure the reviewer uses an appropriate CPU and the newest drivers" was the main point in this.
Quote:
Look for new tests, the latest games (or synthetic tests) signify new testing. (It's nice to see some old favourites mixed in though, they have value to some readers).
Look for the titles YOU want to play. This is what should be important to you. Do you really care whether NVIDIA is doing bad in Tomb Raider if you don't have or want that game?
Quote:
Look for examples which prove testing was real world... for example screenshots of gameplay (and that they are different to past articles).
Screenshots of gameplay don't prove that the numbers weren't manipulated. If I were a reviewer, I'd take the perfect screenshots once on the relevant graphics settings and reuse them in all articles with the same tests. The only use these screenshots have is to show what different settings do, so why remake them every time?
Quote:
Look for more than just gaming... power/thermal etc should also be there but extra tests are also worthy of inclusion. After all many people watch streaming HD content on their PC and modern browsers include GPU acceleration to assist the CPU. We want that to perform great too, right?
I don't think any modern GPU is incapable of this. At least not the kind you see in reviews like these.
M1XN
(18 items)
 
Study Zenbook
(5 items)
 
 
CPUMotherboardGraphicsRAM
i7 4770K @ 4.2 GHz ASUS Maximus VI Impact MSI GTX 970 Gaming 4G 2x8 GB Kingston HyperX DDR3 @ 2400 MHz 
Hard DriveHard DriveHard DriveOptical Drive
Crucial M4 64 GB Crucial M4 128 GB SAMSUNG Spinpoint M9T 2 TB LiteOn DL-8ATSH 
CoolingOSMonitorKeyboard
Noctua NH-C14 Windows 10 64-bit ViewSonic VP2770 Vortex Pok3r 
PowerCaseMouseMouse Pad
Corsair SF600 NCASE M1 V2.5 Logitech G502 SteelSeries QcK+ 
AudioOther
HiFiMan HE-400 Logitech C920 
CPUGraphicsRAMHard Drive
i5-3317 GT 620M 2 GB soldered + 8 GB Corsair OCZ Vertex 3 120 
OS
Windows 7 Home Premium 64-bit 
  hide details  
Reply
M1XN
(18 items)
 
Study Zenbook
(5 items)
 
 
CPUMotherboardGraphicsRAM
i7 4770K @ 4.2 GHz ASUS Maximus VI Impact MSI GTX 970 Gaming 4G 2x8 GB Kingston HyperX DDR3 @ 2400 MHz 
Hard DriveHard DriveHard DriveOptical Drive
Crucial M4 64 GB Crucial M4 128 GB SAMSUNG Spinpoint M9T 2 TB LiteOn DL-8ATSH 
CoolingOSMonitorKeyboard
Noctua NH-C14 Windows 10 64-bit ViewSonic VP2770 Vortex Pok3r 
PowerCaseMouseMouse Pad
Corsair SF600 NCASE M1 V2.5 Logitech G502 SteelSeries QcK+ 
AudioOther
HiFiMan HE-400 Logitech C920 
CPUGraphicsRAMHard Drive
i5-3317 GT 620M 2 GB soldered + 8 GB Corsair OCZ Vertex 3 120 
OS
Windows 7 Home Premium 64-bit 
  hide details  
Reply
post #6 of 117
I always read many a review before i buy anything - there is not perfect review site out there, some maybe bias - paid by and ...

The best reviewer's are the Joe public, meaning their feedback counts a lot in the real world. Just like you lot on here applaud.gifapplaud.gifapplaud.gif
post #7 of 117
Post a bad review equals no review product next round. The worst are those that compare Nvidia to ATI only for same generation products. Try comparing said product to last years SLI setup.
W7 Rig
(0 items)
Deep Blue
(9 items)
 
 
CPUMotherboardGraphicsRAM
Intel Core i7 920 P6T DELUXE NVIDIA GeForce GTX 460 G. 
RAMRAMRAMRAM
G. G. G. G. 
RAM
G. 
  hide details  
Reply
W7 Rig
(0 items)
Deep Blue
(9 items)
 
 
CPUMotherboardGraphicsRAM
Intel Core i7 920 P6T DELUXE NVIDIA GeForce GTX 460 G. 
RAMRAMRAMRAM
G. G. G. G. 
RAM
G. 
  hide details  
Reply
post #8 of 117
I'm wondering if they had the 3570k @ 5.0 to not "lazily" down-clock their 3960X and make a "non biased" comparison.
post #9 of 117
Whats so funny about this post is that I do not trust their website. I have been reading reviews for awhile and a lot of times they have the first reviews posted and to me they read more like glorified advertising than actual reviews. Before I quit reading their reviews I did not find them particularly useful for comparison, did not find them in depth enough, and did not think they would bring up issues or problems. I had an Alienware M11x (that is no longer made mad.gif) I had an r1 and when the r2 came out there were talks of it on the forums not being much faster because of cpu throttling and issues with optimus. So what does hardware heaven's extensive 20 page review say about it? They had exactly one slide with 2 tests made showing direct cpu computational power but no gaming comparison tests. And trying to manually compare the two reviews was only partly useful because some tests were not the same. It was all about how great the new one was but for me I could not use their 2 reviews to decide if I should upgrade...Utterly useless. Then only 14 months after the R1 and 8 months after the r2 the M11x R3 was released, it was the biggest change of all finally offering a significant gpu upgrade and the test suite between the R1->R2->R3 was so vastly different that no direct gaming (the reason for this laptop in the first place) could be made. It was all about how great the new dx11 gpu performed....advertising
post #10 of 117
Quote:
Originally Posted by ladcrooks View Post

I always read many a review before i buy anything - there is not perfect review site out there, some maybe bias - paid by and ...

The best reviewer's are the Joe public, meaning their feedback counts a lot in the real world. Just like you lot on here applaud.gifapplaud.gifapplaud.gif

That's why I like Newegg. I know people say to ignore the comments but I'll dig through a lot of the comments, to see how adept the person is. Depending on the product, since some things I'm not in it for performance or features. HDDs, I just check to see if they fail but I'd surely trust an open review platform (newegg) than going to professional sites as that is the random every day man getting the product.
Current Rig
(14 items)
 
  
CPUMotherboardGraphicsRAM
FX-8350 4.6GHz@1.44v GA-990FXA-UD3 R4.0 HD 7950 (1100/1450) 8G Muskin DDR3 1866@8CLS 
Hard DriveOptical DriveOSMonitor
1TB WD LiteOn DVD-RW DL Linux/Windows 19" Phillips TV 1080p 
PowerCaseMouseMouse Pad
OCZ 600W Generic Junk Logitech MX400 Generic Junk 
Audio
SBL 5.1 
  hide details  
Reply
Current Rig
(14 items)
 
  
CPUMotherboardGraphicsRAM
FX-8350 4.6GHz@1.44v GA-990FXA-UD3 R4.0 HD 7950 (1100/1450) 8G Muskin DDR3 1866@8CLS 
Hard DriveOptical DriveOSMonitor
1TB WD LiteOn DVD-RW DL Linux/Windows 19" Phillips TV 1080p 
PowerCaseMouseMouse Pad
OCZ 600W Generic Junk Logitech MX400 Generic Junk 
Audio
SBL 5.1 
  hide details  
Reply
New Posts  All Forums:Forum Nav:
  Return Home
  Back to Forum: Hardware News
Overclock.net › Forums › Industry News › Hardware News › [HardwareHeaven] Why many GPU reviews are not fit for purpose