Futuremark Delists Android Mobile Devices For Suspicious 3DMark Scores

Are mobile device makers trying to cheat popular industry benchmarks? Futuremark today informed us that the HTC One, HTC One Mini, Samsung Galaxy Note 10.1 2014, and the Samsung Galaxy Note III have all been delisted for possibly breaking the benchmark rules.  Futuremark didn’t come straight out and say why each device was suspected of cheating, but they did release the following statement.

“People rely on Futuremark benchmarks to produce accurate and unbiased results. That’s why we have clear rules for hardware manufacturers and software developers that specify how a platform can interact with our benchmark software. In simple terms, a device must run our benchmarks without modification as if they were any other application.
 
When a device is suspected of breaking our rules it is delisted. 3DMark scores from delisted devices should not be used to compare devices. Delisted devices appear unranked, and without scores, at the bottom of the 3DMark Device Channel and the Best Mobile Devices list on our website.” – Futuremark

3dmark-delisted

 

Print
  • Tushar Patil

    Please check out the LTE version of Note 10.1 2014, Jerry Lee has also uploaded various reviews. This link is of Benchmark & performance. Would this model score more than others?
    Check it out–>http://youtu.be/B1MBwTY2kZo

  • Zach B.

    Samsung got caught YET AGAIN huh? I’m surprised to see HTC listed though, they generally are regarded as one of the more “trustworthy” manufacturers, especially when compared against Samsung, LG, and Sony..

  • Rajaram Mohan Roy

    really? did these device cheat on consumer? means do tab 10.1 2014,Note3, HTC one & HTC one mini are not having genuine processor which performs as per stated by their manufacturer? oh if its true then consumer is hugely exploited & cheated my these tarnish tech giants…I’m potential buyer of Note 3 & Note10.1 2014, but this news has raised doubts in my mind…I have faith in Samsung pls don’t let me down else I won’t have option other than rude Apple.

  • Random

    why Note 3 & 10.1 were delisted? what caused Futuremark to take this step?

    • R6ex

      Artificially inflating benchmark scores (~20%) by maxing CPU & GPU frequencies for the short duration of such recognizable benchmark tests. This is not how the device would react under normal usage conditions, as throttling will come in due to excess heat from operating at max. frequencies all the time. This additional built-in codes within the gadgets do not reflect the true performance of the device under normal usage. Then again, Anandtech has already shown that such cheating measures are rampant among several manufacturers, not just Samsung. I’m still buying the Note 3 despite its cheating benchmark scores. I mean, we all know how well the Galaxy Note series of phablets have performed over the years. My original Galaxy Note is still serving me well. Note 3 can only improve on its predecessor. So, please ignore these inflated benchmark scores and focus on the device and its features.

      • Simon

        WTF is wrong with a device clocking to its max frequency when intensive application such as games are launched, and clock down the frequency when you are just browsing Facebook? EVERY SINGLE PHONE does that, so is your computer!

  • sdfgsdgsd

    lol @ samsung, bunch of cheaters