UL Benchmarks accuses Oppo of cheating on benchmark scores
UL Benchmarks, the company behind popular testing software 3DMark, has found Oppo guilty of cheating on benchmark scores. UL Benchmarks found that Oppo, the Chinese smartphone manufacturer, cheated during benchmarking to produce “artificially high and misleading” benchmark scores. As a result, it has delisted the Oppo Find X and F7 and also their initial scores from the scoreboard.
“After Huawei was caught unfairly boosting benchmark scores last month, we were contacted by reviewers from Tech2 who had similar concerns about Oppo smartphones. Extensive testing by Tech2 found that the flagship Oppo Find X smartphone produced artificially high and misleading benchmark scores,” UL said in a blog post.
While benchmarks are the last thing we look at when we review a smartphone, it does help us better understand the limitations of a smartphone or device. 3DMark is a piece of software that benchmarks all major devices.
“UL has clear rules for manufacturers that govern how a platform can interact with its benchmarking software. The purpose of these rules is to ensure that users get benchmark results that accurately reflect the true performance of the device for apps and games. After reviewing Tech2’s benchmark results, and conducting testing in our own lab, we have decided to delist the affected models and remove them from our performance rankings,” the post added.
According to the benchmarking firm, the Oppo Find X and F7 were found to have scores that were up to 41% higher than the scores from the private app when using the public version of the 3DMark application, even though the tests were identical. It appears that Oppo’s software was not able to recognize the package name of the private 3DMark application.
When Oppo was contacted in response to these findings, it replied that, “When we detect that the user is running applications like games or 3D Benchmarks that require high performance, we allow the SoC to run at full speed for the smoothest experience. For unknown applications, the system will adopt the default power optimization strategy…After the user has not actively operated for 5 to 10 seconds, the device limits the system performance to 70% to 80% of the maximum performance (according to different platforms)…When there is a user operation, it will immediately cancel the performance limit, to ensure that the user experience is not affected.”
Despite the explanation provided by Oppo, it still remains against 3DMark’s rules. As a result, the Oppo Find X and F7 will continue to remain delisted, until Oppo removes this cheating software.
This is not the first time we have heard about smartphone manufacturers cheating on benchmark scores. Companies like HTC, Huawei, Samsung, and other familiar names have done so in the past. Recently, Huawei’s P20, P20 Pro, Nova 3, and Honor Play were removed from 3DMark listings, as the company had coded these devices to detect the testing software and boost performance to hit higher scores.
Source:Techworm.in
0 Comments