Versus The Desktop Web Browser Grand Prix
As we stated in our exploration of iOS-based Web browser performance, much of the desktop benchmark suite had to be dropped from mobile testing. Let's quickly recap the losses.
Start time is scaled back to just a single-tab “hot” start. Mobile OSes only load the active tab, and background tabs aren't loaded until they are made active. This makes the eight-tab start time irrelevant. Since tablets are usually never powered down unless they run out of battery, “cold” start times are also irrelevant.
Current mobile operating systems handle memory and multi-tasking in a very different manner than PCs, so the memory efficiency tests from the desktop are not needed, either. With the loss of the 40-tab memory test and the inability to load all tabs simultaneously, the page load reliability test cannot be conducted either.
We also lost plug-ins, so Flash, Java, and Silverlight aren't needed. WebGL was jettisoned too, since no mobile Web browser supports it yet.
Versus The iOS Web Browser Grand Prix
We lost WebVizBench and Psychedelic Browsing on Android, since the tests fail to run on too many browsers. However, JSGameBench makes a return as our hardware acceleration benchmark.
Sadly, we're all out of CSS performance tests: Kaizoumark will not run on several browsers, the CSS Stress Test & Performance Profiling is a bookmarklet and will therefore not work on Android, and Maze Solver still has serious issues with Firefox.
Test Setup And Benchmark Suite
|Test System Specs|
|Model||Asus Transformer TF300T|
|Operating System||Google Android 4.1.1 "Jelly Bean"Home Screen|
|Display||10.1" LED-Backlit WXGA IPS (1200x800)|
|Processor||Nvidia Tegra 3 (quad-core) @ 1.2 GHz|
|Graphics||Nvidia ULP GeForce|
|Memory||1 GB DDR3|
|Storage||32 GB eMMC Flash|
|Networking||802.11 b/g/n @ 2.4 GHz|
|Local Web Server Specs|
|Operating System||Ubuntu 12.04.1 LTS Server Edition "Precise Pangolin" (32-bit)|
|Processor||Intel Pentium 4 @ 2.41 GHz|
|Memory||768 MB DDR @ 333 MHz|
|Graphics||Nvidia GeForce FX 5500 128 MB DDR (AGP)|
|Storage||Western Digital Caviar SE WD1600AAJD, 160 GB EIDE, 7200 RPM|
|Extra Packages||Apache2, MySQL Client, MySQL Server, PHP5, PHP-GD, PHP5-MySQL, PHPMyAdmin, SSH, Node.js, NPM|
|ISP Service||Cox Preferred (18 Mb/s down, 2 Mb/s up)|
|Modem||Arris Touchstone Telephony Modem TM502G|
|Router||Linksys WRT54G2 V1|
|Page Load Time||Start Time (Yahoo! homepage, Cached)|
|Uncached Load Time (Eight Test Pages)|
|Cached Load Time (Eight Test Pages)|
|Apple SunSpider v0.9.1 (Google Mod)|
|Mozilla Kraken v1.1|
|Google Octane v1|
|FutureMark Peacekeeper v2|
|RightWare BrowserMark v2|
|DOM||Mozilla Dromaeo DOM Core|
|HTML5||GUIMark2 HTML5 (Three Tests)|
|HTML5 Canvas Performance Test|
|Impact HTML5 Benchmark|
|Mandelbrot Set in HTML5|
|Hardware Acceleration||Facebook JSGameBench v0.4.1|
|The CSS3 Test|
|Ecmascript Language test262|
Although applicable links are included in the table above, we've also created a delicious account dedicated to chronicling links to Web Browser Grand Prix benchmarks.
The Transformer, local Web server, and all software were updated as of midnight (Eastern Standard Time) on November 24, 2012. Detailed methodologies are explained on the individual benchmark pages.
- Web Browser Grand Prix: Android Circuit
- Chrome, Dolphin, Firefox, Maxthon, Opera, Sleipnir
- Test Setup And Benchmark Suite
- Load Times
- HTML5 Performance
- Hardware Acceleration Performance
- Responsiveness And Security
- Standards Conformance
- Final Placing And The Android Winner's Circle