Which Web Browser Should You Run On Your Android Device?

Test Setup And Benchmark Suite

Versus The Desktop Web Browser Grand Prix

As we stated in our exploration of iOS-based Web browser performance, much of the desktop benchmark suite had to be dropped from mobile testing. Let's quickly recap the losses.

Start time is scaled back to just a single-tab “hot” start. Mobile OSes only load the active tab, and background tabs aren't loaded until they are made active. This makes the eight-tab start time irrelevant. Since tablets are usually never powered down unless they run out of battery, “cold” start times are also irrelevant.

Current mobile operating systems handle memory and multi-tasking in a very different manner than PCs, so the memory efficiency tests from the desktop are not needed, either. With the loss of the 40-tab memory test and the inability to load all tabs simultaneously, the page load reliability test cannot be conducted either.

We also lost plug-ins, so Flash, Java, and Silverlight aren't needed. WebGL was jettisoned too, since no mobile Web browser supports it yet.

Versus The iOS Web Browser Grand Prix

We lost WebVizBench and Psychedelic Browsing on Android, since the tests fail to run on too many browsers. However, JSGameBench makes a return as our hardware acceleration benchmark.

There was no need to substitute the GUIMark2 HTML5 Vector Charting tests with GUIMark3's Vector Test, as we did on the iPad. In an odd reversal, the GUIMark3 version crashes on most Android browsers. We did, however, need to scrap the Bitmap Gaming portion of the test, as well as the Asteroids HTML5 Canvas 2D & JavaScript benchmark because Dolphin has issues running those tests.

Sadly, we're all out of CSS performance tests: Kaizoumark will not run on several browsers, the CSS Stress Test & Performance Profiling is a bookmarklet and will therefore not work on Android, and Maze Solver still has serious issues with Firefox.

Test Setup And Benchmark Suite

Swipe to scroll horizontally
Test System Specs
ModelAsus Transformer TF300T
Operating SystemGoogle Android 4.1.1 "Jelly Bean"

Display10.1" LED-Backlit WXGA IPS (1200x800)ProcessorNvidia Tegra 3 (quad-core) @ 1.2 GHzGraphicsNvidia ULP GeForceMemory1 GB DDR3Storage32 GB eMMC FlashNetworking802.11 b/g/n @ 2.4 GHzLocal Web Server SpecsOperating SystemUbuntu 12.04.1 LTS Server Edition "Precise Pangolin" (32-bit)ProcessorIntel Pentium 4 @ 2.41 GHzMotherboardBiostar P4M80-M4Memory768 MB DDR @ 333 MHzGraphicsNvidia GeForce FX 5500 128 MB DDR (AGP)StorageWestern Digital Caviar SE WD1600AAJD, 160 GB EIDE, 7200 RPMExtra PackagesApache2, MySQL Client, MySQL Server, PHP5, PHP-GD, PHP5-MySQL, PHPMyAdmin, SSH, Node.js, NPMNetwork SpecsISP ServiceCox Preferred (18 Mb/s down, 2 Mb/s up)ModemArris Touchstone Telephony Modem TM502GRouterLinksys WRT54G2 V1Benchmark SuitePage Load TimeStart Time (Yahoo! homepage, Cached)Uncached Load Time (Eight Test Pages)Cached Load Time (Eight Test Pages)JavaScriptRIABench JavaScript (Eight Tests)Apple SunSpider v0.9.1 (Google Mod)Mozilla Kraken v1.1Google Octane v1FutureMark Peacekeeper v2RightWare BrowserMark v2DOMMozilla Dromaeo DOM CoreHTML5GUIMark2 HTML5 (Three Tests)HTML5 Canvas Performance TestImpact HTML5 BenchmarkMandelbrot Set in HTML5Hardware AccelerationFacebook JSGameBench v0.4.1Standards ConformanceHTML5Test.comThe CSS3 TestEcmascript Language test262Facebook ringmarkSecurityBrowserscope Security

Although applicable links are included in the table above, we've also created a delicious account dedicated to chronicling links to Web Browser Grand Prix benchmarks.

The Transformer, local Web server, and all software were updated as of midnight (Eastern Standard Time) on November 24, 2012. Detailed methodologies are explained on the individual benchmark pages.

TOPICS
  • mayankleoboy1
    "Stock Android Browser" is a myth. There is NO "Stock" android browser.
    Each device manufacturer (Samsung, Asus, Lg, HTC) customise/modify the "stock" browser to match the SoC, the TDP, power saving, and specific browser benchmark targeted, for that device.

    So this "Stock" browser is actually a modified browser, customised by ASUS to work better with a Tegra3 SoC, in some specifc benchmarks which Asus thinks are more important than others. Its not a representative of all android devices.
    Reply
  • mayankleoboy1
    Sunspider and Kraken are crap benchmarks. All browsers target these benchmarks for specifc optimisations, that are never actually used on the web.
    Reply
  • aznshinobi
    9539316 said:
    "Stock Android Browser" is a myth. There is NO "Stock" android browser.
    Each device manufacturer (Samsung, Asus, Lg, HTC) customise/modify the "stock" browser to match the SoC, the TDP, power saving, and specific browser benchmark targeted, for that device.

    So this "Stock" browser is actually a modified browser, customised by ASUS to work better with a Tegra3 SoC, in some specifc benchmarks which Asus thinks are more important than others. Its not a representative of all android devices.

    When you're running a Nexus device, it's a stock browser...
    Reply
  • adamovera
    mayankleoboy1Sunspider and Kraken are crap benchmarks. All browsers target these benchmarks for specifc optimisations, that are never actually used on the web.SunSpider is the next to go for sure, but I haven't heard a ton of criticism regarding Kraken yet. Between BrowserMark, Peacekeeper, and RIABench, we could withdraw all the vendor-developed JS tests.
    Reply
  • tiret
    give me a browser with flash support then we'll talk
    Reply
  • mayankleoboy1
    ^ coming soon to firefox. Project Shumway.
    Reply
  • tiret
    ^ interesting. lets hope it works out... my gf is rather pissed that she can't play farmville on my galaxy tab.
    Reply
  • fwupow
    I've already figured out that Chrome isn't so hot, but the reason why Chrome still wins for me is that it synchronizes bookmarks, passwords, history and a bunch of other stuff across all my computers and devices. That is an indispensable feature for me.
    Reply
  • wildkitten
    tiretgive me a browser with flash support then we'll talkSince Adobe themselves has ended Flash development for all mobile platforms, I don't think you will see many browsers keeping support for it for long. Likely in a year, maybe 18 months, you won't see any support for Flash as, well, what's the point.
    Reply
  • Firefox Beta has flash support once you download and install the flash apk - I have it working well on my Nexus 7
    Reply