Sign in with
Sign up | Sign in

Test Setup And Benchmark Suite

Chrome 27, Firefox 22, IE10, And Opera Next, Benchmarked
By

Our test hardware underwent some significant changes since Web Browser Grand Prix: Chrome 25, Firefox 19, And IE10. We're now on an Ivy Bridge-based Core i5 rig, upgraded from the equivalent Sandy Bridge parts. Our cable modem and ISP speeds are also better than last time. For now, the Web server and router remain the same, though both should be new by the next time we do one of these stories.

Our benchmark suite is also changing. First, that 40-tab workload in our memory tests is now timed using a stopwatch, and contributing to our overall wait time score (start-up and page load times).

Moving on to JavaScript, after we retired SunSpider from the test suite, WebKit updated the long-believed-abandoned JS performance test. We'll be running the newly-released SunSpider v1.0 to see if this benchmark's issues with Internet Explorer have been resolved.

KaizouMark makes a return now that IE9 is no longer in the mix, finally providing us with a long-overdue CSS3 performance test.

The final massive change to the benchmark line-up is in Hardware Acceleration. Both native HTML5 HWA and WebGL swapped out an old test for a newer one. First, we say goodbye to Psychedelic Browsing, and hello to CanvasMark 2013. Next, Airtight Interactive's WebGL Demo gets benched in favor of LUIC Cubes, a more intense metric that should be useful longer.

Test Setup And Benchmark Suite

Test System Specs


Operating System


Microsoft Windows 8 Enterprise (64-bit)

Processor
Intel Core i5-3570K @ 4.2 GHz (quad-core)
Motherboard
Gigabyte GA-Z77X-UD5H (rev 1.0, F14 BIOS)
Memory
16 GB Crucial DDR3 @ 1600 MT/s (4 x 4 GB)
Graphics
Gigabyte GeForce GTX 660 Ti 1 GB GDDR5 (PCIe 2.0 x16)
Storage
Seagate Barracuda 7200.12 500 GB SATA II 3Gb/s, 7200 RPM, 16 MB Cache
Optical
Asus DRW-24B1ST/BLK/B/AS
Power Supply
Corsair TX750W (750 W max)
Case
Zalman MS-800 Plus
CPU Cooler
NZXT Kraken X60 (closed-loop liquid cooler)
Monitor
AOC E2752Vh 27-inch LED (1920x1080)
Keyboard
Logitech Wireless Keyboard K320
Mouse
Logitech Wireless Trackball M570

Local Web Server Specs


Operating System
Ubuntu 12.04 LTS Server Edition "Precise Pangolin" (32-bit)
Processor
Intel Pentium 4 @ 2.41 GHz
Motherboard
Biostar P4M80-M4
Memory
768 MB DDR @ 333 MT/s
Storage
Western Digital Caviar SE WD1600AAJD, 160 GB EIDE, 7200 RPM
Extra Packages
Apache2, MySQL Client, MySQL Server, PHP5, PHP-GD, PHP5-MySQL, PHPMyAdmin, SSH, Node.js, NPM

Network Specs


ISP Service
Cox Preferred (18 Mb/s down, 2 Mb/s up)
Modem
Cisco Telephony Modem DPQ3212 (DOCSIS 3)
Router
Linksys WRT54G2 V1

Benchmark Suite


Startup Time
Cold Start Time (Google SERP, Cached)
Hot Start Time (Google SERP, Cached)
Cold Start Time (Eight Tabs, Cached)
Hot Start Time (Eight Tabs, Cached)
Page Load Time
EEMBC BrowsingBench
40-Tab Load Time (Top 40 Websites)
JavaScriptRIABench JavaScript (Eight Tests)
Futuremark Peacekeeper v2.0
Rightware Browsermark v2.0
JSBench
WebKit SunSpider v1.0
DOMMozilla Dromaeo DOM (Core)
HTML5
Principled Technologies WebXPRT CP1
Impact HTML5 Benchmark
Hardware Acceleration
Facebook JSGameBench v0.4.1
HTML5 HWA
WebVizBench
CanvasMark 2013
WebGLLUIC Cubes
Scirra WebGL Performance Test
Memory Efficiency
Memory Usage (Single Tab)
Memory Usage (40 Tabs)
Memory Management (-39 Tabs)
Reliability
Proper Page Loads
SecurityBrowserscope Security
Standards ConformanceHTML5Test.com
The CSS3 Test
Ecmascript Language test262

While applicable links are included in the table above, we also have a public delicious account dedicated to Web Browser Grand Prix benchmark links. Detailed methodologies are explained on the individual benchmark pages.

We've highlighted Opera Next in the charts to emphasize that it's still in development and not part of the usual WBGP line-up.

React To This Article