How We Test Gaming Headsets

How We Measure & Compare

We start with a brief look at the hardware used, and then proceed to a description of our measurements and measurement rooms:

Test System & Hardware
MicrophonesNTI Audio M2211 (with calibration file, low cut at 50 Hz)
Shure Beta 181/C (artificial head, with calibration file)
HardwareSteinberg UR12 (with phantom power for microphones)
Creative X7 (analog output for active systems or as an amplifier for passive loudspeakers)
Passive PC and monitor
SoftwareArta, Smaart v.7
EnvironmentalCustom-made proprietary measurement chamber, 3.5 x 1.8 x 2.2m (L x D x H)
MeasurementsNear-field (0-12cm, primarily Bluetooth speakers)
Approximated free-field measurement (1m)
15°/25° rotated, side measurement
Measurement using artificial head for headphones and headsets

Our custom-made chamber allows us to measure everything from graphics cards, loudspeakers, and headphones, to computer cases and fans. Its implementation is quite unusual: we built a room inside of a room. If you're imagining a large freight elevator, then you're on the right track. The cabin weighs just under four tons, is quite spacious, and torsionally rigid. It has a double-walled design and is filled with polyurethane foam. The only direct contact to the outside world is where it rests on dampeners. Since the doors are not quite as good as the other walls, despite their thick inner cladding, we built an additional frame on rollers filled with special foam that completely and hermetically seals the opening, shielding it from the outside world.

In addition, we lavishly clad this room in several layers. The bottom layer consists of a dense foam applied to the ceilings, walls, doors, and flooring. On top of that, we used a special pyramid-shaped foam on every surface except the floor. Down there, you'll find one layer of very soft grid plates, topped by a thick layer of felt.

Another room right next to our measuring chamber allows us to control all of our tests externally. Thanks to a special cable duct in the measuring room, we have a wide range of connection options at our disposal. This includes a microphone cable, an additional stereo NF cable, speaker cable, HDMI and USB, as well as an optional 230V connection for active speaker systems.

Headphone And Headset Tests: What Is An Artificial Head?

Evaluating headphones and headsets requires a slightly more complex environment than loudspeakers. The positioning of the earpiece on the auricle, how well the pieces close around the ear, and the distance between sound source and microphone (and their directional characteristics) play a major role.

To get a reasonably reliable measurement is quite complicated. That's why, for stereo recordings, we use a homemade artificial head that imitates the properties of a human. Our microphones are placed inside the auricles.

More specifically, we're using two Shure Beta 181/C mics in a wax-like plastic cast head. Their linear frequency response is very convincing when recording indoor sound, even though these small microphones were originally intended for pure instrument recordings.

A particularly beneficial property is their distortion-free recording of high levels, which is just what we need for headsets. The necessary corrections are provided by a calibration profile that we prepared especially for this purpose.

We would like to point out that our measurements of loudspeakers, headphones, and headsets are, as a result of our technical capabilities, merely semi-professional.
While the results are fully sufficient for an objective assessment of our test objects, they cannot match data generated by highly professional (and much more expensive) equipment that manufacturers and test laboratories use. However, as a general guideline, they should certainly be quite useful.

Music For Evaluating Frequency Ranges, Precision, And Spatial Representation

Instead of hi-fi jargon like thundering bass, delicate strings, and huge sound stage, we're focusing on a theoretical introduction to genre-relevant frequency ranges and the basics of spatial hearing.

AnalysisTitle / Source
Lowest/Low Bass (Range)J.S. Bach - Toccata and Fugue in D Minor (FLAC, vinyl rip)
Tchaikovsky - Festival Overture in E Major (FLAC, vinyl rip)
Avatar (Blu-ray, effect track)
Bass QualityTill Brönner - It Never Entered My Mind (CD)
Blue Man Group - The Complex (CD)
Kid Cudi - Day and Night (The Widdler's Dubstep Remix, CD)
Spatial ResolutionClapton Unplugged (CD)
Dire Straits - Brothers in Arms (CD)
Gershwin - Concerto in F (FLAC, vinyl rip)
Precision Of Instruments And VoicesBrahms -String Quartet No.1, Op.51 No.1 (FLAC, vinyl rip)
Bach - Christmas Oratorio Cantata VI (Thomaner-Chor, vinyl rip)
Gershwin - Concerto in F (FLAC, vinyl rip)
Dynamics and level stability:Carl Orff - Carmina Burana (CD)
Mike Oldfield - Tubular Bells III  (FLAC, vinyl rip)
Maurice Ravel - Boléro (FLAC, vinyl rip)

MORE: Best Deals

This thread is closed for comments
21 comments
    Your comment
  • the nerd 389
    In the article, you say that headphones always create the perception that the source is right at the head. This is incorrect. Newer techniques use either binaural recordings or HRTF approximations to reproduce entire auditory spaces.

    When employed correctly, these techniques allow for a more accurate reproduction of an environment than is possible with speakers.

    If surround headphones employ those techniques, the result is true 3D sound (two angles, as well as distance). That said, the technology needed to pull this off in real time is still a few years away. For now, binaural recordings are the only way to achieve this effect in practice.

    Finally, you should probably disclose the output impedance of your sources. Many headphones have drastically different frequency and phase response between low impedance and high impedance sources. The effect is most pronounced with low impedance headphones, like most gaming headsets (<64 ohms). Motherboards and sound cards usually have a high output impedance (10-100 ohms), while decent headphones amps have low impedance (<2 ohms).
  • Spanky Deluxe
    I just don’t get Tom’s Hardware sometimes. They go out of their way to make top quality articles with great testing methodologies but at the same time make the website absolute garbage to use with half the stuff covered in abnoxious adverts, a terrible UI experience and then even more adverts for even worse stuff that is blatantly obviously scam sites like “How local <ISP LOCATION AREA> housewife earns $15962 per month from home” and the like. Sometimes adverts even stop you reading an article on mobile, i.e. actually block you pressing the next page button. I hardly ever read articles anymore here despite being a visitor for about 20 years as it’s just too much hard work to wade through the website design and adverts everywhere.
  • icycool_q1
    Completely agree Spanky, I am coming here less and less because of the huge video playing throughout almost every article. In addition to that, I have very poor internet and it takes considerable time for this crap to even load. Hell, I'd be happy to pay them $5/year just to have NONE of this extraneous rubbish.
  • Co BIY
    Tom's reviews headsets?

    No category under peripherals ? and I don't remember a recent review.
  • FormatC
    This is the intro review to understand, what we test and how. The headset reviews will follow soon. I'm testing headsets for the German site since a few years (my latest). I think, it is a good compromise for the masses to get more info and to understand, what we write. Not too flat like an unboxing video on YT and and not too in-dept like for the golden ears. ;)

    Quote:
    Finally, you should probably disclose the output impedance of your sources.

    If measure with an good external amp, not on an onboard output. But with exception of a few pilot headsets I wasn't able to find a gaming headset above 32 ohms.

    Quote:
    Newer techniques use either binaural recordings or HRTF approximations to reproduce entire auditory spaces.
    As I wrote in the review, all this techniques are using your brain (and experience) to produce this immersion. But it doesn't help to make a bad headset better or to hear "more". ;)
  • hannibal
    I agree the article. I have always have good Hi-Fi speakers and headphones. Many years back I did Also buy Gaming headset (expensive one) and used it a while and was deeply dissapointed by the sound quality. Did go back to old music Hi-Fi headphones and was much more pleased and the next time I did upgrade my music system I did by the best Hi-Fi music headphones that I could afford at that moment and have been really pleased the sound quality.
    Good bass even in low volume, good balance at low volume, same when you increase the volume upp. So balanced and straight linear sound in all situations!
    The multidriver system is interesting, but very difficult to make right. Have to check out some uber models From Senheiser and othe big audio manufacturers to see how well They can do it with their best systems.
  • the nerd 389
    @FormatC

    I didn't mean to imply that you should measure with a low impedance source. Quite the contrary, actually. Most people don't have headphone amps, so it doesn't make sense to measure with one if that's your audience. All I meant was that the output impedance has a substantial impact on how headphones measure, so it's worth disclosing. It only takes a few minutes to measure if you have a decent multimeter and a couple of resistors lying around.

    Your Creative unit should have an impedance between 10 and 50 ohms. That's a big enough range that it's a pretty notable amount of uncertainty in any measurements you do with it, though. It's worth mentioning that of the units I've measured, I've found almost no difference in output impedance between onboard audio and gaming-oriented sound cards. Even the external ones usually have at least 10 ohms of impedance.

    Regarding the binaural and HRTF techniques, it's not really fair to say that they use the brain/experience to produce the effect. They simulate a physical phenomenon that occurs when sound hits the outer ear and head. You can even measure the effect (assuming you can sit still long enough).

    The wording you chose is akin to saying "the lights in your room allow you to see using your brain/experience to allow you to perceive objects." Again, it's not technically incorrect, but it's not really going to help anyone understand it any better. Also, I wouldn't mention it except for the fact that the HRTF is likely going to become a major factor in mainstream audio in the next few years. It's already used in some high-end audio solutions, and it's expected to be a major ingredient in the next phase of VR.
  • FormatC
    I'm building audio systems since 1979 and I followed in the past each trend to understand (or very often not), what the industry and their PR tried to sell us. I'm visiting a lot of meetings and workshops and it is every time very interesting to hear, what scientists, engineers and medicals said. Alone the inner structure of a human ear is so complex, that we can found thousands of variances of a different spatial immersion. For one person this fakes are working well, for others not. Or simply different. I also saw a lot of blind tests and the results were every time within the statistic. A good 50:50 for stereo vs. artificial sound manipulations.

    What I would say with this small story is:
    Never believe, what the industry said. This is (mostly) pure PR and the utilization of the term Gaming, only to sell their low-end more expensive, is pure nonsense. Stickers and audio labels are nonsense too. Money makers. Good audio hardware can cost a lot of money but our job must it be in the first row, to find the the better pieces between all this crap. What we will do is a thing in the middle of this mostly senseless unboxing YT videos and the Hi-Fi magazines. Call it science for the masses. But we have in each case to take care, that we will stay understandable for all readers. Not so easy... ;)

    BTW: The Creative amp is running between 10 ohms and 600 ohms not bad. But I'm trying each headset also onboard (if it is not USB) to see, how it performs. I'm worked together with MSI for example to improve their mainboard audio solutions and a lot of other companies have now a bigger focus at the audio part of their mainboard design (components, positioning). This was also a follow of my investigations of all this VGA-related influences ("you can hear what you see") and the mainboard layout. The fact, that you can see now on a lot of VGA cards low pass filters for all rails is a direct follow of this work. Together with improved PSUs... ;)
  • JonDol
    228842 said:
    ... it’s just too much hard work to wade through the website design and adverts everywhere.


    There are already long years since AdBlockers became mandatory on THW in order to have a pleasant reading experience. Don't wait anymore before installing a few (not only one since some of them have agreements with ad networks and sneakily whitelist some ads to let them reach you). I personally have at least 3 AdBlockers on every web browser I use.
  • Virtual_Singularity
    1584361 said:
    Completely agree Spanky, I am coming here less and less because of the huge video playing throughout almost every article. In addition to that, I have very poor internet and it takes considerable time for this crap to even load. Hell, I'd be happy to pay them $5/year just to have NONE of this extraneous rubbish.


    Hmmm... Totally, agree. Save for the $5 a year part. =P

    Edit: Good article all the same, as it's an area Tom's hasn't breached much, at least yet, as far as I've seen (or heard). Like the contributor with the outstanding DL/UL speed in the sig hints at: "not too flat like an unboxing video, and not too in depth like for the golden ears". I like that description. Though I personally wouldn't mind a "golden ears" type of review. But then, that'd likely remove or disqualify most gaming headsets from the topic altogether, along with readers? Though just so Tom's knows, some of us would indeed take the time to read the in-depth, "golden ears" stuff. I grew up in the analog world and usually still prefer it, maybe. Ha.
  • JonDol
    482859 said:
    Call it science for the masses. But we have in each case to take care, that we will stay understandable for all readers. Not so easy... ;)


    This is an unfortunate approach IMO as some readers will never understand everything (you already know this, that's way your 'Not so easy ;)' I suppose). As for all the knowledge, in general, the understanding comes in succesive layers so you should not fear to write articles for those that already have the necessary first layers. And you shall not forget that THW's readers are among the most knowledgeable hardware geeks out there and again, don't be afraid to challenge their understanding.
  • FormatC
    If only some... I will be very satisfied. ;)

    This is a long, long process of educating the vendors. I remember our first steps in 2014 and after longer discussions with manufacturers and brands we saw the first better solutions on the market (QPad QH90/85 and Kingston HyperX CloudX). Both are based on normal stereo headphones from Takstar (the same OEM, producing the cheaper models for a few big players). And the resonance between the people in the forums was awesome. So I'm optimistic to establish a new quality thinking. It is not impossible to produce good headsets below 100 USD and make profit with it. I visited a few suppliers and know the costs for a good headset ;)
  • jp182
    $5 per year from the few who would be willing to pay it would not be a replacement for the ad revenue Toms generates.
  • icycool_q1
    $5 Well, if it saves me grief, and they don't lose me as a reader, I'm ok with that!
    Afterall, we all have accounts to post, so said logged in accounts could be easily made ad-free with a minimal of effort.

    @FormatC:\, I am guessing this is a leadup to Ossic X, I'm still waiting for mine, but dev kits are going reaching people soon I expect.
    While ur there.. Logitech G940 and Steelseries Arctis 7 please :D
  • derekullo
    If you want an ad free Tom's experience look no further than:

    Adguard DNS
    https://adguard.com/en/adguard-dns/overview.html#overview

    Custom hosts file to block malicious and bad sites
    http://winhelp2002.mvps.org/hosts.htm

    AdBlock+

    Noscript
    Works with the new Firefox.


    I love Tom's and have been reading it since my first year of high school, but these ads are getting out of control ... I've heard.
  • FormatC
    1584361 said:
    While ur there.. Logitech G940 and Steelseries Arctis 7 please :D
    You mean the G930? My problem: since I'm testing it more in-depth, a few companies stopped to send their samples to me. The delivering of samples is... call it award-dependend. For such companies it makes more sense to send their crap things to the influencers and unboxers. Same reach, but the result can be better planned. The Arctis is ok, the Logitech is a boom boom plastic bomber. :D

    The Ossic X, yeah... I think, it's a bit overhyped. The 3D tracking works, nice for VR. But music in 3D-mode must be horrible. A colleague tested it this year on CES and was not really impressed. For 300 EUR I get a good pilot headset. For VR I can use the Rift for tracking. It's a nice experiment and if you get your own, please report... :)

    @derekullo:
    This is a script hell. Yes. I'm working mostly with an optimized hosts file and a second DNS service. It helps. Adblock Plus is similar to adware, paid by companies to let their ads pass trough. They call it white list, I call it paid content :(
  • icycool_q1
    Thanks FormatC:, Apologies for the G940, I have not used for sometime, they are actually G933, subjectively they sound better than the G930 to me, but the gaming crap software they come with and the generally unprofessional looks makes me annoyed. The 930s were so much better in every regard (except sound and structural integrity).
    I appreciate your honesty about companies not being too willing to share things for you to disintegrate with logic and researched testing. You can't blame them, but you can certainly blame them for making shit in the first place.
    Ossic X is hopefully a decent product, and hopefully it's everything promised. No doubt you will get your hands on a complete final release product and share some non-hyped information to us casual users! :)
  • FormatC
    I'm open for all ;)
  • Aris_Mp
    Good work there Igor! As usual :) You didn't mention that you also have this gear :D
    Looking forward to your reviews!
  • mlee 2500
    This is all great but where can I find actual REVIEWS of gaming headsets on Tom's Hardware? I'm in the market for one but a cursory navigation around the site doesn't reveal much, and there is certainly no "category" for them.
  • FormatC
    Currently in translation and coming soon also here, I have tons of reviews on the German site. :)