Editor's Note: In 1985 and 1986, an argumentative thread ran through Stereophile's pages, discussing the benefits or lack of double-blind testing methods in audio component reviewing, triggered by J. Gordon Holt's review of the ABX Comparator. As this debate is still raging nearly 15 years later, we present here the entire discussion that bounced back and forth between the magazine's "Letters" section and features articles. It was kicked off by a letter from C.J. Huss that appeared in Vol.8 No.5.—John Atkinson
A tradition is anything we do, think, or believe for no better reason than that we have always done it, thought it, or believed it. Most traditions are followed in this mindless and automatic way, and, if questioned, are defended with the argument of, well, that it seems to work. It's time-tested, true-blue and, because so familiar, as comfy as an old slipper. So why rock the boat, throw a wrench in the works, or fix it if it ain't broke.
A number of recent letters have accused us of snobbishness and elitism because we devote so much space to reports about components that "common folk" can't afford. We are "snobbish" because we seem to look down on anything less perfect than a Wilson WAMM speaker system or an Audio Research SP-10 preamplifier. And we are "elitist" because we seem to show little interest in any components which fall short of state of the art. Far from being chastened by these letters, I am proud, to declare that they are right on target.
This issue contains a report on a truly ingenious little device called the ABX Comparator, which takes the fraud out of subjective testing. It does this by making its own selection of source A or source B for each listening trial, without telling you which was selected. Only after all the tests will it reveal what you were listening to each time. "Score" sheets are provided so you can list your guesses, compare them with the cold, uncompromising truth, and file the results for posterity. Or better still, for the first hard evidence that has ever been presented that a lot of people can hear differences that cannot as yet be measured.
101 years ago, the tinfoil cylinder started it all. Within 22 years, its heyday was done, and public support swung to favor the then-new wax-mastered disc. 1948 saw the switch to a slower speed and a finer groove, but the flat disc, traced by a stylus, has held sway for almost 80 years now. Even today, people with multi-speed turntables and a couple of arms (or plug-in cartridges) can reproduce from a single phono unit the earliest or the latest discs merely by the flip of two switches (for speed change and cartridge change). All that is about to come to an end.
In 1960 the high-fidelity field was in a period of stasis. The hi-fi boom was starting to crest out, and there were three magazines for audiophiles: High Fidelity, Stereo Review, and Audio. The first two were (and still are) little more than vehicles for their advertising, more dedicated to promoting their advertisers' wares than in advancing the state of the art. Audio was more into equipment testing than either of the mass-hi-fi magazines, but it too was contributing to the stagnation by listening to its test results rather than to the components.
These diminutive little sleepers have been available in the US for quite some time but have attracted little attention because (1) they have never really been promoted and (2) they are just too small to look as if they could be worth $430 a pair.
Hey, kids, here's the Big News. We've been deluding ourselves all along, worrying about piddling little bits of distortion that we can't hear at all. How's your preamp distortion? 1% at 1 volt out? You have a perfect preamp—a veritable straight wire with gain! That ear-shattering shrillness is all in your mind, because it has now been demonstrated that the human ear cannot perceive distortion levels of less than 6–12% on "normally complex music." If you think you can hear 0.1%, you are deluding yourself.