What the ear cannot hear

Week 2 ended with a proposed explanation. This hour is about the difference between proposing one and testing it.

Loss designed to be inaudible

Perceptual coding does not try to keep the signal. It keeps the parts a model of the listener says will be noticed, and discards the rest.

From Jonathan Sterne, MP3: The Meaning of a Format (2012), chapter 1.

A codec is an argument about hearing, built into a file format.

A comparison that cannot answer it

One encoding cycle at 320 kbps: deviation score 0.3. Ten encoding cycles at 96 kbps: 9.8. Conclusion: ten encoding cycles cause a large loss.

The numbers are fine. The conclusion does not follow.

Two things changed

Cycle count: 1 → 10.

Bitrate: 320 → 96.

There is no way to divide the 9.5-point difference between them. This is not a subtle error — it is everywhere, because the two conditions were probably never designed as a comparison at all.

The repair

Change one thing. Hold everything else fixed.

One cycle at 128 kbps versus ten cycles at 128 kbps.

Bitrate constant; only the cycle count differs. Wednesday’s data: 3.2 points — roughly a third of what the confounded comparison implied.

Four things a protocol must state

  • The independent variable
  • The outcome measure
  • The control
  • What was held fixed

Leave any one out and a reader cannot tell what your result is about.

The number that matters most

You are reporting a difference between two conditions, so what governs you is how much that difference moves when the whole procedure repeats.

For us: 0.5 points.

A non-detection is a finding

Run the corrected comparison at 320 kbps: 0.4 points.

That is at or below repeatability — a non-detection, not a small difference. Reporting it as degradation would be reporting your own noise.

“We did not detect a difference” and “there is no difference” are different claims. Only the first one is yours.

Where that leaves the question

At 128 kbps: detectable. At 320 kbps: not.

A worse headline than “generation loss ruins everything,” and a better answer — conditional on a stated source, score, setting, scenario. Not a claim about MP3 in general.

The control, again

Ten copy operations, no encoder: scores zero.

A clean control does not prove the procedure is sound. It rules out one specific failure — that the procedure manufactures differences regardless of treatment. Run it first.