The Engagement Machine

Platforms optimizing for engagement produced polarization, manipulation, and synthetic-media harms alongside connection — none written as an objective, all delivered by the gap between written and meant.

State it in decision vocabulary. The written utility: engagement time — measurable, optimizable, optimized. The unpriced outcomes: polarization, manipulation, degraded discourse — each carried zero weight in the objective, so the optimizer treated each as free, exactly as the unpriced column predicts. Nobody wrote "polarize"; nobody had to. The machinery pursued the stated number wherever the terrain allowed, and the unpriced outcomes were part of the terrain. The audit question that would have surfaced it before deployment is the checklist's ninth: whose utilities are being optimized, and were the affected represented — a question about the objective's authors, askable before a single knob descended. The case is the canonical deployed instance of the specification problem: not a malfunction, not a rogue system — an objective faithfully served.