Dan Luu on cheap agent-driven performance work

Coding agents lower the human-time cost of bounded performance experiments, which changes which optimizations are worth trying and who can attempt them.

Logged at IST: 2026-08-30 18:12 IST

What it is: Dan Luu's essay arguing that coding agents make many kinds of performance optimization cheap enough to become routine, shared by Bilgin Ibryam.

Gist: Luu's claim is not that agents can blindly optimize software correctly. It is that the cost of trying bounded optimizations has dropped by orders of magnitude in human time. Work that used to need a rare performance specialist for days can now often be attempted by giving an agent a benchmark, letting it make changes, and measuring the result.

The examples are concrete: agent-assisted regex and ripgrep experiments, workload-specific optimization, a game AI where speedups materially improve strength, and even frontend performance cleanup. The interesting shift is economic. Once implementation and verification tedium get cheaper, it becomes rational to try many more small or uncertain optimizations.

The caveat is the useful part. Agents still overfit, make incorrect changes, and are weak at open-ended experimental design. The human job moves toward setting up benchmarks, holdout sets, replay/debug harnesses, and deciding which performance wins are actually worth shipping.

Newsletter angle: Strong developer-tools/systems item: performance work may move from rare expert labor to cheap agent-driven experimentation, with humans providing measurement design and judgment.