Skip to main content
Engineering

Your Job Is Building the Factory, Not Shipping the Part

·7 mins

For most of software’s history, the engineer was the part. You were measured by what came out of your hands: the pull requests, the features, the lines that shipped. That measurement is breaking. The unit of engineering value has moved up a level — from the output you produce directly to the system that produces output for you. The question is no longer “how much did you build?” but, as the framing goes, are you producing the factory that would produce multiplicative outputs?

This idea surfaced sharply in Naval’s “The AI Industrial Revolution”, which is the creative seed for this post. The conversation’s claim — that in idea domains the gap between engineers is 100x or 1000x, “and the world hasn’t fully adjusted to this” — is the kind of line that’s easy to nod along to and hard to verify. So let’s actually check it against what’s happening in the field, and where the metaphor leaks.

The factory model is real, and it has a name #

This isn’t just rhetoric. The “factory model” is a named, documented shift: senior engineers are moving from writing code to designing multi-agent pipelines, specification frameworks, and evaluation harnesses that generate code autonomously. The center of gravity has moved up the stack, from implementation to architecture (Addy Osmani). The same source reports concrete macro signals: new iOS app creation up roughly 50% and US GitHub code pushes up about 35% year over year.

The clearest instantiation is StrongDM’s three-person software factory, built in early 2026 under one blunt rule: code must not be written by humans. Their agents write specifications, generate the implementation, and validate it through an independent test harness; the three engineers build and monitor the factory itself rather than touching the code (Simon Willison). To make that work they built a “Digital Twin Universe” — behavioral clones of Okta, Jira, Slack, and Google — so the agents could run thousands of test scenarios an hour without hitting rate limits or real API bills.

That is the thesis made literal: three people built what used to take a much larger team. But read the fine print, because it’s the most honest part of the story. The factory cost roughly $1,000 in tokens per engineer per day — about $20,000 per developer per month (Simon Willison). The leverage is real; so is the meter running underneath it. And crucially, they had to design the factory first. Prompting harder wasn’t the move; building the production line was.

Does the 100x claim hold up? #

Partially, and the texture matters more than the number.

The historical variance is genuinely enormous. GitHub commit data across 200 major repositories shows the top 1% of contributors account for roughly 50% of all commits and 68.9% of lines changed (Brenden.io). That same piece cites “research from Microsoft and Google” suggesting elite engineers are up to 100x more effective — but it’s worth being precise here, because the citation chain is weaker than the headline. That 100x figure traces back through the source’s own footnote to DeMarco and Lister’s Peopleware (2013), a secondary book, not a published primary study from either company. Treat “100x” as a vivid directional claim, not a measured constant.

The peer-reviewed literature is more grounded and, in one way, more interesting. From Sackman et al. (1968) onward, studies consistently find spreads of 5x–25x between the best and worst performers — but that’s best-versus-worst, not best-versus-average, which means the 10x cliché actually understates the outlier effect at the very top (Jason Crawford). So the spirit of “100x or 1000x” is defensible for genuine outliers in idea domains. The slogan just shouldn’t be mistaken for a quantified finding.

There’s a second, subtler point in the brief that the podcast framing glides past: that extreme variance — Torvalds building Git in two weeks, Walke prototyping React in a weekend — describes idea-domain genius that predates AI entirely. Conflating that with AI-driven leverage is a category error, and it might cut the other way.

The counter-case: factories only help if you can already build one #

Here’s where a builder should get skeptical, because the evidence pushes back hard on the universal version of this story.

The gains don’t automatically reach the company. Faros AI’s analysis of real engineering data found individual developers merge 98% more PRs with AI — yet “no significant correlation between AI adoption and improvements at the company level,” with PR review time up 91% and bugs per developer up 9% (Faros AI). Speed up one station and the bottleneck just moves downstream to the humans reviewing the flood. The factory metaphor breaks precisely when only one station gets faster.

For experienced developers on familiar code, AI can be net negative. METR’s randomized controlled trial — 16 experienced open-source developers, 246 tasks — found they took 19% longer with AI, while believing they were 20% faster (METR). That perception gap is the part to sit with. By early 2026 so many developers refused to work without AI that METR’s follow-up became methodologically compromised — which tells you something about adoption, and not much about productivity.

AI amplifies the system, not the individual. The 2025–2026 DORA report (nearly 5,000 professionals) is explicit that AI amplifies the quality of the engineering system it operates within: strong teams get stronger, weak teams get slower (InfoQ). AI is not a leveler. Without mature practices and clean workflows, it accelerates technical debt, not output. You have to design a good factory before a factory helps you.

Reading the productivity numbers honestly #

The controlled trials are real but narrow. An early GitHub Copilot study clocked 55.8% faster completion on a specific JavaScript HTTP-server task (arXiv 2302.06590). Across four RCTs covering 4,000+ developers, throughput rose about 26% in PRs per week (InfoQ). At enterprise scale, Salesforce reported 75%+ Cursor adoption across thousands of engineers, a 30%+ PR-velocity increase, and double-digit cycle-time and quality gains (Cursor) — useful directionally, though those are vendor-reported figures, and the case study itself says “thousands,” not any specific headcount.

Set against that, the self-reports deserve a caveat the marketing decks omit. METR’s survey of 349 technical workers (run Feb–Apr 2026) found a median 1.4–2x value multiplier and a 3x speed multiplier — alongside the company’s own warning that prior experiments showed self-reports overestimate the effect by about 40 percentage points (METR). When the same outfit’s controlled trial found a negative effect, the gap between what people feel and what gets measured is the whole story.

The role itself is genuinely changing, too — just less dramatically than “100x” implies. The Pragmatic Engineer notes engineers are shifting from how to build to what to build, with context management and AI guidance becoming core skills (Pragmatic Engineer). That’s a real reorientation toward orchestration and intent. It’s also one bullet in a broader picture, not a measured majority verdict.

What to actually do #

Strip away the slogans and a concrete instruction survives. The leverage is real, but it lives in the factory, not the prompt — in the specs, the agent pipelines, and above all the evaluation harnesses that let you trust output you didn’t hand-write. The companies seeing org-level gains are the ones that built the production line first; the ones bolting agents onto a broken process are just generating debt faster.

So treat the 100x as motivation, not measurement. Build the harness before you scale the swarm. Watch your real bottleneck — usually a human reviewer drowning downstream — because speeding up one station while the next one floods is the failure mode the data keeps surfacing. The engineer’s job really is becoming the factory. Just remember that a factory is only as good as the person who designed it, and the meter is always running.