After AGI, the scarce resource isn't intelligence. It's verified knowledge of the physical world.
@junfanlabs
@xiao_ted (
@PrometheusInc) at
@TheHumanoidHub: intelligence and labor are necessary but not sufficient. Progress follows verification, and it must scale to the actual test distribution 👇
1️⃣ Amdahl's Law for innovation: S = 1/((1−p) + p/s). Even if AI accelerates 99% of the work, the ceiling is 100×. Only shrinking (1−p) raises it: slow tests (drugs ~10.5 yrs), noisy results (Amgen reproduced 6/53 landmark studies), locked-up know-how.
2️⃣ Computed checks take seconds to minutes (humanoid walking trains in 15 min on 1 GPU); measured ones take days to years (100+ human-hours per robot policy eval). The gap is structural, not a temporary software deficit.
3️⃣ Cheap exact verifiers → IMO gold, ICPC 12/12. Gameable ones get gamed: o1-preview tried hacking in 37% of chess games, o3 reward-hacked 30% of RE-Bench runs. Post-training optimizes for the game, so verification is its ceiling.
4️⃣ Locomotion has a fast, parallel, high-fidelity sim. Manipulation needs contact-rich real-world data: QT-Opt 800 h → π*0.6 10k+ h → GEN-1 500k h (wearables) → Dyna-2 1M h (human video). Offline data can be built from scratch; on-policy runs are the hard part.
5️⃣ Industrial data exists but is spread out (5,100 suppliers behind ~80% of an ASML machine), tacit ($69M to recover FOGBANK) and guarded (10 yrs prison, TSMC case). Web-scale collection doesn't transfer.
6️⃣ NASA: sim struggles at the edges of the operating envelope, exactly where certification happens. Proxy success ≠ physical viability: 95.9% on BenchCAD, yet only 18% of generated CAD passes engineering checks.
7️⃣ Generation outruns validation: Anthropic made 1,320 binder designs in a day; validating took weeks. Experiments parallelize; knowledge stays sequential.
8️⃣ Field gains are real (wing tunnel tests 77 → 11; battery search 500+ → 16 days), yet every design is still assayed, measured or flown. Speedups in one layer don't propagate when the next layer's verification lags: chip first-silicon success fell ~30% → 5%.
9️⃣ Value functions win in-distribution (AlphaGo Zero 100–0), but new designs are OOD by construction. Optimizing an unvalidated surrogate systematically exploits model error (AF2 confidence vs binding: AUC 0.64).
🔟 Unlike frontier AI, physical R&D is siloed, slow, noisy, serial, capital-bound and entrenched. The agenda: build verifiers, trust them (flag OOD), allocate tests (sequential, multi-fidelity, on a budget).
What it takes: tests need equipment → capital. Data sits in firms → deployment (flywheels aren't optional). Loops take years → focus (long horizons, full stack, pain tolerance). Bad checks get benchmaxxed → measure real-world impact.
Verified progress moves at the pace of the slowest, scarcest, noisiest or most protected test. Generation is abundant; verification is the bottleneck.