Discrete diffusion — but fast? ⚡️ Test-time inference — but for discrete data? 🧠
Categorical Flow Maps: continuous transport toward the simplex, turning discrete generation into a single-step problem. Built on Variational FM (CatFlow), we obtain (self-)distillation from scratch.
Language, molecules, and test-time steering — one framework.
Scaling to LLMs and foundation models next. Watch this space 👀
You like discrete diffusion, but it's too slow? 🥀
You like test-time inference, but it's for continuous methods? 😩
We fixed it.
Introducing Categorical Flow Maps: continuously sample discrete data in a single step 🚀💫
How? 🧵⬇️
💪 Co-led with
@FEijkelboom,
@daan_roos_