I myself didn't fully understand what the deepseek r1 hype was about, but at some point I realized where the mismatch in hype was coming from.
For many people with reinforcement learning knowledge, the o1 announcement was pretty clear. o1 was a model trained with reinforcement leaning to dynamically generate chain of thoughts, using verifiable rewards. I mean, I didn't know the details of their training recipe or anything like that. But the general strategy was pretty much implied by their blog post and release.
To those people, r1 is an open source reproduction of the same, implied, strategy, or at least, the first one that got really good performance. That is extremely valuable as an engineering contribution, but far from being an actual scientific breakthrough.
I came to learn that many other people, typically without a technical RL background, instead consider deepseek r1 the first model trained to reason with reinforcement learning and verifiable rewards, associating o1 to a possibly different paradigm (e.g., MCTS).
It's honestly a good reminder of how history (e.g., of science) can feel very different depending on your perspective
Looking back, I never understood the hype of the "deepseek moment" from last year. Distilling others' models is possible and easier than pushing the frontier. Like, nobody remembers Alpaca?