Teaching LLMs to think ahead; Learning about ML since 2017

Replying to @karpathy
@karpathy did a great job with auto researcher. Using a similar harness AI is able to build a @risc_v CPU better than humans using @YosysHQ: github.com/FeSens/auto-arch-…
3
124
CPU demand for agents is real. I my experience 6x more flops are needed than before. Before I had one MacBook and was happy. Now I have 2 MacBooks, 2 Desktop PCs, 1 server with 20 cores and 128GB or Ram and it still not enough. The agent demands more.
1
29
Fsbonetto retweeted
AI agents designed hardware that runs Qwen on an old FPGA github.com/FeSens/openTPU. @aviflombaum sees a bigger story: what tiny, fast AI hardware could mean for medical devices.
1
1
3
78
I just ran an LLM on an FPGA. Now I'm wondering: how far are we from building our own TPU? Not in simulation. Not on a GPU. On a real Xilinx Kintex-7 FPGA with 4GB RAM. A few days ago, I came across openTPU, an open-source AI accelerator project created by Felipe Sens Bonettoe with the help of AI agents. The idea was too interesting to leave on GitHub. So I decided to put it to the test. 🔧 From GitHub to real hardware: → Connected the FPGA board to MINISFORUM PC via PCIe → Configured the hardware → Built the software stack → Brought up the DMA drivers → Loaded real model weights → Started testing inference And it actually worked. ✅ FPGA hardware detected and initialized ✅ PCIe DMA communication working ✅ Memory subsystem operational ✅ Hardware self-tests passing ✅ Real LLM inference running, including Qwen The most interesting part wasn't the performance. It was realizing that you can take an open-source accelerator architecture, bring it onto real hardware, and start experimenting with your own AI inference engine. Of course, this isn't an H100 competitor. And an FPGA prototype is still a long way from a production ASIC. But that's exactly why I find it exciting. 🔬 What's next? A few years ago, building your own AI accelerator sounded like something only a semiconductor company could attempt. Today, open-source hardware, affordable FPGA boards, and AI-assisted engineering are making that idea worth experimenting with. Maybe the next wave of AI innovation won't just be about building better models. Maybe it will also be about who gets to build the hardware that runs them. 👏 Huge credit to Felipe Sens Bonetto for creating openTPU. nitter.siddz.com/reasoningTokens 🔗 Original project: github.com/FeSens/openTPU #FPGA #AIHardware #OpenSource #ASIC #LLM
4
3
15
348
Will we ever see @Etched benchmarked on @SemiAnalysis_ Inference X? It would be very interesting
2
83
Open Inference on Open Hardware. #OpenTPU is now able to do @Alibaba_Qwen 3.5 inference at +30 tok/sec! And a 44% increase in prefill speed driven by fully automated agents research in the last 24h! github.com/FeSens/openTPU
5
94
Turns out that AI is now capable of designing its own hardware: 25 tok/s on Qwen 3.5 github.com/FeSens/openTPU
3
1,719
Fsbonetto retweeted
Starting from wallets, gas and transactions - the foundations every Ethereum builder needs. Thank you @reasoningTokens!
Replying to @eth_floripa
🧩 Chain, Wallet & Gas - Felipe Bonetto @reasoningTokens former Head of Data Eng at VAAS, where he built graph tech over 100B+ rows of onchain data to catch fraud and scam wallets, stopping 4,000+ malicious txs. He's also a software engineer, AI researcher, and now a founding engineer at a stealth silicon valley startup.
1
10
313
They are really coming for open models, this is sad. As Dario says AI is really dangerous, too dangerous to leave it to the government to decide, to abuse, to regulate and to monopolize.
Dario told the Senate in 2023 that “the scaling of open-source models” was going down “a very dangerous path.” in other words: open weight models are fine until they get good enough to threaten the closed-model business, then they become a matter of national security.
191
Fable is not back… yet 😔
Replying to @kimmonismus
We are currently serving exactly 0 traffic to Fable 5. This could be a UI bug though, will track it down.
116
I’ve being poking around with agent harness and fully autonomous companies and I think I’ve seen end game
4
96
CLI tools is quickly becoming the standard for agents. If your company don’t have a cli tool, you will be left behind
3
91
Its an unpopular opinion but @openclaw is amazing and unreliable. It's amazing when it works, but it often don't
2
121
Day 23 of 2026: I haven’t written a single line of code. Edited 3 lines. It’s over. Time to reinvent myself.
1
40
Fsbonetto retweeted
Quick new post: Auto-grading decade-old Hacker News discussions with hindsight I took all the 930 frontpage Hacker News article+discussion of December 2015 and asked the GPT 5.1 Thinking API to do an in-hindsight analysis to identify the most/least prescient comments. This took ~3 hours to vibe code and ~1 hour and $60 to run. The idea was sparked by the HN article yesterday where Gemini 3 was asked to hallucinate the HN front page one decade forward. More generally: 1. in-hindsight analysis has always fascinated me as a way to train your forward prediction model so reading the results is really interesting and 2. it's worth contemplating what it looks like when LLM megaminds of the future can do this kind of work a lot cheaper, faster and better. Every single bit of information you contribute to the internet can (and probably will be) scrutinized in great detail if it is "free". Hence also my earlier tweet from a while back - "be good, future LLMs are watching". Congrats to the top 10 accounts pcwalton, tptacek, paulmd, cstross, greglindahl, moxie, hannob, 0xcde4c3db, Manishearth, and johncolanduoni - GPT 5.1 Thinking found your comments to be the most insightful and prescient of all comments of HN in December of 2015. Links: - A lot more detail in my blog post karpathy.bearblog.dev/auto-g… - GitHub repo of the project if you'd like to play github.com/karpathy/hn-time-… - The actual results pages for your reading pleasure karpathy.ai/hncapsule/
237
549
5,331
614,827
Since this post I've been querying @antigravity with "How would a google senior engineer implement XYZ" and its output have been much better
Don't think of LLMs as entities but as simulators. For example, when exploring a topic, don't ask: "What do you think about xyz"? There is no "you". Next time try: "What would be a good group of people to explore xyz? What would they say?" The LLM can channel/simulate many perspectives but it hasn't "thought about" xyz for a while and over time and formed its own opinions in the way we're used to. If you force it via the use of "you", it will give you something by adopting a personality embedding vector implied by the statistics of its finetuning data and then simulate that. It's fine to do, but there is a lot less mystique to it than I find people naively attribute to "asking an AI".
68
Fsbonetto retweeted
If money couldn't buy me the freedom to work on Omarchy for the sheer love of computers, what good would it be?
154
232
6,504
444,006
Actively doing nothing is better than doom scroll TikTok. Boredom is incredibly important to the brain.
1
71