HoloEd retweeted
I gave Opus 5.5 one prompt + music. 12 hours later, I woke up to this.
471
666
5,239
806,125
Replying to @EndWokeness
Deregulating #energy is arguably the most impactful foreign policy. Most hostile countries are energy powerhouses (e.g. Russia, Iran, China). If the West unleashed oil/natural gas pipelines/drills & nuclear…hostile regimes would be weakened tremendously without firing a shot.
1
1
1
266
HoloEd retweeted
The federal government is spending America into oblivion
Everyone is posting that the annualized number is about $1.059 trillion. However the interest on the debt for just May 2024 was $103 billion. Debt will grow another $2 trillion or more in the next 12 months. We are already on pace for over $1.2 trillion in annualized payments on the debt. Within the next few years, interest on the debt will exceed Social Security payments and become the largest item in the budget.
11,305
27,286
145,516
59,701,637
Clearly LLMs must one day run in Space Step 1 we harden llm.c to pass the NASA code standards and style guides, certifying that the code is super safe, safe enough to run in Space. en.wikipedia.org/wiki/The_Po… (see the linked PDF) LLM training/inference in principle should be super safe - it is just one fixed array of floats, and a single, bounded, well-defined loop of dynamics over it. There is no need for memory to grow or shrink in undefined ways, for recursion, or anything like that. Step 2 we've already sent messages out to Space, for possible consumption by aliens, e.g. see: Arecibo message, beamed to space: en.wikipedia.org/wiki/Arecib… Voyager golden record, attached to probe: en.wikipedia.org/wiki/Voyage… The Three Body problem (ok bad example) But instead of sending any fixed data, we could send the weights of an LLM packaged in the llm.c binary, with instructions for the machine code. The LLM would then "wake up" and interact with the aliens on behalf of the human race. Maybe one day we'll ourselves find LLMs of aliens out there, instead of them directly. Maybe the LLMs will find each other. We'd have to make sure the code is really good, otherwise that would be kind of embarrassing. :) Step 2 is clearly not a serious proposal it's just fun to think about. Step 1 is a serious proposal as, clearly, LLMs must one day run in Space.
268
441
4,534
519,174
New (2h13m 😅) lecture: "Let's build the GPT Tokenizer" Tokenizers are a completely separate stage of the LLM pipeline: they have their own training set, training algorithm (Byte Pair Encoding), and after training implement two functions: encode() from strings to tokens, and decode() back from tokens to strings. In this lecture we build from scratch the Tokenizer used in the GPT series from OpenAI.
350
1,828
13,664
1,740,481
HoloEd retweeted
This is huge: Llama-v2 is open source, with a license that authorizes commercial use! This is going to change the landscape of the LLM market. Llama-v2 is available on Microsoft Azure and will be available on AWS, Hugging Face and other providers Pretrained and fine-tuned models are available with 7B, 13B and 70B parameters. Llama-2 website: ai.meta.com/llama/ Llama-2 paper: ai.meta.com/research/publica… A number of personalities from industry and academia have endorsed our open source approach: about.fb.com/news/2023/07/ll…
379
3,329
14,809
4,294,607
HoloEd retweeted
Liftoff of Starship!
3,794
25,527
143,878
32,278,329
We’ve just released a major milestone of Unison, version M4 🎉 ✅ Anyone can now self-publish code to share.unison-lang.org ✅ Base library additions: mutable/immutable arrays, date/time primitives, efficient regexes. ✅ ... and lots more Blog post: unison-lang.org/blog/m4-code…
1
25
66
Today 😁
2
A year ago...
4
HoloEd retweeted
Splashdown! Welcome back to planet Earth, @Inspiration4x!
3,120
13,312
90,059
HoloEd retweeted
View from Dragon’s cupola
3,577
12,947
89,991
HoloEd retweeted
Second phasing burn complete. Dragon and the @inspiration4x crew have reached a circular orbit of 585km – a new Dragon altitude record
376
2,132
23,598
HoloEd retweeted
Flight profile for @inspiration4x
379
1,205
7,887
HoloEd retweeted
Liftoff of @Inspiration4X! Go Falcon 9! Go Dragon!
838
6,697
31,965
windowscentral.com/partys-ov… Good times; way back we showed the Silverlight was obsolete before it even launched and that you could do everything using just standard HTML+JS (en.wikipedia.org/wiki/Micros…). Nearly got fired for showing that.
5
16
71
Haskell Symposium 2021 keynote on linear types just out. If you wanted an intro to the *why* of linear types (resource hygiene, safe FFI, performance, correctness wrt protocols, ...), this talk gives you part of the puzzle. piped.video/watch?v=WZ_0FSGe…
1
21
47
A farewell to Simon Peyton Jones as he leaves Microsoft Research Subject: RE: New horizon   I would like to add a few words to what Chris has written.  I know I am also speaking for Mads, the current lead designer of C# (cc’d)
4
251
752
HoloEd retweeted
Starship landing nominal!
17,119
25,182
275,997