michelle retweeted
When I said hunch could learn in real-time I wasn't kidding. It's like teaching a kid!
Behind the scenes, @Cloudflare’s Clef is helping refine the local model so it learns in real time, while @googlegemma’s EmbeddingGemma2 runs live on the CPU. 🧵
It's been a while since I showed any Jev stuff but I've been cooking on a way to use @GoogleDeepMind's EmbeddingGemma2 as an insanely fast real-time /v1/systemone endpoint (20ms on text, 100ms on images).
It's trainable in real-time, can distill an upstream teacher model, and is multi-modal by default. Hard to believe a @googlegemma model of this size can do so well with the right harness!
13
12
172
7,746
incident report for a cross-kv cache exposure affecting glm5.3 on workers ai. no exploitative behaviour was detected. thank you to researcher and @sgl_project for joint disclosure with us.
in such a nascent space there's no silver bullet against GPU memory-safety bugs, but in the blog you’ll see we have been trying to proactively solve for this - not just for us, but for everyone in the industry. we commit to doing so in the future as well.
blog.cloudflare.com/kv-cache…
7
1
75
2,790
debated on amplifying this but i think it’s only right to act honestly and openly. i’ll say we aren’t the first exposure and won’t be the last given how gpu memory safety is still largely unsolved. also proud that we’re trying to fix this for everyone rather than keeping security fixes as proprietary IP.
2
29
995
I'm doing DP. I'm doing TP. I'm doing SP. I'm doing PP. I'm doing ZP. I'm doing FSDP. I'm doing 1F1B. I'm doing CP. I'm doing ETP. I'm doing DPA. I'm doing VPP. I'm doing P/D. I'm doing ZBPP. I'm doing DPA. I'm doing HSDP. I'm doing DCP. I'm doing DWDP. I'm doing AFD.
46
34
690
57,268
wow just learned that my friends sold drake his christian girl autumn hermes margiela aw97 shawl. iconic shit
1
13
4,787
no one’s talking about the funniest part
of you can see everything where billy was like “it wasn’t a strip club it was e11even”
4
106
6,885
in 2024 i tweeted this. @dok2001 still doesn't understand the meme but we are still hiring for cracked engineers and PMs for my teams (workers ai, ai gateway, ai search, web search).
if you are an engineer with distributed systems, inference, ML optimizations, model training xp - shoot me a dm with research/projects/resumes.
if you want to work in AI product and are driven, curious, and have xp in this space - shoot me a dm too.
all i can promise is that you will have fun and work with the smartest people at an enormous scale. please join us.
12
10
140
28,411
michelle retweeted
Cloudflare previous CTO sent this into our bug bounty. We are investigating.
104
597
16,403
347,295
oh i look 3 apples tall
@michellechen explaining why @Cloudflare shipping models makes sense - and it’s all about ~the edge~
17
140
4,655