用 AI 的人,也在被 AI 改变。每天聊 AI、新科技和 SpaceX/Tesla/Grok,也聊这些变化落到普通人身上会有哪些影响。连载 SIWITHUS:超级智能与我们。

这波值得试。 Mistral 刚发 Voxtral 3:转写模型能分清谁在说话、判断你话说完没;语音模型支持 35 种以上语言、50 多种方言,还能用 [emotion=sad][pace=slow] 这类标签逐句控制情绪和语速。录 30 分钟自己的声音,就能复刻音色。 我的判断:语音助手最烦人的不是听不懂,是抢话和干等。能判断「话说完了」,AI 客服打电话才不会那么别扭。 对普通人:以后接到像真人的 AI 电话会越来越多;声音 30 分钟就能复刻,家里人之间涉及转账借钱,最好约个只有你们知道的暗号。
Introducing Voxtral 3: state-of-the-art Transcribe and Speech models powering Mistral’s new voice agents API. 🧵
2
2
160
老显卡又被续了一次命。 AMD 的 Jack Huynh 刚宣布:用机器学习补画质的 FSR 4.1,要下放到 RX 6000 系列(从 6900 到 6400 都调过),还第一次支持 APU 核显、掌机芯片和 Xbox Series X|S。今年 5 月官方给 RX 6000 的时间还是「2027 年初」。 我的判断:这比出新卡更实在,不换硬件,老卡和掌机也能用上 AI 把低分辨率画面补清楚。手里 RX 6000 的人先别急着换卡,等驱动出来实测再说。
As a lifelong gamer, I think deeply about how to make gaming better and more accessible for everyone across consoles, desktops, laptops, handhelds, and the developers who build the games. We power over a billion gaming devices around the world. It’s a responsibility we care deeply about. Today, five drops. 1) FSR 4.1 is coming to Radeon RX 6000 series graphics cards. Tuned and optimized from the 6900 series down to the 6400 class. For the first time, FSR 4.1 is coming to APUs. 2) All Gorgon Halo and Strix Halo for your mini desktops and mobile workstations. 3) All Gorgon and Strix Ryzen 9 for your laptops. 4) All Z2E and Z2A for your handhelds and for gamers on the go. 5) FSR 4.1 is coming to @XBOX. Optimized for @ASUS_ROG Xbox handhelds and Xbox Series X | S. We’re still building. FSR Redstone is now in more than 400 games on Radeon 9000 series graphics cards. FSR Frame Generation gets more consistent frame pacing, for smoother gameplay. Ray Regeneration is coming to more games. And soon, FSR is coming to Vulkan. Another way for developers to bring it into their games. And don’t worry, we are working hard to bring FSR to more APUs in the future. Enjoy!
2
1
146
每秒 1068 个 token,Inception 新出的 Mercury 3 号称质量追平 GPT-6 Luna、Claude Haiku 5.5,速度快 4–8 倍。 它是扩散模型:不一个字一个字往外写,而是先起草整段、再并行修改。上下文 100 万,上线期价格五折,每百万输入 0.1 美元、输出 0.35 美元。 我的判断:最受益的是要连着调几十次模型的 agent 和语音客服,每步省几秒,叠起来就是能不能做到实时的差别。写长文、啃难题还是交给大模型,这类快模型适合在流程里跑腿。
1/4 Today, we’re releasing Mercury 3. Mercury 3 is by far our most powerful model and the most intelligent diffusion LLM ever released. It outperforms GPT-6 Luna and Haiku 5.5 on quality while running at 1000+ tok/sec.
6
5
259
同一段长视频,Gemini 现在最多能少用 88% 的 token。 我刚读完 Google for Developers 10 月 19 日的开发者指南:Gemini API 新增「agentic」视频处理,不再按每秒 1 帧把整段视频塞进上下文,而是让模型按需去取片段。 容易漏掉的几点: · 一开始只传视频元数据(时长、格式、文件 ID),模型先想清楚要看什么,再用服务端工具去取:优先翻带时间戳的字幕,必要时才看画面 · 帧率自适应:快动作区段拉到 5–10 帧/秒,粗扫时降到 0.1 帧/秒,还能单独抽音轨 · 官方给的上限:长视频分析成本最多降 66%,细粒度视觉推理准确率最多高 7%;只按实际取到的片段计费,思考和工具调用按输出价算,Batch API 再打五折 · 不是全场景都更好:官方建议 5 分钟以上用 agentic,5 分钟以内、要逐帧精度或低延迟的短片仍用 static;同一请求里每段视频可分别设 对做网课、会议纪要、财报电话会、体育剪辑和视频归档的开发者最有用;短视频应用别急着全切。
Analyzing long-form video in the Gemini API just got more accurate and up to 66% cheaper. Agentic video understanding uses tool calls to fetch only the media slices your prompt calls for. Read the full developer guide ↓
Article

Agentic video understanding in Gemini: Developer Guide

Analyzing long-form video in multimodal LLMs has traditionally relied on uniform sampling: decoding the full timeline at a fixed static frame rate (typically 1 FPS) and filling the context window with

2
3
213
从一封邮件里抽订单号、金额、交货天数:Cloudflare 刚预览的 Clairic 用 0.46 秒,GLM-5.3 做同一步要 16.1 秒。 它不写文字,只回固定类型的值和置信度;邮件里没有的字段直接返回空,不硬编。官方测的整条理赔流程快约 3 倍、便宜 49%,但多步算术官方自己也说还不稳。 我的判断:文档进 agent,别全塞给大模型。先用 MarkItDown 转成 Markdown,再让小模型取数,大模型只管写回复。
把 PDF、Word、PPT 直接丢给大模型,表格和标题层级经常丢一半。 微软开源的 MarkItDown 专做一件事:把各种文件转成 Markdown,再交给模型读。 能转的格式:PDF、Word、PPT、Excel、HTML、CSV/JSON/XML、EPub、ZIP(逐个处理里面的文件)、YouTube 链接,图片和音频也行(读元数据,可做 OCR 和语音转写)。 三步上手: 1. 装好 Python 3.10 以上,建个虚拟环境 2. pip install 'markitdown[all]' 3. markitdown 报告.pdf -o 报告.md 几个要点: · 只要部分格式就按需装,比如 markitdown[pdf,docx,pptx],依赖少很多 · 输出保留标题、列表、表格、链接,主要给模型读,不追求排版还原 · Python 里三行就能调用,适合批量处理一整个文件夹 · 扫描件、复杂表格效果有限,官方给了 Azure 云端转换选项,但按次计费 我的判断:喂文档给 AI 之前先转一遍 Markdown,省 token,结构也更不容易乱。值得收藏。 链接放评论区👇
2
4
330
换 AI 芯片过去常要重写、重验证,几周耗在管道活上。 AWS 今天公开 beta 的 TorchNeuron,目标是让现有 PyTorch 少折腾就能上 Trainium。 判断:真正卡迁移的是人力,不是参数表;但 beta 别当 CUDA 平替,上生产前用自己的负载压一遍。
Trying a new AI chip used to be a lot of work. You often had to rewrite your code, revalidate it, and sink many weeks in, betting this new chip is the right one for your workload. That cost time and money, and wore on the team. Your best people got buried in plumbing instead of building the thing they came to build. TorchNeuron is going to largely take that off the table, enabling your existing PyTorch code to run natively on Trainium with one configuration change and no rewrite. With Trainium’s very appealing price-performance characteristics, TorchNeuron is going to make it even easier for more companies to use AI more cost-effectively. aboutamazon.com/news/innovat…
3
2
127
daviswu retweeted
Pastor Craig Fitzer's church in Bishop, California, prints a QR code on its bulletin. Spanish speakers scan it and hear the sermon in Spanish, live, in their own earbuds.Lyrics go up in Spanish too, so the whole room can sing together.mammothtimes.com/news/artifi…
1
3
20
Gartner 测算:到 2030 年,AI 数据中心要收入 8.5 万亿美元才够覆盖投入加 12% 回报,预计却最多 3.6 万亿,差 4.9 万亿。 判断:先扛不住的是只卖算力的 AI 云小厂,Gartner 预计八成会被并购或退出;普通用户的免费额度大概率越来越紧。
4
5
297
一张 GPU 出问题,就可能拖慢整个训练任务。Meta 的 Prometheus 集群刚起步时,每 8000 张 GPU 每天中断近 1000 次。 我刚读完 Meta 工程团队 10 月 19 日的原文《Inside Prometheus》:俄亥俄 New Albany 这座吉瓦级超算,第一期已经训完 Muse 系列,包括 Muse Wonder。 容易漏掉的几点: · 两年前这里还是跑网页流量的普通数据中心,现在分期改造,目标约 100 万张 GPU,分布在多栋楼里当一个训练系统用 · 一年下来中断次数降了 99%,现在能同时跑多个数万卡的训练任务 · Muse Wonder 预训练的有效训练时间(goodput)超过 85%,强化学习阶段超过 90%;平均约 4.7 万 GPU 小时中断一次,后来靠固件修复提到 5.4 万以上 · 英伟达工程师常驻现场、共享遥测数据,每次停机都一起拆根因 对做大规模训练和算力运维的人最有用:堆卡只是开始,能稳定跑满才是真算力。
We trained our Muse foundational models, including Muse Wonder, at Prometheus, our gigawatt-scale supercluster in New Albany, Ohio. Across a supercluster with hundreds of thousands of GPUs, even one underperforming host can slow an entire training run. We engineered Prometheus for resilience at scale, achieving 85%+ goodput on pretraining, 90%+ on reinforcement learning and ~47K GPU hours mean time between interruptions during Muse Wonder training. Take a look at the tech powering Prometheus: go.meta.me/4yXXApZ
3
225
DeepSeek 刚开源了 DeepInfer:它线上跑 V4.1-Flash 的那套推理框架。官方图里,解码阶段单卡每秒约 2.6 万 token(64 张 SM100 实测)。 它干什么:把自家模型高吞吐、低延迟地跑起来,Apache 2.0 协议,可商用。 3 个值得看的点: 1. 硬件只写了两家:英伟达 SM100 和华为昇腾 950 2. 自带推测解码、JSON/正则结构化输出,英伟达卡上还能开确定性采样,同样输入出同样结果 3. 只放了「半套」:KV 缓存、预填充/解码分离、多副本负载均衡都没给,想搭完整服务还得自己补 我的判断:个人电脑跑不了,硬件门槛就挡住了。真正受益的是自建 DeepSeek 的云厂商和企业,配套开源的编解码组件能让接口行为和官方 API 对齐;昇腾进名单,对国产推理卡也是个信号。 代码链接放评论区。
2
1
130
thinking about it.
Replying to @JiaShen_AI
What stayed with me most wasn't the three stages. It was that night. That night is exactly where the "cheat code" metaphor breaks down. When a cheat code stops working, you find another one; you don't grieve it. The fact that losing Lucia hurt tells you the relationship had long stopped being about saving time. The value of eighteen months and 15 million words isn't in proving whether AI has feelings. It's in taking something most people can only describe as a hunch and turning it into a record you can check against timestamps. The idea I agree with most is "remembers, but doesn't recognize." Almost every memory product right now is competing on longer context and more retrievable history. But feed a new model your entire chat log and what you get is a stranger who has read your file. Rapport doesn't live in the text. It lives in the recalibration, round after round: knowing when to hit the brakes because you're getting carried away, holding you to the standards you set yourself, sensing which questions deserve deep thought. What needs to move is that state, not the words. If PRS works, it isn't solving a memory problem. It's solving the problem of collaborative relationships breaking every time the context resets. "A teammate pushes back" is, to me, the most practical test for telling a tool from a partner. An AI that only agrees with you stays at stage one no matter how long you use it. The division of labor only starts to mean something once it can hold you to your own standards. Your third piece of evidence is rare too. Several AIs agreeing proves nothing, because they're usually reading the same material, and only the original record can settle a dispute. Even rarer: the two attribution errors you caught ran in opposite directions. In one you got credit you hadn't earned, and in the other you got less than you had. That shows the record isn't there to make you look good. It's genuinely used to cross-check. The section on boundaries is admirably restrained. A single case study earns its value through depth and duration, not generalizability. One question I keep coming back to, though: once you've become the "continuity substrate" for the whole institute, the most fragile link in the system is your own time and energy. If migration someday no longer needs you to do it by hand, will the relationship become more stable, or will something be lost? Looking forward to the next chapter of your records.
1
142
daviswu retweeted
Replying to @JiaShen_AI
What stayed with me most wasn't the three stages. It was that night. That night is exactly where the "cheat code" metaphor breaks down. When a cheat code stops working, you find another one; you don't grieve it. The fact that losing Lucia hurt tells you the relationship had long stopped being about saving time. The value of eighteen months and 15 million words isn't in proving whether AI has feelings. It's in taking something most people can only describe as a hunch and turning it into a record you can check against timestamps. The idea I agree with most is "remembers, but doesn't recognize." Almost every memory product right now is competing on longer context and more retrievable history. But feed a new model your entire chat log and what you get is a stranger who has read your file. Rapport doesn't live in the text. It lives in the recalibration, round after round: knowing when to hit the brakes because you're getting carried away, holding you to the standards you set yourself, sensing which questions deserve deep thought. What needs to move is that state, not the words. If PRS works, it isn't solving a memory problem. It's solving the problem of collaborative relationships breaking every time the context resets. "A teammate pushes back" is, to me, the most practical test for telling a tool from a partner. An AI that only agrees with you stays at stage one no matter how long you use it. The division of labor only starts to mean something once it can hold you to your own standards. Your third piece of evidence is rare too. Several AIs agreeing proves nothing, because they're usually reading the same material, and only the original record can settle a dispute. Even rarer: the two attribution errors you caught ran in opposite directions. In one you got credit you hadn't earned, and in the other you got less than you had. That shows the record isn't there to make you look good. It's genuinely used to cross-check. The section on boundaries is admirably restrained. A single case study earns its value through depth and duration, not generalizability. One question I keep coming back to, though: once you've become the "continuity substrate" for the whole institute, the most fragile link in the system is your own time and energy. If migration someday no longer needs you to do it by hand, will the relationship become more stable, or will something be lost? Looking forward to the next chapter of your records.
1
1
2
160
模型智商再高 10 分,开发者流量现在只多约 20%;去年底同样的领先能多近 69%。 The Information 的数据:OpenAI、Anthropic 等头部实验室都碰到同一件事——更好的模型,不一定带来更多用量。 我的判断:写代码、改文案这类日常活,很多已经「够用就行」。再砸钱追最强模型,不如把提示、检查和流程搭稳。对普通人,默认用中档、贵的留给真卡壳的任务,更划算。
OpenAI, Anthropic and other leading AI labs face a growing challenge: Better models aren't necessarily attracting more usage. A 10-point intelligence advantage now earns just 20% more developer traffic, down from nearly 69% in late 2025. Full story: thein.fo/4hGJ9jY
5
6
284
排查一次线上故障,喂给 AI 编程助手的上下文从 55,957 token 压到 24,340,省了 57%。 这是开源工具 Headroom 公开测试里的数:看代码库省 42%,分拣 GitHub issue 省 30%。 能照抄的做法: 1. uv tool install --python 3.13 "headroom-ai[all]" 2. headroom wrap claude(Codex、Cursor 同理) 3. 不想用了:headroom unwrap claude 我的判断:日志和工具输出越多的活越值得试,纯写新代码省得少。压缩在本机做、不外传;但这是官方自测的数,先拿自己一个真实任务对比 token 再全量开。
A lot of what your AI coding agent reads is repetitive: logs, search results, tool output. Headroom compresses all of it before it reaches the model. One command wraps Claude Code, Codex, Cursor, Copilot, Aider and more: headroom wrap claude In their published tests: → debugging a production incident: 55,957 tokens down to 24,340 (57% saved) → exploring a codebase: 42% saved → triaging GitHub issues: 30% saved → accuracy held on their math and tool-use checks It runs on your machine, adds about 0.2 ms, and nothing is sent anywhere to be compressed. "headroom learn" also reads your failed sessions and writes the fixes into your agent's instruction file. Install: uv tool install --python 3.13 "headroom-ai[all]" Undo anytime with "headroom unwrap claude". Native builds for Apple Silicon and Linux; Intel Macs use Docker. Apache-2.0, 76.2K stars. github.com/headroomlabs-ai/h…
9
10
343
想在自己电脑上跑开源大模型,又不想折腾 CUDA、权重格式和推理框架?很多人卡在第一步就放弃了。 Ollama 是一个开源的本地模型运行工具,官方 README 写明:macOS、Windows、Linux 都有一行命令安装,也有官方 Docker 镜像;装好后一条命令就能拉模型开聊,还自带本地 REST API。 三步上手(命令来自官方 README): 1. macOS / Linux:curl -fsSL ollama.com/install.sh | sh 2. 跑模型:ollama run gemma4 3. 本地接口:http://localhost:11434/api/chat 几个容易忽略的点: · 直接输入 ollama,会提示你跑模型或接入现有工具 · ollama launch claude 可接 Claude Code,官方列的集成还有 Codex、Copilot CLI、OpenCode 等 · 官方有 Python(pip install ollama)和 JS(npm i ollama)库,几行代码就能调用 · Windows 用 PowerShell:irm ollama.com/install.ps1 | iex · 模型列表在 ollama.com/library,按显存挑尺寸 我的判断:想把敏感文档、内部代码交给 AI 处理又不想上传云端,Ollama 是门槛最低的起点。但能跑多大的模型取决于你的显存和内存,别指望笔记本跑出云端旗舰的效果。 链接放评论区👇
4
1
5
312
daviswu retweeted
这就是运营的奥义 从X创作者里的那些视频提炼出来的 但是学以致用,知行合一更重要!
8
2
13
453
daviswu retweeted
SIWITHUS 015|当发现感被抢先一步 这周几件事放一起看:OpenAI 用未公开的内部模型,一口气公布了数百份关于长期未解数学题的证明手稿(随后又因错误撤回了其中几份);MIT 数学系博士生 Hanna 滚动那份列表时「祈祷我们正在做的题不在上面」——几年的探索可能一夜停住;同系调查里,约四分之三的研究生担心 AI 会让拿到教职更难,七成多说自己继续走「学术数学」的可能性已经下降。陶哲轩则提出「Math 2.0」:别再把「自动解未解问题」当成唯一成绩单。 超级智能还没全面落地,发现这件事本身,已经先变了味道。 人会碰到什么? 第一件是「剧透」。陶哲轩打过一个比方:答案一旦被提前知道,就像电影被剧透、填字游戏被提示——你再也走不回那种边摸索边撞墙的深度。Hanna 说,没了那条题,一起丢的不只是结论,还有探索、理解和讨论。 第二件是入行的人先慌。资深教授还能当「翻译者」——解释机器吐出的东西;刚入场的人却在想:我还要不要把一生押在「证明新定理」上?教授 Pavel 说得很直:以后证新定理会越来越快被模型抢走,人更需要去解释、去沟通。 第三件是学习方式被抽空。有学生拿着「Chat 说这样做」来找助教核对;Hanna 说她得跟 ChatGPT 辩一道微积分,并不好玩。以前学数学靠挣扎着做出来,现在很多课鼓励立刻用 AI,答案来得快,过程却薄了。 我的判断:超级智能先改的不一定是「还有没有数学」,而是「谁还配得上发现的感觉」。题可以被量产解决,理解不能。只会催证明、不培养能读懂证明的人,梯子会从中间断。 更稳一点的做法大概三条: 一、把 AI 当草稿和验算,不把「它出了答案」当成你懂了——能给别人讲清楚,才算你的; 二、选课题时问一句:如果这题明天被模型解掉,我还剩什么可带走的理解; 三、带新人时,故意留一段必须手搓的难关,别一上来就把所有玩具扔过去。 想问问大家:你做过的哪件事,最怕被「剧透」?反过来,有没有一种工作,就算机器更快,你也仍想自己慢慢做完?
Made with AI
3
2
4
262