Agents & Gemini API, MTS @GoogleDeepMind | prev: Tech Lead at @huggingface, AWS ML Hero 🤗 Sharing my own views and AI News 🧑🏻‍💻 philschmid.de

Nürnberg
The Interactions API is now generally available. 🎉 The Interactions API is the simplest way to build with Gemini for humans and agents. - One API for Gemini models and agents. - Antigravity Agent with a isolated remote Linux sandbox. - Image gen with Nano Banana; music with Lyria 3, soon video with Omni. - `background=True` for async, long-running interactions. - Multimodal Tool Use & Combination. - Dedicated skills for coding agent. Building something new inside Google isn't easy, but it's possible. We spent almost a year on this because we think developers and agents deserve an API that is intuitive, familiar and easy to learn and use and evolves with improving capabilities and new behaviors. Give it a try. Feature requests, bugs, complaints all to me. 👇🏻
28
23
273
44,663
Can Agents improve their own harness on unseen tasks? The @GoogleResearch team released Harness², a framework that allows improve an harness around a frozen model. How it works: 1️⃣ Agent runs the base harness on each task to record a baseline trajectory 2️⃣ Editor agent inspects the trajectory, drafts 2 candidate edits (SI, Skills, hooks,….), and runs both. 3️⃣ Composer agent diffs the new trajectory against the baseline, merges edits that fixed failures (within a cap), and runs the final harness. 4️⃣ Reflector agent logs verified lessons into file and saves the winning components to a library for future tasks to pull on demand. Results: - 💡 Gemini 3.5 Flash +8.4 on WorkBuddy-Bench and +7.5 on JobBench. - 🛠️ Skills and scripts drive ~50% of edits; dropping skills costs 5.3 pts. - 📚 Gemini 3.5 Flash improves on all 3 benchmarks when editing its own harness. Paper: arxiv.org/abs/2610.14224 Code: github.com/google-research/h…
46
30
295
14,397
what's your early feedback on Gemini 4 Argon? where should we improve? we take your input seriously.
1,204
41
1,378
262,770
Gemini 4 Argon in now available for Pro subscribers.
7
1
7
2,203
The new Gemma docs! gemma.ai/ 🥁🥁🥁 From capabilities, to fine-tuning guides, inference optimizations and educational content on how the models work. All at central place!
10
9
140
8,173
Thank you for all that feedback. Will go through all of it and see how we can help improve the experiences.
what's your early feedback on Gemini 4 Argon? where should we improve? we take your input seriously.
50
132
9,216
Gave Gemini 4 Argon a photo of the Manhattan skyline asked it to recreate it as oil painting. It wrote a multi-pass canvas renderer that starts with broad background strokes, blocks in the buildings and river, and finishes with fine specular highlights on the water.
12
12
149
19,502
Gemini 4 Argon is now live in the Gemini API and @GoogleAIStudio 🎉 What it has done at Google so far: - A months-long Chrome refactor at ~4x the usual pace - 35%+ more agentic code submissions - Improved session creation in ADK by 40% - 2.9x the throughput increases in SGLang for Gemma 4 With Gemini 4 you should spend most of your time writing a clear goal and a way to check the result. Through your hardest challenge and convince yourself: aistudio.google.com/learn/ge…
25
13
182
10,144
Will be at @aiDotEngineer in NYC this week! 🔥 - Building a autonomous coworker | 10/14 2:55pm - @GoogleDeepMind Booth | most of the time Come by if you build agents, evals or have feedback about Gemini.
4
2
26
4,607
Philipp Schmid retweeted
Replying to @StatsWire
Argon is coming, fear not :)
441
62
1,637
345,497
Add: > can communicate technical concepts to none ai native engineers. > pushes to keeps things simple and says no to features/behaviors
literal hardest role to hire for rn and every ai startup wants someone > chronically online (knows trends) > has taste & can create (new media) > understands ai & technical > can execute with quality (operator) such a small niche of folks who can do this
8
1
28
4,523
SynthID Detector (synthid.com) is now publicly available, supporting the Nano Banana 2.1, @OpenAI, @nvidia, Kakao, and soon @Apple. 🌐 Verify if an image, video, or audio file was generated: 1️⃣ Upload or paste your file at synthid.com 2️⃣ Scans for watermarks from Google or our partners (files are deleted right after)
12
4
42
4,797
> A completely filled up glass of wine and a clock at 3:30pm - Nano Banana 2.1
16
3
232
9,410
Embed Anything w/ @googlegemma in your browser huggingface.co/spaces/webml-…
10
14
207
13,818
EmbeddingGemma 2 is out! Our first native multimodal embeddings built on Gemma 4 under Apache 2.0. 🤗 Embeds 100+ languages, code, images, audio, and video into one vector. 🧮 8,192 context 3️⃣ 740M omni, 440M text+vision, 570M text+audio, or 270M text-only 📈 +14% jump on MTEB Code 🪆 Matryoshka: 768d, 512d, 256d, or 128d 🤗 Available in Sentence Transformers and LiteRT-LM 🔓 Apache 2.0 huggingface.co/google/embedd…
22
61
576
32,959
Nano Banana 2.1 (`gemini-nano-banana-2.1`) is now available. Outperforming previous Pro model at 4x cheaper price (now $0.034 per image vs $0.134). 🕒 Improved instruction following 🔤 Better in-image text rendering 🔍 Grounded with Google Image Search 🎭 up to 5 characters consistency + 14 references images Available in @GoogleAIStudio, the Gemini API, @googlecloud, the @GeminiApp, and @FlowbyGoogle: aistudio.google.com/docs/ima…
35
37
511
32,992