Love to see what open models and post-training can do! 🤝

The future of enterprise AI is multi-model, and enterprises deserve the freedom to choose. NEWS: We’re expanding that choice through our collaboration with @NVIDIA, post-training its open-weight Nemotron 3.5 Super VL for enterprise workflows. Here’s what it delivered for two of our customers: ✅ @Skydance: A complex finance workflow that reviews vendor credit memos, statements and invoices to find credits the company is owed. Post-trained Nemotron matched their current frontier model’s accuracy at 40x lower inference cost, with 5x faster response times. ✅ @EY_US: An M&A due diligence agent that finds and reconciles answers across hundreds of files in a virtual data room. Post-trained Nemotron matched EY’s current frontier model at about one-eighteenth of the inference cost, returning answers more than twice as fast. Put NVIDIA’s open-weight models to work for your business with Scale Post-Training. Thank you, @JensenHuang and the NVIDIA team, for the early access and collaboration. scale.com/partnership/nvidia

Learn more: scale.com/blog/scale-partner…

A great pianist can play almost anything, but mastering one piece is what makes a performance exceptional. The same goes for AI. With today's launch of Nemotron 3.5 Super VL, we’re collaborating with @NVIDIAAI to combine their open post-training tools with Scale’s data, evaluation and applications building expertise. Together, we're turning general-purpose models into powerful, cost-effective specialists for enterprises everywhere. Welcome to the multi-model world. 🤝

🍿

the coolest thing we see as the organizers is when events are over capacity. @scale_AI clearly resonated with folks last night!!

People increasingly turn to AI chatbots for mental health support. But are models actually helping when it matters most? We're releasing DistressBench, a new benchmark measuring how well AI models respond to mental health crises.

We’re introducing Humanity’s Sixth Sense, a new benchmark testing the intuitive visual reasoning people rely on every day. Across 522 open-ended tasks spanning images and video, HSS tests everything from spatial and causal reasoning to social understanding. The gap is significant. Humans score 93.1%, while the strongest model, GPT-6-astra, reaches 53.6%. The median model scores just 30.9%.

Learn more: labs.scale.com/blog/introduc… agentenvframework.com

Every RL environment we build runs on AgentEnv. Today we’re open-sourcing it, so more people can build the worlds agents learn in.

Much of the AI security debate is about frontier models. But a lot of people are building on open-weight models. We need to understand their capabilities and risks too. A real testing strategy covers every model, not just the frontier.

You can’t improve agents if you can’t measure where and why they fail. At #LATechWeek, we're hosting a hands-on evals workshop led by our Head of General Agents @Bckenstler to break down how we structure evals, what we measure, and how we use the results to improve AI systems. Apply here to join us: scl.ai/LATechWeek

An honor to meet with His Highness the Crown Prince of Kuwait to discuss how @Scale_AI can support Kuwait’s digital transformation and develop Kuwaiti AI talent.

The nation that can measure the AI frontier will be the one that steers it. Our future should not be steered by speculative warnings. We have to be driven by evidence. That was the clearest takeaway from this week's AI conversations at the UN General Assembly. Governments need to get serious about testing frontier AI, and nowhere is that more urgent than in Washington. Getting serious means three things: → Clear responsibility for testing across agencies → Access to models before they're deployed → Funding for the experts and tools to do the work Scale AI's cyber research shows what testing can reveal. We've seen AI agents carry out an attacker's instructions while still finishing the user's task, so the user never knew anything went wrong. We've also seen models refuse to help people defend their own systems. Both are failures. Real testing has to measure the harm AI can cause and the help it fails to give. Government shouldn't have to rely solely on AI developers to explain these failures. It needs its own testing capacity, with the expertise to ask hard questions and the tools to answer them. Scale has worked with the U.S. government for years to test the risks and capabilities of AI models, and we're accelerating that work in the months ahead. Here's what we think America should do next: scale.com/blog/steer-the-ai-…

We’re partnering with @googlecloud to make it easier for enterprises to put AI to work. Our joint reference architecture is a blueprint bringing the Scale GenAI Portfolio to Google Cloud, with Gemini Enterprise integration. Excited to give builders a proven foundation to put AI to work faster. scale.com/blog/deploying-ent…

Today, we released SWE-Bench Pro V2, a refreshed public split of SWE-Bench Pro. The frontier keeps moving, and the standard for measuring it should move with it. We’ll keep strengthening our leaderboards, incorporating feedback, and building more rigorous evals for what comes next.

AI safety doesn’t translate one-to-one. We partnered with the Korea AI Safety Institute to develop ROK-FORTRESS, our first benchmark together, testing how language and geopolitical context affect AI safety. Across 14 frontier models, we found that translation alone can miss meaningful differences in model behavior. scale.com/blog/korea-ai-safe…

This week I joined @RoyalFamily, govt ministers and leaders to discuss how AI can best serve the public good. AI can expand opportunity and solve some of our toughest challenges. It’s essential that we pursue that potential responsibly, in a way that benefits people broadly. Rigorous, independent testing - like we do at @Scale_AI - is an essential step to earning public trust. Governments and independent evaluators need to work together to deeply and continually assess AI's capabilities, opportunities, and risks. That allows us to make sound decisions about its development and use. Conversations like this one are a step in the right direction.

Cue the makeover montage.