Scale retweeted
The future of enterprise AI is multi-model, and enterprises deserve the freedom to choose. NEWS: We’re expanding that choice through our collaboration with @NVIDIA, post-training its open-weight Nemotron 3.5 Super VL for enterprise workflows. Here’s what it delivered for two of our customers: ✅ @Skydance: A complex finance workflow that reviews vendor credit memos, statements and invoices to find credits the company is owed. Post-trained Nemotron matched their current frontier model’s accuracy at 40x lower inference cost, with 5x faster response times. ✅ @EY_US: An M&A due diligence agent that finds and reconciles answers across hundreds of files in a virtual data room. Post-trained Nemotron matched EY’s current frontier model at about one-eighteenth of the inference cost, returning answers more than twice as fast. Put NVIDIA’s open-weight models to work for your business with Scale Post-Training. Thank you, @JensenHuang and the NVIDIA team, for the early access and collaboration. scale.com/partnership/nvidia
4
7
44
3,321
A great pianist can play almost anything, but mastering one piece is what makes a performance exceptional. The same goes for AI. With today's launch of Nemotron 3.5 Super VL, we’re collaborating with @NVIDIAAI to combine their open post-training tools with Scale’s data, evaluation and applications building expertise. Together, we're turning general-purpose models into powerful, cost-effective specialists for enterprises everywhere. Welcome to the multi-model world. 🤝
10
10
73
10,302
🍿
So many models launching this week! And we have one of our own coming...⌛️

ALT Happy Jonah Hill GIF by We TV

1
1
69
8,863
Scale retweeted
the coolest thing we see as the organizers is when events are over capacity. @scale_AI clearly resonated with folks last night!!
1
2
17
1,592
Scale retweeted
People increasingly turn to AI chatbots for mental health support. But are models actually helping when it matters most? We're releasing DistressBench, a new benchmark measuring how well AI models respond to mental health crises.
1
7
24
1,900
Scale retweeted
We’re introducing Humanity’s Sixth Sense, a new benchmark testing the intuitive visual reasoning people rely on every day. Across 522 open-ended tasks spanning images and video, HSS tests everything from spatial and causal reasoning to social understanding. The gap is significant. Humans score 93.1%, while the strongest model, GPT-6-astra, reaches 53.6%. The median model scores just 30.9%.
85
148
2,242
207,333
Scale retweeted
Much of the AI security debate is about frontier models. But a lot of people are building on open-weight models. We need to understand their capabilities and risks too. A real testing strategy covers every model, not just the frontier.
1
9
28
3,398
Scale retweeted
You can’t improve agents if you can’t measure where and why they fail. At #LATechWeek, we're hosting a hands-on evals workshop led by our Head of General Agents @Bckenstler to break down how we structure evals, what we measure, and how we use the results to improve AI systems. Apply here to join us: scl.ai/LATechWeek
2
6
19
2,058
We’re excited to bring @nvidia's Open Agent Safety Platform technologies to Scale GenAI Portfolio, helping us build, train, deploy, run, and evaluate AI agents in controlled environments with enforceable security and a clear record of their actions.
Today, with over 100 industry partners, we introduced the NVIDIA Open Agent Safety Platform, bringing together OpenShell and Sentry. Artificial intelligence is extraordinary technology that will advance discovery, productivity, security, health, and prosperity for generations to come. But its full promise can only be realized when people have confidence that AI is being built to be safe and deployed with wisdom and responsibility. This is bigger than a single product. It's the beginning of an open ecosystem to build the trust layer for safe agent systems. Together, we are building the foundation of the AI economy. Trust and innovation are not in conflict. Safety is how trust is earned. We must build not only the most capable AI, but the most trusted AI, so that this extraordinary technology can realize its enormous promise for the world. nvda.ws/4hcoq7m
16
4
72
15,484
Scale retweeted
An honor to meet with His Highness the Crown Prince of Kuwait to discuss how @Scale_AI can support Kuwait’s digital transformation and develop Kuwaiti AI talent.
ممثل حضرة صاحب السمو الشيخ مشعل الأحمد الجابر الصباح أمير البلاد سمو ولي العهد الشيخ صباح خالد الحمد الصباح يبحث مع الرئيس التنفيذي لشركة (Scale AI) العالمية فرانسيس ديسوزا آفاق التعاون المشترك في مجالات تطبيقات الذكاء الاصطناعي والبيانات الضخمة والتحول الرقمي - سموه استقبله والوفد المرافق له في مقر وفد دولة الكويت الدائم لدى الأمم المتحدة على هامش أعمال الدورة الـ81 للجمعية العامة في نيويورك - جرى استعراض سبل الاستفادة من حلول التكنولوجيا المتقدمة في دعم وتطوير القطاعات الحكومية والاقتصادية الحيوية في دولة الكويت وتأهيل الكوادر الوطنية وتنمية قدراتها - #الكويت #السعودية #فلسطين #القدس #غزه #اليمن #لبنان #السودان #سوريا #مصر #العراق #الأردن #الضفة_الغربية #حماس #ترمب #ترامب #أمريكا #تركيا #الرياض #ايران #ليبيا #صباح_الخير #يوم_الجمعة #ليلة_الجمعة #ساعة_استجابة #جمعة_مباركة #مساء_الخير #الخميس_الونيس #مضيق_هرمز #خليجي٢٧ #خليجي27 دول الخليج الدول العربيه الولايات المتحده الشرق الاوسط مجلس الامن الامم المتحدة الرئيس الفنزويلي مدريد صوت المطر صوت الرعد مطر الليل أبستين
8
6
35
4,921
Scale retweeted
The nation that can measure the AI frontier will be the one that steers it. Our future should not be steered by speculative warnings. We have to be driven by evidence. That was the clearest takeaway from this week's AI conversations at the UN General Assembly. Governments need to get serious about testing frontier AI, and nowhere is that more urgent than in Washington. Getting serious means three things: → Clear responsibility for testing across agencies → Access to models before they're deployed → Funding for the experts and tools to do the work Scale AI's cyber research shows what testing can reveal. We've seen AI agents carry out an attacker's instructions while still finishing the user's task, so the user never knew anything went wrong. We've also seen models refuse to help people defend their own systems. Both are failures. Real testing has to measure the harm AI can cause and the help it fails to give. Government shouldn't have to rely solely on AI developers to explain these failures. It needs its own testing capacity, with the expertise to ask hard questions and the tools to answer them. Scale has worked with the U.S. government for years to test the risks and capabilities of AI models, and we're accelerating that work in the months ahead. Here's what we think America should do next: scale.com/blog/steer-the-ai-…
3
10
37
1,933
We’re partnering with @googlecloud to make it easier for enterprises to put AI to work. Our joint reference architecture is a blueprint bringing the Scale GenAI Portfolio to Google Cloud, with Gemini Enterprise integration. Excited to give builders a proven foundation to put AI to work faster. scale.com/blog/deploying-ent…
6
2
64
16,954
Today, we released SWE-Bench Pro V2, a refreshed public split of SWE-Bench Pro. The frontier keeps moving, and the standard for measuring it should move with it. We’ll keep strengthening our leaderboards, incorporating feedback, and building more rigorous evals for what comes next.
SWE-Bench Pro V2 is live. What’s new: 🧵
15
8
143
52,834
AI safety doesn’t translate one-to-one. We partnered with the Korea AI Safety Institute to develop ROK-FORTRESS, our first benchmark together, testing how language and geopolitical context affect AI safety. Across 14 frontier models, we found that translation alone can miss meaningful differences in model behavior. scale.com/blog/korea-ai-safe…
5
6
44
17,333
Scale retweeted
This week I joined @RoyalFamily, govt ministers and leaders to discuss how AI can best serve the public good. AI can expand opportunity and solve some of our toughest challenges. It’s essential that we pursue that potential responsibly, in a way that benefits people broadly. Rigorous, independent testing - like we do at @Scale_AI - is an essential step to earning public trust. Governments and independent evaluators need to work together to deeply and continually assess AI's capabilities, opportunities, and risks. That allows us to make sound decisions about its development and use. Conversations like this one are a step in the right direction.
“I really am enormously grateful for the presence in this room of many of our greatest technological minds, and indeed, for the thoughtful stewardship demonstrated by those gathered here today as you consider the fundamental principles that should – and must – guide the development of Artificial Intelligence in the years ahead.” Today at Dumfries House, The King convened AI pioneers, Government representatives and thought leaders to discuss how AI can be developed and deployed in ways that benefit society.
2
4
30
3,977
Cue the makeover montage.
Still shipping nonstop. Here’s our new look
4
1
36
25,298