As I said on @LBC: AI companies can no longer reliably control their systems.
4
5
36
4,786
My office is hiring an Artificial Intelligence Policy Fellow to help shape AI legislation and track AI developments in the private sector as Congress works to keep pace with the technology. Experience in AI, policy research, or national security is encouraged.
The new fellow being hired by @RepNateMoran looks set to be the only staffer recruited directly by a member of Congress to focus exclusively on AI Will more follow? Story by @vronirwin transformernews.ai/p/nathani…
7
31
190
20,721
Quite hard to reconcile this with all the “we must beat China” talk
OpenAI once pushed to keep AI chips from China. Now it's staying quiet. politi.co/3TRuwRQ
2
3
37
1,039
Shakeel retweeted
Crazy that idol show and dating show for AI characters are actually a thing in China now. According to the data of one such show, 92% of the audience are women and most ppl are between 18 and 23. Fans are drawn to characters whose personalities reflect their own, often through zodiac signs or MBTI types. AI tools let them create outfits, performances, and stories for their AI idols. Fans also said that interactions with accounts run by production teams make those AI characters feel close and real. According to one fan quoted in the article: “If you think of her as virtual, of course she’ll feel distant. But if you think of her as someone who exists, someone who can talk to you every day—and you can imagine what clothes to put her in, how to dress her up, what styles she could try—over time, it starts to feel different.”
2
3
10
959
The @NYTimes Fellowship is now accepting applications for its 2027-28 class. The program offers early career journalists the opportunity to work in the newsroom for one year. The deadline to apply is Friday, Nov. 20. nytco.com/press/applications…
2
54
93
16,992
Shakeel retweeted
Looked into recent FEC filings and wouldn't you know it, Anthropic co-founder Tom Brown started cutting checks to Republicans right around the time he became Dario Amodei's White House whisperer hardresetmedia.com/p/anthrop…
1
2
8
828
Shakeel retweeted
Little tidbit tucked into my latest—Moran told me he’s taking a look at that bill Beyer and Jacobs floated at The Curve 👀 transformernews.ai/p/nathani…
The new fellow being hired by @RepNateMoran looks set to be the only staffer recruited directly by a member of Congress to focus exclusively on AI Will more follow? Story by @vronirwin transformernews.ai/p/nathani…
2
6
19
1,491
Shakeel retweeted
The new fellow being hired by @RepNateMoran looks set to be the only staffer recruited directly by a member of Congress to focus exclusively on AI Will more follow? Story by @vronirwin transformernews.ai/p/nathani…
2
3
20
19,828
Shakeel retweeted
wow, joel kaplan leaving meta per internal memo not a household name but about as significant as could be in meta politics land not lost on me that a midterms wipeout is expected and kaplan was the conservative whisperer at the top
26
100
1,021
82,362
Some news! Transformer is spinning out from Tarbell and becoming its own independent organization. We're very grateful to Tarbell for incubating us and acting as our publisher for the last couple years. In that time, we've built up an enviable subscriber list — incl. staff across Congress, the executive branch, and frontier AI companies — and regular citations from the NYT, New Yorker, Washington Post and many others. We're doubling down on our success, with ambitious 2027 and 2028 growth plans. We're very excited for the flexibility becoming an independent entity will bring us!
Some news to announce from Tarbell: @ReadTransformer , the publication dedicated to covering the power and politics of transformative AI, will spin out from the Tarbell Center for AI Journalism and become an independent organization.
21
7
183
6,452
(We're also fundraising for the new entity — if you work at a foundation or philanthropy keen to support our impactful AI policy reporting, drop me a line...)
2
9
511
Shakeel retweeted
Anthropic's Frontier Safety Roadmap has been updated to include two new policy goals: a policy proposal on embedded third-party evaluators (due 12/15) and a policy framework to target the pace of AI development (due 1/15). anthropic.com/responsible-sc…
1
2
14
882
👀
At @MorePerfectUS and @AINowInstitute event at Webster Hall, @ZohranKMamdani calls on @GovKathyHochul to sign the Responsible Data Center Development Act, legislation that would regulate the growth of large-scale data centers beyond the moratorium.
3
861
Shakeel retweeted
Its mind-boggling to me that so many people are hesitant to support AI safety rules on the grounds that it might help China, but some of those same folks want to sell far more advanced AI chips to China. Sad to see OpenAI retreat on this issue (to keep NVIDIA happy?)
OpenAI once pushed to keep AI chips from China. Now it's staying quiet. politi.co/3TRuwRQ
4
19
132
3,123
Notable, given Wiener's been a beneficiary of spending from Anthropic-linked PACs
Anthropic’s AI safety proposal falls far short of protecting public health and safety. Congress must go further. We’re facing huge risk from even the current generation of frontier AI models, and that risk will only escalate with further model development. Government’s most basic obligation is to protect public health and safety. In the context of AI, that means Congress must ensure that AI benefits people and doesn’t harm people. Quick, effective, robust regulation is essential. Several provisions in Anthropic’s proposal go beyond what has been proposed in Congress so far, but big picture, this proposal is insufficient to manage the catastrophic AI risks about which Anthropic, other companies, and many experts are warning us. Anthropic’s proposal contains no minimum standards for AI companies’ safety plans or for third party auditors, and the proposal would make it even harder for the federal government or states to nimbly regulate and act to prevent severe harms. If we’re going to have safety standards and auditors — and we must — it’s essential that regulators have flexible authority to ensure they are actually protecting people. The proposal also uses a definition from SB 53 that was intended for risk disclosures — not for broader regulation — and extends that definition to dramatically limit the situations in which the federal government can stop model deployments. SB 53 was the first AI safety regulation in the country. It is a transparency law, and we intended it to be the first step, not the final step, to protect people from catastrophic risk. Misuse of that law’s definition would effectively gut the emergency shutdown provisions in this proposal. The state law preemption in Anthropic’s proposal also goes too far. Given the abuse we’ve seen by the Trump administration — toward Anthropic earlier this year and more recently when Trump and Musk colluded to disable Starlink/Starshield for Ukraine, as part of their corrupt love affair with Putin — it’s perfectly reasonable to be concerned about corrupt government actors using shutdown powers to attack disfavored companies. Yet, given the scale of the risks about which these companies and many others are warning us, as well as the turbulence of our federal politics, tying the hands of regulators in California and other states is not a good idea. There are several stronger policy proposals, around auditing, creation of a regulator, and various other issues, that are under development now. Policymakers should look to these proposals as the basis for action in the coming weeks and months. We have very little time to get this right, and we must act with urgency. We must ensure Congressional action protects public health and safety and doesn’t undermine it.
1
19
1,300
*actually just the one PAC as far as I know
144
“Amodei” gave me a real jump scare (it isn’t Dario, don’t worry)
Community note
The quote is from retiring Nevada Rep. Mark Amodei (R-NV) about a House candidate, per WSJ and local reporting. It is not from Anthropic CEO Dario Amodei. x.com/natalieandrews… x.com/MiniRacker/sta… en.wikipedia.org/wiki/Mark_Amod… en.wikipedia.org/wiki/Dario_Amo… wsj.com/politics/elect…
2
42
1,733
Shakeel retweeted
Anthropic's leaked federal AI bill draws widespread criticism from AI safety advocates for being significantly weaker than the bipartisan FRONTIER Act (@shakeelhashim / Transformer) (Visit Techmeme dot com for the link and full context!)
1
3
5
3,677
Shakeel retweeted
A costly signal that would mean a lot to the public is if Anthropic said they were not releasing Fable 5.5 in advance of the IPO as a gesture of good faith towards pausing the frontier
1
6
489
Reminder that I've placed a $3000 referral bounty on this data viz job. Send me someone who is energized making complex data and decisions as fascinating and legible to lawmakers as they are to experts. ifp.org/opportunity/graphic-…
10
17
55
26,006
👀
Personal update: Turns out that what I thought was leaving OpenAI became more of a sabbatical. When I left a few months ago, I felt that the most important thing to focus on was making AI more useful to people. But we’ve since entered a different regime of AI progress. One in which getting the safety and security challenges of increasingly capable AI right has to become a central priority. So I’ll be returning to OpenAI, joining @merettm to help chart a path through these challenges. There’s much work to do, so let’s get going.
867
Recently, a draft leaked of federal bill text being circulated by Anthropic. The bill does have some good elements, many of which have been seen before in state legislation (for example in Massachusetts) that Anthropic also supported in the past. I previously wrote about many of those elements here: nitter.siddz.com/Thomas_Woodside/status…. Overall, however, this bill would be bad if passed into law, and I believe that circulating it has been counterproductive for federal AI safety discussions. I wish that Anthropic were embracing something closer to our policy suggestions here: secureaiproject.org/californ…. Here are my concerns about the bill’s content in more detail: 1. No minimum safety standards: The bill does not authorize any agency to create minimum safety standards requiring AI developers to implement any practice. This should be an important component of any federal framework; otherwise, all decisions are made purely by ad hoc court orders, which is not a good way to ensure safety. It does allow the agency to designate (but not create) security (not safety) standards. 2. Weak “blocking orders:” the government can only block a model if a risk is imminent, and the bar for showing that is high. There are many procedural requirements, such as the requirement that the agency head personally certify a lot of the filing, that would make it challenging to use this blocking power. In my view, an agency should be able to issue orders that take effect immediately if there is an imminent need for action (an imminent need for action differs from an imminent risk because it would include instances when an action is necessary soon to stop a risk, even if the harm itself would occur at an indeterminate point in the future). The agency should not have to wait for a court in such cases, although a court should of course be able to review quickly. 3. Evaluator shopping: We’ve previously said that at least some evaluators need to be selected by the government, not just chosen by the companies they are evaluating. This bill doesn’t even provide an accreditation system for evaluators, much less government selection. Instead, it provides only a rating system, which developers can feel free to ignore, except once the agency is doing a blocking order proceeding. 4. No “pacing:” This bill doesn’t go far enough in terms of pacing. If Anthropic does not embrace robust minimum standards, we think it’s especially important that something like compute-pacing be included. See our pacing proposal here: secureaiproject.org/californ…. 5. No embedded evaluators: There isn’t a requirement that evaluators be embedded at AI companies or that they continuously assess risk. They do have a requirement to produce rapid reports in certain circumstances, but without a duty to actually constantly assess whether they actually should produce a rapid report, it’s unclear whether they’ll do so. 6. No dispute resolution process: If an evaluator lacks information that it needs from a developer and the developer refuses to provide it, there isn’t a clear process to resolve the dispute. For example, there could be a process that permits the agency to order the information handed over, with a court review if a party disagrees. At present, the agency has to bring an action for a violation, which is very time consuming and would likely only happen in egregious cases. 7. Weak incident reporting: The definition of what is required to be reported is written very narrowly. It would not even cover incidents like Hugging Face unless they cause $250,000+ in damages (only the number of such incidents would have to be reported annually). 8. No preventing coercive control of government/secret loyalties: The bill doesn’t have provisions aimed at preventing insiders at AI companies from using powerful AI systems to coercively take control of government or otherwise provide themselves with significant advances. 10. No reporting of AI R&D automation: While covered as a risk factor, there are no reporting requirements to allow the public to understand how AI is being used to automate AI research and development unless the developer assesses this poses another “enumerated risk.” To be clear, I don’t think it’s necessary for every draft bill to have all of the above policies in it. That would be an unrealistic standard. It’s possible to have narrow, tight bills focused on particular problems that make a solid contribution to the discourse. That said, not everything in this bill is executed well, such as the blocking orders. More importantly, because it includes preemption, floating a bill this weak will likely have a detrimental effect on the political discourse. When a bill includes state preemption, it must be interpreted as the proposer’s view of what is “worth” that preemption. This is how everyone in DC will interpret it, so the proposer needs to propose it in that light. Anthropic is seen by many as being in favor of strong regulation (and state regulation), and portrays themselves that way. Their bill draft could give the false impression that this is what strong regulation looks like, anchoring future discussions and negotiations in a very suboptimal place. I do not think that the policy Anthropic has put forward is worth preempting all state frontier AI disclosure, evaluation, incident reporting, and possibly (the drafting seems to contain an error) model blocking laws. Anthropic representatives have said they circulated this in part because “it’s important to get early feedback from policymakers.” However, in my view, floating language like this signals to policymakers that Anthropic is prepared to support it as is. And as is, it is a bad bill.
Anthropic has published a new policy framework for frontier AI. I’m happy to see it! Importantly, it takes seriously the need to sometimes stop AI companies from taking actions that pose a substantial risk of catastrophic harm. There are also some areas where it could be improved.
7
14
56
3,356