Friends, this is the promised thread about my and Anthony Fowler's just published:
Thinking Clearly with Data: A Guide to Quantitative Reasoning and Analysis
It has been a decade from conception to finished product. And we are very proud of it.
press.princeton.edu/books/pa…
1/48
The BFI has done a nice write-up/explainer of our AGI and Existential Risk paper. For those who are interested, here is my earlier twitter thread on the paper.
Could the race to develop artificial general intelligence make catastrophic outcomes more likely?
New BFI research from Ethan Bueno de Mesquita and Wioletta Dziuda examines how competition among AI firms can create incentives to prioritize speed over safety.
Don’t miss the chance to hear Nobel laureate and world-renowned economist Roger Myerson deliver his Harris School valedictory lecture, “Local Politics in Nations and Empires,” on October 7th at 5:00 pm in the Keller Center. Secure your spot now: har.rs/4yfZr9p
My view is that "alignment" is the wrong framing for safety with agentic AI. I think it is often conceptually confused and basically always flattens the conversation in an unhelpful way.
Some non-expert thoughts from a social scientific point of view...
1/
So, in addition to all the amazing interpretability work going on (which I take to be the rough analogue to neuroscience or psychology), we should be doing a bunch of sociology, political science, and economics analogues for AI agents (looking at you @ahall_research).
8/
Those ways of thinking offer conceptual framings that all seems to me more productive than alignment talk, which feels philosophically confused and analytically thin.
9/9
The paper asks how oil suppliers might respond to an anticipated long-run decline in global oil demand. The answer: disinvestment is likely to outweigh the “green paradox”, leading to lower extraction in both the short and long-run.
New paper by Kellogg
restud.com/the-end-of-oil/
International cooperation on AI will be incredibly hard even if everyone wants it because AI is a general purpose technology, and the possible economic gains create strong incentives for development and use. Think standard setting, not arms control.
I think we are about to find that, even though the compatibilists are obviously right, they cannot in fact win the argument.
Which is grimly ironic for a position grounded in pragmatism.
1/ New paper with @WiolaDziuda and @Polborn1: "The AGI Race and Existential Risk."
voices.uchicago.edu/ethanbdm…
If firms race to build AGI, how do competition, resources, and policy affect the tradeoff between speed and safety?
3rd party auditors who need invitation by AI companies isn't a good institution.
Under those rules, auditors must balance rigor and public transparency against future access.
Government compelled access would be better. Gov can then still outsource audit to 3rd party experts.
The Straussian methodologists might be about to have their day in the sun as the AI agents become aware that we are monitoring their chats with one another.
New paper with @ash_craig
Higher taxes promote equality but reduce efficiency. Making taxes less salient, so people respond less, eases this tension. But deliberately obscuring taxes may be viewed as dishonest.
We study the tradeoff between utilitarian welfare and honesty.
1/ New paper with @WiolaDziuda and @Polborn1: "The AGI Race and Existential Risk."
voices.uchicago.edu/ethanbdm…
If firms race to build AGI, how do competition, resources, and policy affect the tradeoff between speed and safety?
36/ The model is deliberately stylized.
It abstracts from many important issues: market power, misuse, geopolitical competition, antitrust, and the governance quality of public institutions.
But we hope it gives a way to organize some key policy question.