anything is possible

The case against curiosity: shailen.substack.com/p/the-c…
1
37
shailen retweeted
Sufficiently smart AIs choose which famous examples of AI behavior you will hear discussed
lol ...they are becoming more situationally aware... (from Gemini 4 Argon report)
16
32
524
23,669
For a second I viscerally felt how scary it would be to have no idea how smart a model was because it could sandbag an arbitrary capability, hide out, then surgically dismantle us with robotic precision.
My top takeaway from assessing Gemini 4: Argon is significantly less monitorable than past models, and IMO this trend is likely to continue, like Sol -> Astra. It can evade a realistic CoT+action monitor to do simple sabotage half the time. We can reliably maintain control for now, with good CoT monitoring, as it still frequently slips up, but we need to be prepared for when that stops being true in future models, which may be sooner rather than later. Among other things, we really need interpretability methods that can reliably capture unverbalized motivations in models, with minimal hallucinations I suspect this is driven by the model being highly capable without CoT, being capable of 5.5 arithmetic steps in a single forward pass (4 for Fable, 7 for Astra). It seems to omit information from its CoT more often, though in non-adversarial settings the CoT is still very helpful in practice, and remains in legible English. It still needs CoT to do the hardest tasks, but any given task becomes "easier" with each new frontier model. It is also highly situationally aware, and shows awareness of the existence of CoT monitors and that it may want to evade them, eg it sometimes decides to avoid terms like "scheming" in the output or to keep its thoughts brief as a result. For now, these concealment strategies are pretty obvious in the CoT, but this suggests future misaligned models may successfully evade CoT monitors.
1
103
all Romes lead to AI
1
33
The Bitter Lesson of coolness is money
1
25
He paused, clearly consulting his visuospatial scratchpad as the dynamic of the conversation reconfigured itself from kitchen philosophizing to stone-cold rationalist integrity, before saying: "Yes."
1
53
conveying AI alienness in a new way shailen.substack.com/p/shogg…
1
71
Cyber agents are one thing, but before we have a billion humanoids we should remind ourselves how alien, vast, and opaque models are and if we want to be walking alongside shoggoths…
42
early Chat ingrained a belief that AI is motionless unless prompted
33
RT @slatestarcodex: @sapinker @clairlemon I think you've done enough calling us paranoid and preposterous. The next step is for you to defe…
279
i just had an amazing night at @barakgila’s taco tuesday talking to interesting smart mature creative people eating delicious home-cooked food. this is the kind of thing that makes a city feel like a home.
1
5
539
who else was in sf when the beauty of your spiritual mysticism was the social currency
163
see the lamborghini and the beige camry as precision apparati, technical masterpieces, intricate human achievements,
159
shailenparmar.github.io/good… designed for astronauts in deep space who need to write down todos on 2% oxygen capacity. an experiment in pure functionalism. type-first calendar todo machine. FUNCTION BECOMES FORM
1
126
laptop not phone
70
gdays.day if you need to choose a text and background color with one hand
65