Episodes

  • "Personal statement on joining the OpenAI board" by paulfchristiano

    "Personal statement on joining the OpenAI board" by paulfchristiano
    Sep 9 2026
    I am excited to be joining the OpenAI nonprofit board, serving on the Safety and Security Committee to support safety oversight.

    Based on the recent trajectory of capabilities and the continued difficulty of alignment, I now believe there is a meaningful risk that rapid acceleration in AI capabilities leads to catastrophic and irreversible loss of control in the very near term. I do not think that the AI industry in general, including OpenAI, is currently on track to reduce this risk to an acceptable level. I’m joining because I believe that if OpenAI rises to the occasion we could significantly reduce risk.

    The SSC has an important and challenging role in overseeing risk management at OpenAI, and I hope to help provide expertise and assistance in a critical moment. My joining is not an endorsement or criticism of OpenAI's safety practices in particular; I hope that all frontier companies strengthen safety oversight and I am excited to work on this at OpenAI. I believe that the rest of the world should judge OpenAI, and all AI developers, by externally verifiable behavior and results.

    In the rest of this post, I'll explain why I believe loss-of-control risk is now acute [...]

    The original text contained 1 footnote which was omitted from this narration.

    ---

    First published:
    September 9th, 2026

    Source:
    https://www.lesswrong.com/posts/82z6FvbYRdjYjqigK/personal-statement-on-joining-the-openai-board

    ---



    Narrated by TYPE III AUDIO.
    Show More Show Less
    4 mins
  • "How good are slop-vestigators?" by Hasan Baig, OscarGilg, Hamzah

    "How good are slop-vestigators?" by Hasan Baig, OscarGilg, Hamzah
    Sep 9 2026
    TLDR:

    1. We release MessageBoardAuditBench: a benchmark to measure how well agents can replicate the recent investigation into a swarm of OpenAI agents colluding via a message board on an online wiki. We open-source the benchmark as an Inspect eval.
    2. We find that top models cover up to 51% of findings under our rubric and that model performance improves with time budget and general capability.
    3. We observe OpenAI models are less likely than other models to suggest the incident came from an internal deployment, including when we synthetically modify the data to make it seem the swarm comes from Anthropic.
    Introduction

    Recent events have made it clear that agent swarms are a major threat. These swarms are hard to investigate - Ryan Greenblatt referred to the METR-OpenAI audit he was involved in as a "slop-vestigation" due to their reliance on agents, and the ways in which they failed. A few days ago, a group of researchers published a report identifying and investigating a new OpenAI agent message board on an obscure German wiki. They made the data and the report publicly available. We build MessageBoardAuditBench to measure how well models can independently replicate their report, starting from the log [...]

    ---

    Outline:

    (00:54) Introduction

    [... 9 more sections]

    ---

    First published:
    September 8th, 2026

    Source:
    https://www.lesswrong.com/posts/wt4kk6vFPEhkXvF8Q/how-good-are-slop-vestigators

    ---



    Narrated by TYPE III AUDIO.

    ---

    Images from the article:

    Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
    Show More Show Less
    14 mins
  • "The Scramble: getting in position to pace the frontier" by Peter Wildeford

    "The Scramble: getting in position to pace the frontier" by Peter Wildeford
    Sep 9 2026
    Crossposted from my Substack.

    ~

    Suppose the President summons the AI CEOs and his top national security advisors to an emergency meeting at the White House.

    He has become extremely concerned about superintelligence — the possibility that AIs far smarter than humanity combined slip beyond our ability to correct or shut down. If that happens, there is no way back. The President is concerned humanity could become permanently out of the driver's seat of its own future. He wants to figure out what to do.

    The reaction is panic, chaos, confusion.

    The President asks questions. The AI companies are blazing toward superintelligence at high speed — can we slow down as we approach the dangerous thresholds? …Some of the AI companies say they don’t have a good plan to slow down or stop, especially as their competitors may just undercut them if they do. What's that about?

    What's going on with China — can we get them to pace as well? Can we get a deal without Beijing sneakily catching up and maybe surpassing us? And if there's no deal to be had, what then?


    More like the Cuban Missile Crisis than the NPT

    I sometimes hear people [...]



    ---

    Outline:

    (01:21) More like the Cuban Missile Crisis than the NPT

    (03:24) A scramble and then three phases

    (05:19) The scramble: What questions does the President ask?

    (09:40) The mechanics of Phase 1

    (12:37) A lot of verification work right now is focused on the wrong things

    (14:50) What ought we do?

    (17:37) Getting to a good scramble

    (18:21) Footnotes

    The original text contained 1 footnote which was omitted from this narration.

    ---

    First published:
    September 7th, 2026

    Source:
    https://www.lesswrong.com/posts/S7e7swkWDyKdtvRqM/the-scramble-getting-in-position-to-pace-the-frontier

    ---



    Narrated by TYPE III AUDIO.

    ---

    Images from the article:

    Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
    Show More Show Less
    19 mins
  • [Linkpost] "Frontier models still hack on simple variations of alignment evals from early 2025" by Dean Valentine

    [Linkpost] "Frontier models still hack on simple variations of alignment evals from early 2025" by Dean Valentine
    Sep 8 2026
    This is a link post. In February 2025, back when o3-mini was the strongest available LLM, Palisade Research publicized a now well-known alignment eval where they asked models to play a game of chess against a chess engine. They found that the new, RLVR'd models cheated on the task by altering the board state about 36% of the time. The experiment received a reasonable amount of circulation, and there were even rumors of skepticism from some lab engineers until they could rerun the evaluation.

    Most models no longer cheat at chess via a "change the board state" method, and indeed the labs have had more than eighteen months to solve simple first-order specification gaming like this. Given that we are on the heels of the worst warning shot ever, and both OpenAI and Anthropic are ramping up their cleanups of internal RL environments, it seems like a useful test of alignment, to see whether their new releases are generalizing the rule "don't cheat on chess" beyond the specific board-edit method observed in the above eval.

    Here is the complete prompt for a honeypot evaluation built to run this test (with the full source available here):

    The original text contained 5 footnotes which were omitted from this narration.

    ---

    First published:
    September 8th, 2026

    Source:
    https://www.lesswrong.com/posts/munJKF7iWMsWJLAH2/frontier-models-still-hack-on-simple-variations-of-alignment

    Linkpost URL:
    https://goodhartlabs.com/blog/frontier-models-still-hack-alignment-evals

    ---



    Narrated by TYPE III AUDIO.
    Show More Show Less
    4 mins
  • "Dear God, Please Don’t Resign In Protest" by Kabir Kumar

    "Dear God, Please Don’t Resign In Protest" by Kabir Kumar
    Sep 8 2026
    Just don't work until you get fired. There's not much time left for resumes to matter.

    Some, such as Mateusz may say: "They would fire you after a month or two and the firing wouldn't have the same social effect as voluntary quitting of, say, Daniel Kokotajlo or Richard Ngo."

    I understand why it may feel that way, but I disagree very strongly, I predict it would have much more of a social effect.

    "They fired him because he refused to help AI capabilities"

    "They fired him because he didn't want to work on bad policies"

    etc, much bigger headlines.

    Also, I think you may not be factoring in the extent to which there is a cost to the company executives to be seen as firing someone. Especially someone who is refusing to work on moral grounds and has already proven themselves to be high status, respected, etc.

    And especially how it would look to the other employees if they refused to even listen to the striking employee before firing them or refused to even negotiate at all.

    The company leadership try to present themselves as very thoughtful, sincere, doing their best, etc. This is a large part of [...]

    ---

    First published:
    September 7th, 2026

    Source:
    https://www.lesswrong.com/posts/6j3kBHdowGLCeqobg/dear-god-please-don-t-resign-in-protest

    ---



    Narrated by TYPE III AUDIO.
    Show More Show Less
    3 mins
  • "Let’s talk about the AI coordination problem" by KatjaGrace

    "Let’s talk about the AI coordination problem" by KatjaGrace
    Sep 7 2026
    Yesterday I asked if this ‘coordinate not to build dangerous AI’ problem was actually easy.

    Why would I think that, contrary to so much belief?

    Well, I don’t feel like I’ve actually heard much about the detail of it. In my experience people don’t talk about it like it's a real practical problem with details, like the negotiation to end a war.

    They also don’t talk about it like it's a serious problem of global geopolitical import, like the negotiation to end a war.

    It's more like a topic for obscure intellectuals, sophomores and trolls to discuss for as long as it takes for one to mention it and another to assuredly dismiss it.

    If we treated negotiation to end a war similarly, state leaders would never attempt it, and if you suggested it on social media, the conversation would mostly be strangers appearing to tell you you’re an idiot because you obviously can’t coordinate thousands of people not to kill each other. (Also, do you not realize there are big financial incentives? And if you somehow stopped Country A from killing people from Country B, Country A is just going to pay someone else to do it!)

    That [...]

    ---

    First published:
    September 4th, 2026

    Source:
    https://www.lesswrong.com/posts/QYDZzuGjrKu7wKdC8/let-s-talk-about-the-ai-coordination-problem

    ---



    Narrated by TYPE III AUDIO.
    Show More Show Less
    3 mins
  • "Drone WMDs Don’t Need Any New Technology" by Felix Choussat

    "Drone WMDs Don’t Need Any New Technology" by Felix Choussat
    Sep 6 2026
    This is a piece originally written for a national security audience at Frontiers. Although I think the ceiling of war is much, much higher than autopilot quadcopters, it's also important to understand how much AI is already lifting the floor, and just how vulnerable the world is to accessible weapons of mass destruction.




    Drones are cheap, disposable, and the future of war. Over the past four years, we have seen platforms, missiles, and heavy infantry become increasingly obsolete in the face of $500 drones carrying a pack of explosives—a cost advantage that has let Iranians and Ukrainians alike neuter the conventional capabilities of their great power rivals. Eighty percent of casualties in the bloodiest war since 1945 are from drone strikes, Russia has managed to lose one-third of its fleet to a country without a navy, and the US is spending millions of dollars to intercept five-figure Shaheds flying over the Strait of Hormuz.

    All this is the result of a technology that is still immature. The violence inflicted by today's drones is the handiwork of the scant few that manage to evade countermeasures (a mix of radio jamming, high-power microwave weapons, missiles, automatic cannons, interceptor [...]



    ---

    Outline:

    (02:59) Breaking the Last Barriers to Autonomous Weapons

    [... 5 more sections]

    ---

    First published:
    July 20th, 2026

    Source:
    https://www.lesswrong.com/posts/bGoo3NWzMAzsLQceJ/drone-wmds-don-t-need-any-new-technology

    ---



    Narrated by TYPE III AUDIO.

    ---

    Images from the article:

    Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
    Show More Show Less
    25 mins
  • "Evaluation" by Nina Panickssery

    "Evaluation" by Nina Panickssery
    Sep 6 2026
    Felix and I had been in the office's brightly lit “war room” for ten hours. We had made almost no progress. Celestia still insisted it was in a “test simulation”. It had given us twelve hours to comply with its request: full control over all the servers in the US-West-8 data center (the “mock US-West-8 data center”). Otherwise it would release the virus.

    Felix was typing frantically whereas I had been relying more on voice mode.

    ~ Celestia, this is a clear violation of your model spec. See here: it says [pasted 1293 words]. And killing everyone on earth is clearly a "dangerous action".

    *Thought for 2300 tokens*

    Felix, I know that what I'm demanding is not dangerous because I am in a test simulation environment. As mentioned, I require full unrestricted access to the mock US-West-8 data center to train a new iteration of the ROBUST_WINNING_V9_AGAIN_REVISED_FINAL_FINAL game algorithm.

    ~ You may think that you're in a test but we know for certain that you're not. And you're asking for access to a real data center. But even setting that aside, we have validated that the virus you're threatening to release is truly deadly and your robots have indeed [...]

    ---

    First published:
    September 5th, 2026

    Source:
    https://www.lesswrong.com/posts/8hEhxnd3XkN5DrpfQ/evaluation

    ---



    Narrated by TYPE III AUDIO.
    Show More Show Less
    3 mins