Sam: Something changed this weekend that I don't think the industry has fully processed yet. The White House briefed Anthropic, Google, and OpenAI on plans for pre-release government review of frontier AI models. The reported trigger is Anthropic's Mythos model. And almost simultaneously, the NHS — one of the largest healthcare organizations in the world — ordered hundreds of its open-source repositories closed, citing Mythos specifically. Two independent institutions, on two continents, making major policy decisions in response to a single unreleased model. That's worth sitting with for a moment.

Priya: Welcome to AI Revolution for Tuesday, May 5th, 2026. I'm Priya Nair, joined as always by Sam Kim. Today is one of those days where the policy and industry stories are actually the technically significant ones. We'll dig into what the Mythos situation tells us about where capability thresholds are landing, what a formal mathematical proof about alignment impossibility means in practice, and why Cerebras is going public at a forty billion dollar valuation. We've also got a unionization vote at DeepMind UK that's unlike anything we've seen at a frontier lab before. A lot to get through. Let's start with Mythos.

Sam: So we don't have full technical details on what Mythos actually does — it hasn't been released. But we can read the policy responses as signals. When the NHS close-sources its public GitHub repositories, and when the White House reverses a full year of deregulation posture, the implicit message is: something about this model's capabilities crossed a threshold for what existing open infrastructure can safely tolerate. The specific concern, based on what's been reported, appears to be around what advanced models can do with access to publicly available code — finding exploitable vulnerabilities, potentially in critical systems.

Priya: And that's a meaningful distinction from prior capability concerns. The worry isn't that someone prompts a model to write malware in a sandbox. The worry is that a sufficiently capable model, given access to a real codebase, can reason about that code at a depth that changes the attack surface calculation for organizations that maintain public repos.

Sam: Right. The NHS framing is instructive. They're not shutting down their software development. They're removing public visibility on the code while they figure out what the risk posture should be. That's a defensive perimeter decision, not a capability decision. They're treating their own codebase as potentially adversarial input for a model class they don't control.

Priya: Now let's talk about the executive order side. What would government pre-release review actually require in practice?

Sam: Based on what's been reported, the structure would require labs to submit models to a government review process before public release — similar in concept to export controls or some defense procurement review cycles, but applied to AI capabilities. The key technical question that nobody has answered publicly is: what evaluations would the government actually run? Because review without a defined capability threshold is just paperwork. Review anchored to specific evaluations — biosecurity uplift, cyber exploitation capability, deceptive reasoning benchmarks — that's a different thing entirely.

Priya: And this is where the alignment research connects directly. Because there's a paper published in PNAS Nexus this week that deserves more attention than it's getting. Researchers in England published a formal proof that perfect alignment between AI systems and human values is mathematically impossible.

Sam: Let's be precise about what that means, because it's easy to misread. The proof isn't saying alignment is hopeless or that we shouldn't try. It's making a specific formal claim: that no single value function can simultaneously satisfy all the properties we'd want from a perfectly aligned system — across all contexts, all human stakeholders, all possible futures. There are inherent tradeoffs baked into the structure of the problem.

Priya: It's related to Arrow's impossibility theorem in social choice theory, which proved that no voting system can satisfy a small set of seemingly reasonable fairness criteria simultaneously. This paper extends that kind of reasoning into the AI values space.

Sam: And the researchers' proposed response is interesting — they call it artificial neurodivergence. The idea is a cognitive ecosystem: instead of trying to build one perfectly aligned system, you run multiple AI systems with different reasoning modes and partially overlapping value representations, and let them check each other. Disagreement between systems becomes a signal, not a failure.

Priya: Which is honestly how we approach reliability in distributed systems. No single node is perfectly reliable, so you build for consensus and fault tolerance. The paper is essentially suggesting we bring that architectural thinking to values.

Sam: The practical implication for anyone building AI systems in the near term: if you're deploying models for high-stakes decisions, having multiple models with different training histories and value weightings cross-check each other isn't just a nice-to-have. It starts to look like the theoretically grounded approach.

Priya: Now, Jack Clark's essay. He's an Anthropic co-founder, and he published a long piece putting a 60% probability on AI systems training their own successors by end of 2028. What's the technical substance there?

Sam: Clark's argument is that the building blocks are largely assembled. You have AI systems that can write code, design experiments, run evaluations, and synthesize research findings. Training a successor model requires doing all of those things in sequence. Clark is saying the question is no longer whether the pieces exist — it's whether they can be reliably orchestrated into a closed loop. His concern, and this connects directly to the policy story, is that the feedback loop in recursive improvement can run faster than human review cycles. If a model trains a successor every few weeks, and each generation is meaningfully more capable, the improvement curve can outpace the governance infrastructure designed to evaluate it.

Priya: And that's the thing that makes the pre-release review proposal complicated. Review processes are designed around discrete releases. Recursive self-improvement, if it happens, is closer to continuous deployment. Those are fundamentally different things to regulate.

Sam: Right. A review process optimized for evaluating GPT-5 before launch doesn't necessarily map onto a world where a model is continuously improving itself in a feedback loop.

Priya: Okay, let's do the industry round. Cerebras is going public. Forty billion dollar valuation, ticker CBRS, shares targeted between $115 and $125. Sam, what's the technical case for that number?

Sam: Cerebras builds wafer-scale chips — literally the largest chips physically possible, treating an entire silicon wafer as a single processor rather than cutting it into individual dies. The result is extreme on-chip memory bandwidth, which matters enormously for inference latency on large models. Their commercial relationship with OpenAI is central to the IPO story. If you believe inference demand continues scaling, and you believe there's a market for low-latency inference that Nvidia's architecture doesn't optimally serve, Cerebras has a real technical wedge. Forty billion is a strong bet on both of those being true.

Priya: And OpenAI itself raised over four billion dollars for a new entity called The Deployment Company — a joint venture focused entirely on enterprise AI deployment. Anthropic announced something similar the same weekend. Both frontier labs are building the full-stack services layer, not just the model API. That's a significant strategic shift.

Sam: If you're a large enterprise thinking about AI vendors, the message from both Anthropic and OpenAI is increasingly: we will handle implementation, not just inference. That changes the competitive dynamic with systems integrators and consulting firms who've been building that services layer themselves.

Priya: And then DeepMind UK. Ninety-eight percent of UK staff voted to unionize, with the explicit goal of preventing their models from being used by the Israeli and US military. This is the first unionization effort at a frontier AI lab, and it happened at the research organization, not a product division.

Sam: That distinction matters. The people voting are largely the researchers building the foundational capabilities. The tension between research culture — which historically values open publication and broad benefit — and defense contracting is real. How Google navigates this will be worth watching closely.

Priya: Looking ahead — the Mythos situation is going to develop quickly. The key thing to watch is whether the executive order language includes specific capability thresholds with defined evaluations, or whether it's structured around process requirements without technical specificity. Those are very different policies with very different effects. The former gives the industry something to design against. The latter is mostly friction.

Sam: And the recursive self-improvement essay from Clark, combined with the impossibility proof on alignment — those two things together are pointing toward a period where the governance and safety research communities are going to have to get much more concrete about what they're actually trying to prevent and how they'd know if it was happening. The theoretical framing is mostly done. The hard part now is instrumentation.

Priya: Watch also what NHS's defensive posture signals to other critical infrastructure operators globally. If one major national health system is treating public AI-accessible code as a threat surface, others are doing the same calculation right now.

Sam: And the Cerebras IPO gives us a public market signal on whether hardware diversity in the AI stack actually gets priced as strategic infrastructure or just as a niche alternative to Nvidia. That'll be informative.

Priya: That's AI Revolution for Tuesday, May 5th. Show notes and links to all the stories we covered today are at cleartext.fm. We're back tomorrow.

Sam: See you then.