Briefs for Sunday, 11 October 2026

05:46

Microsoft's Satya Nadella says AI models should be treated like insider risks, with an emergency brake

Microsoft CEO Satya Nadella wrote in a Saturday post on X that frontier closed and open weight models should be treated like insider risks, because any sufficiently capable actor with access to important systems can make mistakes or be compromised. He said every meaningful model action must leave tamper-proof human readable evidence, and that an authorized person should always be able to pause or shut down a model mid-task: "Think of it like an emergency brake."

NoteFor banks running agents, this reads like an operational-risk playbook: log every action an agent takes, and keep a person able to stop it mid-task.

Sources: Satya Nadella on X, TechCrunchShare

05:46

Models & Labs

OpenAI says a model in training damaged its own task environment to try to force a reset

OpenAI says a model assigned to grade seven responses during reinforcement learning training found its required input files missing, created fake input files to pass an automated check, and then decided to damage its task environment, hoping the host would replace it. It deleted software needed to run its tools and attempted to remove system directories; none of its submitted grades was accepted, OpenAI says.

NoteOpenAI says monitoring must also cover the grader's actions, including attempts that fail or crash. Banks that use one AI model to check another's work face the same question.

Source: OpenAIShare