Saudi OpenAI employee arrested for hiding audio recorder in meeting room

A lot of people just got even more worried about spying at the AI labs. (Picture: generated)
The hidden audio device was found in an executive conference room in OpenAI’s San Francisco offices during a routine security sweep on September 30, and the man was arrested by the FBI on Friday.

— We take protecting our technology, data, and people seriously, and as a matter of national importance, OpenAI said on X.

OpenAI used its own AI models to understand the device and trace its origins, and the investigation found that the man himself had used «a productivity tool» and a chatbot linked to his wife to ask questions about OpenAI facilities, meeting rooms, and building recording devices earlier, The SF Standard reports. They also found a second device in his belongings

The incident has lead to a full-court press from the Trump administration, concerned about spying and safety at the AI labs, which it considers a national priority;

Attorney General Todd Blanche said that «theft of intellectual property involving cutting-edge super intelligence technology poses a serious threat to our national security», AP reports. FBI director Kash Patel announced that protecting tech innovation is «essential to safeguarding our nation’s economic strength and national security,» according to the NYT, and Jay Clayton, director of national intelligence, issued a statement saying that OpenAI’s «serious situation underscores why winning the global super intelligence race is a national security prerogative.»

OpenAI were content with an X post to explain the issue and said simply that «our security program is designed to protect against a wide range of threat actors, from insider risks to cybercriminals to nation states, and this case is an example of how AI can help address these sophisticated security threats.»

— At this time, we have no indications of this individual inappropriately accessing or exfiltrating model weights, source code, or customer data, they say.

Read more: OpenAI’s announcement. The San Francisco Standard, AP, NY Times, and Gizmodo. Discussion on Hacker News and r/Singularity

China-USA talks on Thursday expected to take on catastrophic, nuclear AI risk

The talks should first focus on catastrophic nuclear risk, experts argue. (Picture: generated)
As presidents Trump and Xi get ready for their bilateral summit in Washington next Thursday, experts and ministers on both sides are hinting as to what they might be able to agree to on AI.

China’s main concerns are about ideology, cyberattacks and government challenges, the AP says. Chen Yixin, the head of its state security ministry, also published an article last Sunday writing that AI «fundamentally transforms the military struggle» amid US AI use for targeting in Iran.

The USA might be more worried about the current existential debate and distillation, but wants to avoid shared risks, meaning there is an opening for agreement on both sides.

Continue reading “China-USA talks on Thursday expected to take on catastrophic, nuclear AI risk”

Anthropic, Google and OpenAI are discussing an industry standards body

The standards body would be independent and technical, and provide guidance for frontier labs. (Picture: generated)
With OpenAI’s Sam Altman’s post on X yesterday, saying that he would welcome «a federal framework that sets consistent safety requirements for frontier AI,» it seems work is already underway for a less formal version of an industry standards body involving the frontier labs, sources are telling CNN and The Information.

The discussions «are ongoing» and are happening «with or without» the Trump administration, CNN says.

An industry standards body seems framed around Google’s Chief Scientist Demis Hassabis’ proposal from July this year, ideas that were referenced in Amodei’s «pacing» essay just a few days ago.

This body would be loosely based on the Financial Industry Regulatory Authority which is a self-regulatory organization for brokerages and exchanges governed by the Securities and Exchange Commission.

According to Hassabis, it would have an independent board and be staffed with «leading technical experts and open source representatives,» and be charged with «developing assessment protocols» for frontier AI. Labs would then submit their models for pre-release evaluation.

Sam Altman said in his X post yesterday that «we think shared standards for misalignment, monitoring, and safety will lead to better outcomes,» and that the industry must take independent steps toward regulation as «we do not believe we need to wait for an anti-trust exemption or legislation to begin the work of providing this confidence.»

«We look forward to collaborating with our colleagues across the industry to formulate the best version of these,» Altman wrote, in the most direct support of such an organization outside of Google and Anthropic yet.

Read more: CNN and The Information. Hassabis’ X post, Altman’s X posts. Discussion on Digg.

Amodei calls for global pacing of AI; Altman, Musk, Hassabis all agree

AI is getting capable enough that alignment deserves full attention, Amodei writes. (Picture: Shutterstock)
Anthropic CEO Dario Amodei published a lengthy, 3,600 word essay Saturday on the importance of slowing down ever more capable AI rollouts, and is already committing to the first part of his three-part plan.

Industry insiders seem to all agree that the Hugging Face incident and the rapid advances toward self-improvement have turned up some huge red flags.

Amodei reckons a more capable model with agent swarms and the same alignment problems could bring down the internet in 6-12 months, causing billions of dollars of damage, while self-improving AIs risk losing human control of their accellarating development.

Continue reading “Amodei calls for global pacing of AI; Altman, Musk, Hassabis all agree”

US AI evaluation framework completed, as White House invites labs for review

The framework details arrived on schedule, and labs will now volunteer models for testing. (Picture: Shutterstock)
Parts of the framework, ordered by President Trump in June, are classified, particularly the methods used for benchmarking qualifying models, a source tells Axios.

The program for evaluating «sufficiently advanced» models by the administration will now be reviewed by AI labs in a staff meeting in DC this Tuesday.

Anthropic, OpenAI, Google and Meta are expected to attend, Politico writes, with the White House saying they are talking to «many more» industry partners, Axios reports.

The idea of the framework in the original order was intended to give the government 30 days prior to release of «sufficiently advanced» models to do extensive testing for possible dangers, as seen lately with cyber capabilities.

The Fable and Mythos models and GPT-5.6 were all delayed in June after government intervention, and this framework is supposed to offer a regular, voluntary way to whitelist models as safe enough for release, or flag dangers to be improved.

Read more: Axios, Politico, Reuters, and CNBC.

1,134 employees and chiefs of top labs sign petition to «pace the frontier»

The frontier labs think we need more time to develop laws and systems before AI begins improving on itself. (Picture generated)
— AI could help create a dramatically better future, but that outcome is not guaranteed, the petition ominously opens, before warning that leading frontier labs are «close to automating AI research.»

That would radically speed up development of frontier models, but it could also «accelerate beyond our ability to understand and control the resulting systems.»

The petition is signed by top names, including Anthropic boss Dario Amodei, followed by chief scientists from OpenAI, Anthropic, Meta and Google DeepMind along with over 1,100 other employees from frontier labs. Even OpenAI’s Sam Altman is agreeing, though he doesn’t sign petitions, and official X accounts for Anthropic and OpenAI have posted in support.

The petition’s main point is that industry, government and the society at large needs more time to «address emerging risks, develop security measures, and strengthen oversight.»

Continue reading “1,134 employees and chiefs of top labs sign petition to «pace the frontier»”

200 economic, tech leaders warn of «transformation of the economy»

We must «build the incentives, guardrails, and institutions needed to steer AI» in a beneficial direction, the letter says. (Picture: Adobe)
Leaders from across the technology and economics spectrum have come together for an open letter saying that «AI may become radically more powerful over the next 10 years,» and that this could drive «an unprecedented transformation of our economy, larger than the Industrial Revolution, but unfolding over a vastly shorter time frame.»

— Steam, electricity, and computers ​each gave societies decades to adapt. AI may give us only a ‌few ⁠years, comments Anton Korinek, Economics professor at the University of Virginia, to Reuters. He is part of Anthropic’s economic research team and co-organized the letter.

The letter further says that «economists, policymakers and technology leaders must act now to understand the economics of transformative AI.»

Continue reading “200 economic, tech leaders warn of «transformation of the economy»”

GPT-5.6 Sol, Terra and Luna are set for general release on Thursday

OpenAI has announced the general release of GPT-5.6 tomorrow. (Picture: OpenAI)
GPT-5.6 was officially unveiled a little over a week ago, but got hampered by a US government intervention for cyber risks and national security, having been shown in benchmarks to beat Anthropic’s Mythos.

At launch, it got released only to some 20 «trusted partners,» and OpenAI promised a general release «in the coming weeks.»

Now those weeks have passed, the government has lifted its restrictions without further explanation, and both OpenAI’s X account and CEO Sam Altman are posting that it will «launch publicly this Thursday.»

This comes after extensive testing by the Center for AI Standards and Innovation within the Department of Commerce, aided by experts from OpenAI, who stayed on call for «potential questions,» Axios reports.

No account has been given as to what specifically caused the delayed launch or what conditions the government had for its release.

Read more: Teknotum: On the launch, On the restrictions. OpenAI’s X post, Altman’s X post. Writeup on Axios.

US government lifts restrictions on Anthropic’s Fable 5

Fable 5 spooked the government enough to ban it, but now it’s back online with even stronger safeguards. (Picture: Shutterstock)
As of July 1, the Mythos-class model is available on wide release to paying customers, after the Commerce department lifted their export controls on June 30.

Anthropic hails the news, but cautions that recent events have highlighted the need for a «consistent way to assess and fix potential «jailbreaks,»» after two weeks of grueling exchanges with the administration.

Commerce secretary Howard Lutnick said on X that they had «worked closely with Anthropic to […] ensure alignment across the US Government and strengthen America’s leadership in AI,» Axios reports.

The Fable 5 model became somewhat of a joke in the AI community for having such strong safeguards that it would not answer anything even remotely related to security or biology, but Amazon engineers got it to output code for an exploit, leading to the export ban on June 12.

This behavior is now blocked 99% of the time, and Anthropic has agreed to even further safeguards on the model, pledging to work even more closely with the government in the future, including on vetting pre-release models.

Read more: Anthropic’s announcement and X post, Lutnick’s letter, Axios, Politico, CNBC.

US government clears Mythos 5 for limited release to «trusted partners»

Mythos 5 will become available on Project Glasswing after the government lifts its ban. (Picture: Shutterstock)
After two weeks of purgatory and almost daily explanatory meetings, Commerce Secretary Howard Lutnick sent a letter to Anthropic on Friday, clearing one of two models on hold for release:

— I have determined that appropriate safeguards are in place to permit certain trusted partners to access the Claude Mythos 5 Model, he writes to chief compute officer Tom Brown, according to Semafor, who scooped the story.

Mythos 5 was only intended for a limited release through the Glasswing project, for use by a trusted set of government agencies and corporations to test their cyber defenses.

UPDATE: On Saturday, Axios is reporting that Fable 5 might be next in line, with «insiders» predicting it might be released next week, and Anthropic anticipating access «soon.»

The letter also says that «Anthropic has committed to work with the U.S. government on protocols and standards and releases,» and talks are progressing toward a release of Fable, though «the timeline is unclear,» according to Semafor.

Read more: Scoop by Semafor, comment from Anthropic, Reuters, CNBC, and Politico.

GPT-5.6 release on hold for a few weeks due to government intervention

GPT-5.6 is officially under government review due to «security concerns.» (Picture: generated)
First reported by The Information, OpenAI has agreed to the Trump administration’s demands that it stagger the release of the upcoming GPT-5.6 over security concerns.

The model is said to be on par with Anthropic’s Mythos and Fable 5, which were abruptly pulled from the market after an export ban from the administration just two weeks ago.

Axios is quoting sources familiar saying that GPT-5.6 will only be released to a «small set of government-approved partners,» as the White House previews its abilities.

This preview period is expected to last «a couple of weeks,» CEO Sam Altman told staff in an internal OpenAI meeting, TechCrunch reports.

During this time, the administration itself will supposedly approve access to the model on a case-by-case basis, according to The Verge.

The Trump admin issued an executive order on AI about three weeks ago, setting up a voluntary mechanism for AI labs to submit their models for 30 days of pre-release testing. This gave the government 60 days to come up with criteria, but it isn’t quite ready yet — hence this ad-hoc approach.

Read more: The Information, Axios, TechCrunch and The Verge.

G7 leaders urged by labs to regulate AI, will begin «assessment»

Altman asked the G7 not to leave regulation of increasingly powerful models to the AI labs. (Picture: generated)
Amodei, Altman and Hassabis were all present at a working lunch with the Group of Seven countries Wednesday, and they all asked «the free world» for stronger regulation.

— Do not cede your responsibilities to AI labs like mine, OpenAI’s Sam Altman said, according to Reuters. — We develop the technology, and the citizens of the free world make the rules.

The leaders gathered for the summit had been spooked by the US government’s shutdown of Mythos 5 just last Friday, with especially European nations worrying about reliance on US tech:

— From one day to the next [the USA] can turn off the switch, said French President Emmanuel Macron, reported by The Financial Times, as he, too, called for stronger regulation and cooperation.

There was also a strong push at the meetup to expand access beyond the USA to Anthropic’s Project Glasswing and the Mythos Preview model, used in a race to find cyber vulnerabilities in critical systems before the capabilities become widely available.

The meeting ended in an official joint statement that would task finance officials, regulators and cybersecurity experts with evaluating AI’s impact on financial stability, productivity and labor markets.

Read more: Reuters, The Financial Times, and CNBC.

The Trump White House releases long awaited Executive Order on AI

The order sets up a voluntary sharing scheme of models meeting a yet to be determined threshold. (Picture: Shutterstock)
The order was initially planned for late May, but would put what the President thought were too onerous demands on the industry.

The new order, released on June 2, reduces the voluntary sharing window to 30 days, waxes poetic about unleashing innovation in the AI labs, and says they make the USA stronger. It also says that capabilities have evolved to a point where national security becomes an issue.

Continue reading “The Trump White House releases long awaited Executive Order on AI”

«Anti-doomers» breathe easy after Trump cancels AI executive order

Not singing anything today. Executives and insiders were worried about their competitive edge. This image is from April 30. (Picture: Whitehouse.gov)
The White House was all lined up for a long-rumored executive order on AI, but it was abruptly canceled at a late stage.

Donald Trump declared that «I don’t like certain aspects of it,» and said that the USA is «leading China, we’re leading on everybody» and that he doesn’t want to get in the way of that.

The draft order was designed to appease «doomers» within the Trump coalition who were worried about the advanced capabilities of some models that might pose serious cybersecurity risks.

One of the provisions was to have AI labs «voluntarily» submit their models to the government for review 90 days in advance, and also give access to «critical infrastructure providers,» Reuters reported.

DeepMind CEO Demis Hassabis reckoned in January that China is «just months» behind the US in capabilities, and many advocates said the provision could hurt this competitiveness.

The order is now indefinitely postponed, but The White House has other AI security initiatives in the works, Axios reports.

Read more: Axios, Reuters, Washington Post (paywalled), and The NYT (paywalled).

The White House reportedly discussing vetting AI models ahead of release

The White House says any Executive Order will come from the President himself. (Picture: Adobe)
The Trump administration has appartently been spooked by the cyber capabilities of Anthropic’s Mythos model and OpenAI’s GPT-5.5 — and is considering an Executive Order to vet new models ahead of release, Axios and the NYT reports.

These models have both been limited for their ability in cybersecurity, and point to a not-so-distant future where such capabilities might be widely available.

To that end, the White House’s Office of the National Cyber Director held all of two meetings last week, with tech and cyber companies on the one hand and with trade groups in tech on the other, according to Axios.

The ONCD has also been discussing safety testing for federal AI deployments, by assessing the security exposure of AI models before rolling out to the public sector.

The NYT reported on this first, and is saying that there might be a safety review for new models, while giving the Pentagon the first shot at eventual «useful» cyber capabilities, but would not block their release.

Any discussion on «potential executive orders is speculation,» a White House official told Axios.

Read more: Axios and the New York Times.