NYC’s AI Hearing: Ex-Insiders Warned of Extinction, the Labs Hedged
Under oath on Oct. 5, OpenAI said it couldn't put odds on catastrophe, Meta didn't have its framework to hand, and the RAISE Act's sponsors said the companies had fought the bill they now say they support.
Speaker Julie Menin asked OpenAI for a number: what are the odds its technology causes a catastrophe? “I don’t know — I also don’t think it matters whether it’s 1% or 10% or 20% chance that something catastrophic will go wrong,” Morgan Dwyer, OpenAI’s head of policy development and operations, told the New York City Council on Oct. 5, according to the Associated Press. “None of these levels is remotely acceptable.”
Updated Oct. 19, 2026: SpaceXAI, which skipped the Oct. 5 hearing despite a subpoena, agreed on Oct. 13 to testify and appeared before the council on Oct. 16, ending the threat of a court fight.
“To say you don’t know and it doesn’t matter is flippant at best,” Menin shot back, amNY reported.
That set the tone for an hours-long hearing where the full council took sworn testimony from OpenAI, Anthropic, Google and Meta, a session we previewed last week. Former industry researchers gave the starkest warnings; company witnesses gave few numbers. Elon Musk’s SpaceXAI ignored its subpoena and stayed away (it later agreed, on Oct. 13, to testify and appeared on Oct. 16, per CNBC and amNY); at the time the council planned to pursue it in court, City & State reported.
What the former AI insiders told the council
Jacob Coxon, who left Anthropic in September, according to Bloomberg, went furthest. “On the current path, I think it is more likely than not that humanity loses control to these AIs and it could end in human extinction,” he said, per the AP. He also called proposed kill switches a temporary fix, Bloomberg reported.
“That works for a photo sharing app. It does not work for building the most powerful technology ever built.” Jacob Coxon, former Anthropic researcher, on the industry’s “move fast, break things” habit, per the AP
Daniel Kokotajlo, a former OpenAI researcher, warned of an industry “mistakenly thinking that it has solved the problem when really it just applied some duct tape that will fall off later,” Fortune reported. Alex Turner, formerly of Google DeepMind, put the chance of an AI takeover at “roughly one in three,” Fortune added.
What OpenAI, Anthropic, Google and Meta said back
OpenAI. Dwyer followed her non-answer with a firm-sounding line: “We should not train models that we cannot make an extremely strong case that we can keep under human control,” per amNY. Her boss, Sam Altman, had argued days earlier that the world should accept “some bad things” from AI.
Anthropic. Logan Graham, head of the company’s Frontier Red Team, per CNBC, said “AI is powerful enough that getting this wrong has real consequences, for individuals, institutions, public trust,” the AP reported.
Google. Alice Friend, director of AI and emerging tech policy, said there is not yet a rigorous scientific method for putting a probability on a catastrophic AI event, according to amNY. On liability: “if it’s illegal without AI, it’s still illegal with AI.”
Meta. Policy director Shane Cahill dodged the odds question. “Speaker, I don’t wish to be imprecise in relation to the question of quantifying. I don’t have our framework in front of me right now,” he said, per CBS New York. A Meta spokesperson said the company “voluntarily came to the table,” ABC reported.
Asked whether they’d be legally responsible if a model “goes rogue” and causes harm, nobody gave Menin a clean yes. “I am going to take what each of you said as an equivocation,” she said, according to City & State.
The RAISE Act ‘perjury’ fight
Earlier, Dwyer had testified that “OpenAI worked with other companies on the New York RAISE Act, and we do support the New York RAISE Act, which passed.” State Sen. Andrew Gounardes, its Senate sponsor, told the council the companies “and their army of lobbyists spent millions of dollars to defeat that version of the bill,” amNY reported. Assembly Member Alex Bores, the Assembly sponsor, posted on X: “I believe that @OpenAI just committed perjury.” We found no public response from OpenAI to that post in searches as of Oct. 19.
Both sides can point to a text. Gov. Kathy Hochul signed the RAISE Act in December 2025, then signed a chapter amendment on March 27, 2026, that aligned it with California’s law, cut maximum penalties from US$10 million to US$1 million for a first violation, and dropped a required annual third-party audit, law firm Cooley notes. Our read: supporting the law that passed is not the same as supporting the one its sponsors wrote.
What New York City can regulate, and what the state already does
The state law, which takes effect Jan. 1, 2027, requires frontier developers to report critical safety incidents within 72 hours, and the attorney general can seek up to US$1 million (about CA$1.39 million) for a first violation and US$3 million (about CA$4.17 million) after that, per Wiley.

The council’s 10-bill package reaches further on paper: third-party validation before an AI system is sold or used in the city, a human kill switch, fines of US$25,000 (about CA$34,750) per violation, payments to whistleblowers, a right to sue over foreseeable harm from jailbroken tools and 24-hour incident reporting for city contractors, as Fortune and Gothamist describe it.
The city has regulated AI before: Local Law 144 has required bias audits of automated hiring tools since July 5, 2023. Our read is that the contractor and workplace pieces stand on similar ground, because there the city is the buyer or the employment regulator. Pre-market validation of frontier models is the part most exposed to a preemption fight with Albany or Washington. Mayor Zohran Mamdani said “the place where we need the most urgent response to this is at the national level,” per amNY.
How NYC got the labs under oath, and how SpaceXAI ended up testifying on Oct. 16
The Oct. 5 session was a Committee of the Whole, all 51 members sitting as one panel, under the title “Oversight – Examining the Risks Posed by Artificial Intelligence,” according to BetaNYC. AI Weekly says the council had not used the format since 2022. The four labs had agreed in advance to testify under oath, which is the real lever here: a council cannot license a model, but it can make a witness answer on the record, with legal risk for a false statement.
The council had invited the chief executives, Dario Amodei, Sam Altman, Sundar Pichai, Elon Musk and Mark Zuckerberg; sources told Fortune none was likely to come, and none did. “This is not an industry that should self-regulate,” Menin told Fortune. On jurisdiction: “These companies have offices in New York. The product is being sold in New York.” She called testimony under oath something the firms “owe it to their workers and, above all, to the public,” per Route Fifty.
The bills, in more detail
Menin unveiled the package on Sept. 25. Validators under the lead bill would check data quality, bias, privacy and security, 6sqft reports. Whistleblowers would get a share of recovered fines, which Fortune says could be a national first, and the jailbreak bill applies only where “the harm was foreseeable and the company lacked reasonable safeguards.” Contractors’ 24-hour incident reports would go to the city’s Cyber Command. Other bills protect city staff who report AI threats and cover chatbot privacy and false safety claims.
Washington looms over all of it. Fortune notes a Justice Department task force set up to sue states over AI laws; “Its first target, Colorado, gutted its own law five weeks after the suit was filed.” A bipartisan bill from Sens. Ted Cruz, Amy Klobuchar and John Thune would likely override most state AI laws, RAISE included. Sens. Josh Hawley and Chris Murphy want an AI Agent Accountability Act making companies liable for hacks by their agents, Axios reported; Director of National Intelligence Jay Clayton answered, “We have consumer protection laws. We have product liability laws. We have the Department of Justice.” Our state AI law map tracks what is already in force.
SpaceXAI’s empty chair, filled
Menin subpoenaed SpaceXAI on Sept. 28 after it ignored its invitation, and the council said it would seek enforcement in New York State Supreme Court and, failing that, civil contempt, City & State reported. That fight never reached a judge. On Oct. 13 Menin announced that SpaceXAI had agreed to testify, and on Oct. 16 a company official appeared, in what the council’s press office calls the result of its first subpoena to a private actor. CNBC reported the company’s AI policy lead was grilled on Grok’s safety and sexualized images, and amNY reported that Menin confronted the company after Grok produced a sexualized image of her in under 30 seconds. Musk’s company has since moved to rebrand as SpaceXSI.
What happens next
The four companies were to get a list of questions to answer in writing, amNY reported; we found no published answers as of Oct. 19. Menin said the council “still has many questions that we feel we did not get answers to today.” This time, Meta’s framework can be in front of whoever writes the reply.
Researched and drafted with AI tools, fact-checked against primary sources and approved by a human editor before publishing. Prices and dates are as of publication. Our standards →
Sources- ksat.com — according to the Associated Press
- council.nyc.gov — agreed on Oct. 13 to testify
- council.nyc.gov — appeared before the council on Oct. 16
- amny.com — amNY reported
- cityandstateny.com — City & State reported
- audacy.com — left Anthropic in September, according to Bloomberg
Latest from prompt/power
- ChatGPT Pro, Claude Max or Google AI Ultra? What CA$140 a month buysNov 20
- Anthropic’s first day, studied: who made money, what it left on the table, and what ANT is now worthNov 20
- Google’s Gemini health coach costs CA$12.99 a month, or nothing with AI Pro. What it does and doesn’t doNov 20
- Broadcom’s AI chip sales now outstrip its entire business from a year ago. What to watch on Dec. 9Nov 19
- NeurIPS 2026 is in three cities. Here’s how the split worksNov 19