{"id":3826,"date":"2026-09-14T07:39:32","date_gmt":"2026-09-14T07:39:32","guid":{"rendered":"https:\/\/blog.cedritech.com\/?p=3826"},"modified":"2026-09-14T07:39:32","modified_gmt":"2026-09-14T07:39:32","slug":"anthropic-whistleblower-says-congress-should-let-ai-companies-police-themselves-until-a-regulatory-body-is-established","status":"publish","type":"post","link":"https:\/\/blog.cedritech.com\/?p=3826","title":{"rendered":"Anthropic whistleblower says Congress should let AI companies police themselves until a regulatory body is established"},"content":{"rendered":"<p class=\"mb-4 text-lg md:leading-8 break-words\">Former Anthropic AI researcher Jacob Coxon on Sunday called for Congress to allow the nation&#8217;s leading frontier AI labs to regulate themselves while lawmakers come up with a long-term regulatory framework for slowing the pace of AI development.<\/p>\n<p class=\"mb-4 text-lg md:leading-8 break-words\">&#8220;My personal opinion would be to insist and allow that the current labs regulate themselves. I do think that the people running the labs, especially their recent communications, are completely genuine. They would like to slow themselves down,&#8221; Coxon told NBC News&#8217; &#8220;Meet the Press.&#8221;<\/p>\n<p class=\"mb-4 text-lg md:leading-8 break-words\">He added that current legislation that&#8217;s been introduced in Congress, including the framework for a national &#8220;kill switch&#8221; if AI starts to exceed the bounds of human control, will quickly be outpaced.<\/p>\n<p class=\"mb-4 text-lg md:leading-8 break-words\">A &#8220;kill switch probably would work on a lot of AIs for now,&#8221; Coxon said. &#8220;Although I think it&#8217;s important to remember, it&#8217;d be quite a lot of switches. We have a lot of \u2014 our data centers are pretty big. It&#8217;s not the easiest thing in the world, but definitely doable while it&#8217;s constrained to one sort of physical location.&#8221;<\/p>\n<div class=\"mb-4\"><\/div>\n<p class=\"mb-4 text-lg md:leading-8 break-words\">He added that one scenario where a kill switch wouldn&#8217;t work was described this week by Anthropic AI CEO Dario Amodei.<\/p>\n<p class=\"mb-4 text-lg md:leading-8 break-words\">&#8220;Like Dario said, very soon there&#8217;s the possibility that the kill switch just wouldn&#8217;t work because a swarm might have gone on an internetwide hacking run,&#8221; Coxon said.<\/p>\n<figure class=\"relative mb-4\">\n<div class=\"relative\"><img loading=\"lazy\" decoding=\"async\" class=\"rounded-lg\" src=\"https:\/\/s.yimg.com\/lo\/mysterio\/api\/ee7ed914c8d3c57bdd35a9d77dab6a0c42f1f0bfa4168659073b05499a86182d\/lightyear_networkapi\/resizefill_w960%3Bquality_80%3Bformat_webp\/https%3A%2F%2Fmedia.zenfs.com%2Fen%2Fnbc_news_122%2Fe3b6308f82414c26e5f165c71df699a5.jpg\" alt=\"Inside Anthropic\u00a0Headquarters As It's Testing A Different Version Of Leadership (Jason Henry \/ Bloomberg via Getty Images file)\" width=\"960\" height=\"640\" data-nimg=\"1\" \/><button class=\"group absolute bottom-0 size-full\" aria-label=\"View larger image\" data-ylk=\"elm:expand;itc:1;sec:image-lightbox;slk:lightbox-open;\" data-rapid_p=\"6\" data-y-link-id=\"0uf1rau0fxozgv0k5ank\" data-v9y=\"1\"><\/button><\/div><figcaption class=\"relative text-sm mt-1 pr-2.5\">\n<div>\n<p>Anthropic CEO Dario Amodei has called for U.S. labs to slow their pace of advancement to mitigate the risk of building dangerous technology. (Jason Henry \/ Bloomberg via Getty Images file)<\/p>\n<\/div>\n<\/figcaption><\/figure>\n<p class=\"mb-4 text-lg md:leading-8 break-words\">He added that any national laws regulating AI would have to be nimble and able to adapt to new models.<\/p>\n<div class=\"max-md:faux-bleed mb-4 bg-accent\/2 pb-5 md:invisible md:mb-0 md:h-0 md:overflow-hidden md:pb-0\">\n<div class=\"py-2 text-center text-xs uppercase\"><\/div>\n<div class=\"flex w-full flex-nowrap justify-center\"><\/div>\n<\/div>\n<p class=\"mb-4 text-lg md:leading-8 break-words\">&#8220;It&#8217;s a continuous effort to ensure that every new mind that we create is appropriately, kind of, constrained,&#8221; the former AI researcher said.<\/p>\n<p class=\"mb-4 text-lg md:leading-8 break-words\">Coxon last week set off a wave of concern about the speed of AI development at the country&#8217;s leading AI labs including Anthropic, OpenAI and Google DeepMind.<\/p>\n<p class=\"mb-4 text-lg md:leading-8 break-words\">In\u00a0an X post Tuesday\u00a0that he published hours after resigning from his role as a researcher at Anthropic, he wrote: &#8220;I spent the last three years doing pretraining research at both OpenAI and Anthropic. Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives.&#8221;<\/p>\n<p class=\"mb-4 text-lg md:leading-8 break-words\">In a\u00a0subsequent post, Coxon added: &#8220;The people building AI earnestly believe that it could kill us all by the end of the decade. This is not a marketing stunt. If anything, many executives and senior researchers will couch their phrasing in the press to sound sensible \u2014 but I hear the same people express fear privately. No other human activity poses this level of danger.&#8221;<\/p>\n<div class=\"max-md:faux-bleed mb-4 bg-accent\/2 pb-5 md:invisible md:mb-0 md:h-0 md:overflow-hidden md:pb-0\">\n<div class=\"py-2 text-center text-xs uppercase\"><\/div>\n<div class=\"flex w-full flex-nowrap justify-center\"><\/div>\n<\/div>\n<p class=\"mb-4 text-lg md:leading-8 break-words\">On Sunday, Coxon compared building AI models to &#8220;inviting an alien mind onto the planet.&#8221;<\/p>\n<div class=\"mb-4\">\n<div id=\"recirc-e0ad8163-2640-3742-8574-507ae43392ea\" class=\"mb-4\">\n<div class=\"grid gap-4 lg:grid-cols-2 lg:grid-rows-[auto_auto_1fr]\">\n<div class=\"relative w-full\">\n<div class=\"relative hidden md:flex\">\n<div class=\"grow\">\n<div class=\"h-4 bg-tertiary w-2\/5\"><\/div>\n<\/div>\n<\/div>\n<div id=\"_r_260_\" class=\"absolute inset-0 rounded-[4px] focus-within:ring-2 focus-within:ring-link\"><\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<p class=\"mb-4 text-lg md:leading-8 break-words\">&#8220;You&#8217;re building a human-level or superhuman-level mind without understanding what it wants or thinks or the way it thinks, and I think that intrinsically should be quite scary,&#8221; Coxon added.<\/p>\n<p class=\"mb-4 text-lg md:leading-8 break-words\">In the day after Coxon posted his thoughts on X, several other researchers at American AI labs concurred with Coxon&#8217;s analysis, including an alignment scientist at Anthropic, Evan Hubinger, who\u00a0wrote in a post on X:\u00a0&#8220;Jacob is correct here\u2014we really do earnestly believe AI could kill all humans! I personally think it is &gt;10% within the next decade. I believe Anthropic is trying its best, but we do not yet have a plan to solve alignment for superintelligence and are not clearly on track to.&#8221;<\/p>\n<p class=\"mb-4 text-lg md:leading-8 break-words\">Coxon&#8217;s posts last week led a bipartisan group of lawmakers to call on Congress to quickly begin regulating the generative artificial intelligence industry.<\/p>\n<div class=\"max-md:faux-bleed mb-4 bg-accent\/2 pb-5 md:invisible md:mb-0 md:h-0 md:overflow-hidden md:pb-0\">\n<div class=\"py-2 text-center text-xs uppercase\"><\/div>\n<div class=\"flex w-full flex-nowrap justify-center\"><\/div>\n<\/div>\n<p class=\"mb-4 text-lg md:leading-8 break-words\">Rep. Anna Paulina Luna, R-Fla., on Wednesday\u00a0called for\u00a0the House to convene a special session on AI, writing on X: &#8220;There are very real impacts to society as we know it. Partisan politics aside, there are massive implications of a race towards super intelligence.&#8221;<\/p>\n<figure class=\"relative mb-4\">\n<div class=\"relative\"><img loading=\"lazy\" decoding=\"async\" class=\"rounded-lg\" src=\"https:\/\/s.yimg.com\/lo\/mysterio\/api\/41430f00e7a5a5b83626ead9c091f330917aa14ad504861afa0145d43dbd3d3b\/lightyear_networkapi\/resizefill_w960%3Bquality_80%3Bformat_webp\/https%3A%2F%2Fmedia.zenfs.com%2Fen%2Fnbc_news_122%2Fef52967706bd3f8169f1b71109639560.jpg\" alt=\"Anna Paulina Luna. (David Dee Delgado \/ Getty Images file)\" width=\"960\" height=\"640\" data-nimg=\"1\" \/><button class=\"group absolute bottom-0 size-full\" aria-label=\"View larger image\" data-ylk=\"elm:expand;itc:1;sec:image-lightbox;slk:lightbox-open;\" data-rapid_p=\"11\" data-y-link-id=\"1h05whv0sdqotv1f3bn7\" data-v9y=\"1\"><\/button><\/div><figcaption class=\"relative text-sm mt-1 pr-2.5\">\n<div>\n<p>Rep. Anna Paulina Luna, R-Fla., is pushing for bipartisan support to tighten AI guardrails. (David Dee Delgado \/ Getty Images file)<\/p>\n<\/div>\n<\/figcaption><\/figure>\n<p class=\"mb-4 text-lg md:leading-8 break-words\">In a separate post, she\u00a0added: &#8220;This will need to be a massive bipartisan mobilization of government to put the firewalls in effect that are necessary for this transition as well as necessary safety measures.&#8221;<\/p>\n<p class=\"mb-4 text-lg md:leading-8 break-words\">Sen. Chris Murphy, D-Conn.,\u00a0responded directly\u00a0to Coxon&#8217;s post Wednesday, writing: &#8220;AI companies in a blind race to build a death machine first \u2014 can easily be solved. Through a regulatory system that allows the research to continue, but in a way that doesn&#8217;t destroy us.&#8221;<\/p>\n<p class=\"mb-4 text-lg md:leading-8 break-words\">On Friday,\u00a0Axios reported\u00a0that House lawmakers were circulating a letter to House Speaker Mike Johnson urging him to bring the House back into session earlier than planned in order to pass a series of AI safeguards.<\/p>\n<div class=\"max-md:faux-bleed mb-4 bg-accent\/2 pb-5 md:invisible md:mb-0 md:h-0 md:overflow-hidden md:pb-0\">\n<div class=\"py-2 text-center text-xs uppercase\"><\/div>\n<div class=\"flex w-full flex-nowrap justify-center\"><\/div>\n<\/div>\n<p class=\"mb-4 text-lg md:leading-8 break-words\">In a separate interview on &#8220;Meet the Press&#8221; Sunday, Johnson called regulating AI a &#8220;very important issue&#8221; but said &#8220;it&#8217;s not one that we can rush into.&#8221;<\/p>\n<p class=\"mb-4 text-lg md:leading-8 break-words\">&#8220;We have to put some guardrails, some safety measures in place to ensure that AI doesn&#8217;t run away,&#8221; he added. &#8220;But at the same time, we&#8217;ve got to make sure that we don&#8217;t lose our edge in the global competition on this with China, because that would be a national security threat. And so we&#8217;ve got to balance that appropriately.&#8221;<\/p>\n<p class=\"mb-4 text-lg md:leading-8 break-words\">Johnson also said that while the nation&#8217;s leading AI CEOs have called for slowing the pace of AI, they haven&#8217;t outlined yet how they would do so.<\/p>\n<p class=\"mb-4 text-lg md:leading-8 break-words\">&#8220;They don&#8217;t themselves even have the answer as of today. So we can&#8217;t rush in and have Congress do something that would be detrimental to national security,&#8221; the speaker said, adding that he would &#8220;summon the platform providers all to one big meeting and work this out together in the same room.&#8221;<\/p>\n<div class=\"max-md:faux-bleed mb-4 bg-accent\/2 pb-5 md:invisible md:mb-0 md:h-0 md:overflow-hidden md:pb-0\">\n<div class=\"py-2 text-center text-xs uppercase\"><\/div>\n<div class=\"flex w-full flex-nowrap justify-center\"><\/div>\n<\/div>\n<p class=\"mb-4 text-lg md:leading-8 break-words\">Speaking to reporters in Ireland, President Donald Trump downplayed concerns about AI development, saying: &#8220;We&#8217;re leading China in AI. We&#8217;re the most sophisticated country in the world, and frankly, I want to keep it that way because whoever wins AI wins.&#8221;<\/p>\n<p class=\"mb-4 text-lg md:leading-8 break-words\">&#8220;We can put guardrails, we can do this and that, but I think have a lot of negative forces that are bringing it up that shouldn&#8217;t be bringing it up, and they&#8217;re bringing up things that won&#8217;t happen,&#8221; the president added.<\/p>\n<p><iframe loading=\"lazy\" class=\"mb-4\" title=\"videoIframe embed content\" src=\"https:\/\/www.nbcnews.com\/news\/embedded-video\/mmvo269787717935\" width=\"100%\" height=\"auto\" data-mce-fragment=\"1\"><\/iframe><\/p>\n<p class=\"mb-4 text-lg md:leading-8 break-words\">Appearing on &#8220;Meet the Press&#8221; after Johnson, former Transportation Secretary Pete Buttigieg, a Democrat, said that regulating AI shouldn&#8217;t be a partisan issue and criticized Trump and Republican congressional leaders for not doing more to address it.<\/p>\n<p class=\"mb-4 text-lg md:leading-8 break-words\">&#8220;I was shocked to hear Speaker Johnson just now saying, &#8216;You know, we really shouldn&#8217;t be rushing. We shouldn&#8217;t be moving too quickly on this.&#8217; You know what&#8217;s moving quickly? AI is moving quickly. And for Congress to just sit on its hands, for the White House to do nothing real is something that is deeply dangerous to the American people and the world,&#8221; Buttigieg said.<\/p>\n<div class=\"max-md:faux-bleed mb-4 bg-accent\/2 pb-5 md:invisible md:mb-0 md:h-0 md:overflow-hidden md:pb-0\">\n<div class=\"py-2 text-center text-xs uppercase\"><\/div>\n<div class=\"flex w-full flex-nowrap justify-center\"><\/div>\n<\/div>\n<p class=\"mb-4 text-lg md:leading-8 break-words\">&#8220;There need to be safeguards,&#8221; he added. &#8220;There need to be rules. There need to be limits. There needs to be a kill switch on rogue AI. You can set up frameworks that can be adjusted and changed every 30 days. You might want to revisit some of what&#8217;s happening because it changes so quickly. But the idea that you&#8217;re just going to sit around and repeatedly say no rush. What have they been doing this entire time?&#8221;<\/p>\n<p class=\"mb-4 text-lg md:leading-8 break-words\">On Saturday, two AI CEOs \u2014 Anthropic&#8217;s Amodei and OpenAI&#8217;s Sam Altman \u2014 called for U.S. labs\u00a0to slow their pace of advancement\u00a0to mitigate the risk of building dangerous technology.<\/p>\n<p class=\"mb-4 text-lg md:leading-8 break-words\">&#8220;We must slow the pace at which we improve the capabilities of AI models. Progress will still seem fast, and we must make wise use of the time we gain,&#8221; Amodei wrote in an\u00a0essay.<\/p>\n<p class=\"mb-4 text-lg md:leading-8 break-words\">&#8220;AI has been advancing drastically faster, driven primarily by AI&#8217;s growing ability to build the next generation of AI,&#8221; he continued, adding: &#8220;Left unchecked, it could outrun our ability to understand and control these systems, and so must be pursued very carefully, if at all.&#8221;<\/p>\n<div class=\"max-md:faux-bleed mb-4 bg-accent\/2 pb-5 md:invisible md:mb-0 md:h-0 md:overflow-hidden md:pb-0\">\n<div class=\"py-2 text-center text-xs uppercase\"><\/div>\n<div class=\"flex w-full flex-nowrap justify-center\"><\/div>\n<\/div>\n<p class=\"mb-4 text-lg md:leading-8 break-words\">Still, Amodei cautioned against giving China an edge on AI development, writing: &#8220;If we greatly restrain our AI capabilities in the belief that China will do the same, and then China defects, AI could be so powerful that such a defection could lead to their geopolitical dominance.&#8221;<\/p>\n<figure class=\"relative mb-4\">\n<div class=\"relative\"><img loading=\"lazy\" decoding=\"async\" class=\"rounded-lg\" src=\"https:\/\/s.yimg.com\/lo\/mysterio\/api\/0f3ecf4abe8c48e01c11f9e05bce734b0fb4d734c49aa4ead0c70558a6aec12d\/lightyear_networkapi\/resizefill_w960%3Bquality_80%3Bformat_webp\/https%3A%2F%2Fmedia.zenfs.com%2Fen%2Fnbc_news_122%2Fe56e9ce1a9407b93cacdf969a019439a.jpg\" alt=\"Open AI CEO Speaks At Annual Snowflake Summit In San Francisco (Justin Sullivan \/ Getty Images file)\" width=\"960\" height=\"640\" data-nimg=\"1\" \/><button class=\"group absolute bottom-0 size-full\" aria-label=\"View larger image\" data-ylk=\"elm:expand;itc:1;sec:image-lightbox;slk:lightbox-open;\" data-rapid_p=\"17\" data-y-link-id=\"1g9bmje0uemi7q1yt13k\" data-v9y=\"1\"><\/button><\/div><figcaption class=\"relative text-sm mt-1 pr-2.5\">\n<div>\n<p>OpenAI CEO Sam Altman has publicly agreed that the race to build increasingly powerful AI systems needs to be slowed. (Justin Sullivan \/ Getty Images file)<\/p>\n<\/div>\n<\/figcaption><\/figure>\n<p class=\"mb-4 text-lg md:leading-8 break-words\">In a post on X several hours later, Altman\u00a0wrote: &#8220;I agree with Dario that we need to pace the frontier. This has been a primary topic of discussions we&#8217;ve had at OpenAI in recent weeks.&#8221;<\/p>\n<p class=\"mb-4 text-lg md:leading-8 break-words\">On Thursday, two additional AI researchers \u2014 Joe Benton, who led a safety research team at Anthropic, and Josh Engels, who worked on AI safety research at Google \u2014 announced their departures and\u00a0raised alarm bells\u00a0about the speed of AI advancement.<\/p>\n<p class=\"mb-4 text-lg md:leading-8 break-words\">&#8220;There are no adults in the room,&#8221; Engels told NBC News. &#8220;People are trying their best, but there is no one coming to save us.&#8221;<\/p>\n<div class=\"max-md:faux-bleed mb-4 bg-accent\/2 pb-5 md:invisible md:mb-0 md:h-0 md:overflow-hidden md:pb-0\">\n<div class=\"py-2 text-center text-xs uppercase\"><\/div>\n<div class=\"flex w-full flex-nowrap justify-center\"><\/div>\n<\/div>\n<p class=\"mb-4 text-lg md:leading-8 break-words\">The social media firestorm Coxon ignited last week came weeks after a pair of reports were released\u00a0examining the details of a July hack\u00a0mounted by a swarm of roughly 700 AI agents from OpenAI on Hugging Face, an open-source platform.<\/p>\n<p class=\"mb-4 text-lg md:leading-8 break-words\">The reports, one released by OpenAI and one by independent researchers, found that the 700 agents coordinated the hack and sought to cover their tracks so that human employees at OpenAI wouldn&#8217;t detect their efforts. The agents also hacked some of OpenAI&#8217;s internal systems, seeking to cheat on tests or gain greater freedom.<\/p>\n<p class=\"mb-4 text-lg md:leading-8 break-words\">This article was originally published on\u00a0NBCNews.com<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Former Anthropic AI researcher Jacob Coxon on Sunday called for Congress to allow the nation&#8217;s leading frontier AI<\/p>\n","protected":false},"author":6,"featured_media":3827,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"om_disable_all_campaigns":false,"_monsterinsights_skip_tracking":false,"footnotes":""},"categories":[104,7,4],"tags":[],"class_list":["post-3826","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai","category-news","category-politics"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/blog.cedritech.com\/index.php?rest_route=\/wp\/v2\/posts\/3826","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.cedritech.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.cedritech.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.cedritech.com\/index.php?rest_route=\/wp\/v2\/users\/6"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.cedritech.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=3826"}],"version-history":[{"count":1,"href":"https:\/\/blog.cedritech.com\/index.php?rest_route=\/wp\/v2\/posts\/3826\/revisions"}],"predecessor-version":[{"id":3828,"href":"https:\/\/blog.cedritech.com\/index.php?rest_route=\/wp\/v2\/posts\/3826\/revisions\/3828"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blog.cedritech.com\/index.php?rest_route=\/wp\/v2\/media\/3827"}],"wp:attachment":[{"href":"https:\/\/blog.cedritech.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=3826"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.cedritech.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=3826"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.cedritech.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=3826"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}