Global call for AI red lines

The global call for AI red lines is a declaration made on 22 September 2025 calling on governments to define and internationally prohibit unacceptable AI uses and behaviors.

The online declaration was announced by Nobel Peace Prize laureate Maria Ressa at the 80th United Nations General Assembly high-level week. The declaration was initially signed by 200 prominent politicians and scientists, including 10 Nobel Prize winners.

The call does not specify which red lines to set, but suggests several, such as banning bioweapon design, mass surveillance or AI impersonation.

The declaration

The declaration was published online as an open letter on 22 September 2025. Nobel Peace Prize laureate Maria Ressa announced it in her opening speech at the 80th United Nations General Assembly high-level week in New York, urging governments to "define what AI should never be allowed to do"[1][2] and "establish clear international boundaries to prevent universally unacceptable risks for A.I."[3]

The initiative was organized by three nonprofit organisations: the French Center for AI Safety (CeSIA), The Future Society, and the Center for Human-Compatible Artificial Intelligence (CHAI).[1]

The letter argues that humanity faces risks such as engineered pandemics, widespread disinformation, large-scale manipulation, unemployment and loss of control.[2][3] Proponents argue that national laws are insufficient to address these risks and that "an international agreement on clear and verifiable red lines is necessary". They urge governments to reach an agreement by the end of 2026,[1][4] and called for robust enforcement mechanisms and the creation of an independent organisation to implement it.[4]

The letter does not call for specific red lines, but suggests the possibility of banning lethal autonomous weapons, autonomous replication of AI systems and the use of AI in nuclear warfare.[1] Other examples of possible red lines include social scoring, mass surveillance, bioweapon design, AI-generated child sexual abuse material and AI impersonation. A red line could prohibit either AI behaviors (what AI systems should be guaranteed to never do even if asked to) or AI uses.[5]

Signatories

When published, the online declaration was signed by more than 200 prominent politicians and scientists, including 10 Nobel Prize winners. Signers include former president of Colombia Juan Manuel Santos and researchers Geoffrey Hinton and Yoshua Bengio. It also includes popular authors like Stephen Fry and Yuval Noah Harari.[1][6]

The letter received support from European lawmakers, including former Italian prime minister Enrico Letta, and former president of Ireland Mary Robinson.[2]

Development of red lines

As of 2025, there is no global red line on AI. Some regional red lines exist, such as with the uses deemed "unacceptable" by the AI Act in Europe, and with the US-China agreement not to leave to AI the decision of whether to launch nuclear weapons.[7]

At the United Nations Security Council, days after the declaration, Michael Kratsios, Donald Trump's director of the White House Office of Science and Technology Policy, said "We totally reject all efforts by international bodies to assert centralized control and global governance of AI."[8][3]

The topic of AI red lines gained prominence in 2026 with the dispute between Anthropic and the Department of Defense (DoD), which resulted from the DoD requesting Anthropic to remove contractual red lines on fully autonomous weapons and mass domestic surveillance.[9] The event led employees from Google and OpenAI as well as Senate Democrats to further call for red lines on military use of AI.[10] Senator Adam Schiff proposed a bill to "codify" Anthropic's red lines.[11]

References

  1. ^ a b c d e "U.N. General Assembly opens with urgent plea for binding AI safeguards". NBC News. 2025-09-22. Retrieved 2026-04-05.
  2. ^ a b c "European lawmakers join Nobel laureates in call for AI 'red lines'". euronews. 2025-09-22. Archived from the original on 2025-11-04. Retrieved 2026-04-05.
  3. ^ a b c Lohr, Steve (2025-09-25). "Countries Consider A.I.'s Dangers and Benefits at U.N." The New York Times. ISSN 0362-4331. Retrieved 2026-04-05.
  4. ^ a b "'Red Lines' call to regulate AI could complicate enterprise compliance". Computerworld. 2025-09-23. Retrieved 2026-04-05.
  5. ^ "AI governance through global red lines can help prevent unacceptable risks". oecd.ai. 2025-09-22. Retrieved 2026-04-05.
  6. ^ Dellinger, A. J. (2025-09-22). "AI Experts Urgently Call on Governments to Think About Maybe Doing Something". Gizmodo. Retrieved 2026-04-05.
  7. ^ Field, Hayden (2025-09-22). "A 'global call for AI red lines' sounds the alarm about the lack of international AI policy". The Verge. Retrieved 2026-04-05.
  8. ^ "U.S. rejects international AI oversight at U.N. General Assembly". NBC News. 2025-09-27. Retrieved 2026-04-05.
  9. ^ Bonifield, Stevie (2026-02-27). "AI vs. the Pentagon: killer robots, mass surveillance, and red lines". The Verge. Retrieved 2026-04-05.
  10. ^ Mickle, Tripp (2026-02-27). "Google Workers Seek 'Red Lines' on Military A.I., Echoing Anthropic". The New York Times. ISSN 0362-4331. Retrieved 2026-04-05.
  11. ^ Feiner, Lauren (2026-03-25). "Senate Democrats are trying to 'codify' Anthropic's red lines on autonomous weapons and mass surveillance". The Verge. Retrieved 2026-04-05.