Politics

UN member states delay agreement on autonomous weapons regulation

Over 120 UN member states failed to reach an immediate agreement on regulating autonomous weapons in Geneva, opting instead to continue discussions over the next two years. The ICRC and UN secretary general António Guterres are calling for legally binding prohibitions to prevent civilian harm.

UN member states delay agreement on autonomous weapons regulation

More than 120 member states of the UN Convention on Certain Conventional Weapons concluded a week-long conference in Geneva. They failed to reach an agreement for immediate action, though they agreed to discuss regulating autonomous weapons over the next two years. I find this delay concerning because the development of these weapons outpaces regulatory efforts. "If we leave this unregulated, it will be much more difficult to put the genie back in the bottle," Dr. Cordula Droege said. Droege is the director of international law, movement and partnerships at the ICRC. The ICRC president Mirjana Spoljaric Egger and UN secretary general Antonio Guterres want a legally binding instrument that includes clear prohibitions and restrictions. They want a ban on autonomous weapons against personnel and want to ensure weapons behave predictably. Militaries are currently employing artificial intelligence for various purposes, like the Israeli military in Gaza which uses AI to generate target banks or the semi-autonomous drones used in the Ukraine-Russia war that possess last-mile capability. Rights groups warned that any delay in regulation risks allowing private industry and militaries to set the norms of how autonomous weapons are used.

Risks of AI-driven weaponry

Autonomous weapons have already caused civilian deaths. In July in Zaporizhzhia, a Russian drone guided by an AI system tried to hit a petrol station but hit a wall instead and killed three people in a fountain of shrapnel. In Gaza, the Israeli military used AI-assisted targeting methods to fill target banks much faster than humanly possible since the start of the war. Rights groups say this caused the erroneous death of civilians and people with tenuous links to militant groups. A US strike in Iran killed 156 civilians, including 120 schoolchildren, because AI systems gathered faulty intelligence. Anna Hehir, head of military AI governance at the Future of Life Institute, says further delay could lead to mass civilian harm that dwarfs previous events. She notes that manufacturers and militaries are developing swarm capabilities where hundreds or thousands of autonomous drones act at the same time. This mass of systems allows for high damage because a single algorithmic error can lead an entire swarm down a path based on that error, particularly if they are programmed to target humans. Proliferation also exists as the Houthi movement in Yemen used Claude to "vibe code" ballistic missiles. Armed Islamist groups in Africa’s Sahel region use AI tools to improve drone ballistics and for operational planning. A senior diplomat with knowledge of the UN discussions says that after 13 years, the agenda shows the political will finally present to start to get serious about regulation of autonomous weapons systems.