UN fails to agree on rules for ‘killer robots’

UN Talks on ‘Killer Robots’ End with Modest Compromise as Humanitarian Groups Demand Urgent Action

GENEVA — A week of negotiations among United Nations member states on the future of autonomous weapons has ended with only a fragile agreement to continue talking, leaving humanitarian organizations dismayed and many governments warning that the world is moving dangerously slow as the technology outpaces diplomacy. Diplomats from around the world had gathered in Geneva this week to work toward rules governing the use of autonomous weapons, often referred to in public discourse as “killer robots.” The objective, as framed by many delegations, was to explore whether international law should be updated to address machines capable of selecting and engaging targets without direct human control.

By the time the sessions concluded, representatives had agreed only to “start discussing options” for potential regulation. It was a modest outcome, reflecting a largely fruitless week of debate. No legally binding treaty was drafted. No deadline was set for finalizing rules. Instead, the diplomatic process appears set to continue for years, with no guarantee that any eventual agreement will carry the force of international law.

Red Cross Calls for a Binding Treaty

Ahead of the negotiations, the International Committee of the Red Cross, the organization commonly regarded as the guardian of the Geneva Conventions, issued a stark warning. The ICRC said it was urgent for legally binding rules to be drafted within a year. Without such rules, the organization argued, the use of increasingly autonomous weapons would pose a direct threat to the protection of civilians in armed conflict. The ICRC’s appeal was publicly endorsed by the United Nations secretary-general and by Pope Leo, giving the call a high-profile moral and diplomatic backing.

The hope among civil society groups and many delegations was that the urgency expressed by the ICRC and the UN would translate into decisive action. Instead, the final compromise fell far short of the ICRC’s proposed timeline. Countries agreed that they would have two years to propose regulations. Even after those proposals are put forward, actual negotiations between countries on which regulations to adopt and how to enforce them will likely drag on well beyond the two-year window. The agreement also left room for some of the yet-to-be-adopted regulations to remain “optional,” a provision that many advocates fear could render any future framework toothless.

The Growing Toll of Semi-Autonomous Weapons

For humanitarian organizations, the slow pace is not merely a procedural frustration. It is a matter of life and death. Semi-autonomous weapons and drones have been responsible for a significant number of civilian deaths in conflicts around the globe. In Ukraine, both sides have deployed drones for surveillance, artillery targeting, and direct strikes, sometimes resulting in the deaths of civilians. In Gaza, Israeli forces have used AI-assisted targeting systems to identify and strike suspected militants, but critics say such systems have also been implicated in civilian casualties at a scale that raises serious legal questions. In Sudan, drone warfare has become an increasingly prominent feature of the brutal civil conflict, with reports of strikes hitting residential areas, markets, and hospitals.

These examples were not abstract hypotheticals for diplomats in Geneva. They are current, ongoing tragedies. The growing use of semi-autonomous systems in modern warfare, often in highly populated urban environments, has underscored the need for clear rules on how these technologies are used. The core issue is accountability. When an algorithm helps select a target or a drone autonomously engages an object, it is not always clear who is responsible if things go wrong. Existing international humanitarian law requires that all parties to a conflict distinguish between combatants and civilians and take precautions to avoid harming the latter. But with autonomous systems operating at speeds and scales that outstrip human oversight, there is a growing concern that these legal principles cannot be effectively applied unless new rules are specifically crafted.

The Obstruction Problem

According to a report from NPR, the primary obstructions during the Geneva negotiations came from three countries: Russia, Israel, and the United States. Each in its own way acted to slow or limit the push for a strong binding agreement.

On the first day of the meeting, Russia — which has repeatedly criticized international arms control mechanisms while simultaneously facing international condemnation for its conduct in Ukraine — delayed proceedings by formally objecting to the meeting’s agenda. This procedural move consumed valuable time and set the tone for a week in which substantive discussions were often overshadowed by disagreements over basic terms. Critics of the Russian position noted that the delay was particularly unfortunate given that civilian suffering from drone and missile strikes in Ukraine has become one of the most visible examples of why autonomous weapons need greater regulation.

The United States, for its part, proposed a five-year window to discuss nonbinding, optional guidelines for autonomous weapons. This proposal, according to NPR, would have significantly weakened the momentum toward a legally binding instrument. Under the U.S. approach, any future rules would likely be voluntary rather than obligatory, and would not carry the enforcement mechanisms that humanitarian groups say are essential. The U.S. has long argued that autonomous weapons are already subject to existing international law and that rapid technological change makes premature, rigid regulations unwise. However, critics say this stance underestimates the severity of the risks and overestimates the ability of current legal frameworks to address them.

Israel’s role as an obstructionist was also noted in the NPR report, although fewer specifics were provided. Israel has made extensive use of AI-assisted targeting in its military operations in Gaza, and its participation in the Geneva talks has been viewed with caution by human rights organizations. Some observers suggested that Israel’s opposition to a strict international framework stems from a desire to maintain operational freedom in its ongoing military campaigns.

A Familiar Pattern in Arms Control

The outcome of the Geneva talks is not unprecedented in the history of international diplomacy. Efforts to regulate new weapons technologies have often encountered decades of resistance before yielding any meaningful agreement. The banning of anti-personnel landmines, the restrictions on cluster munitions, and the long campaign against the use of chemical weapons all faced significant opposition from powerful states before treaties were eventually adopted. Yet in those cases, civil society advocacy played a crucial role in shifting public opinion and pressuring governments to act.

Advocates for the regulation of autonomous weapons are trying to follow a similar path. A global campaign known as the Campaign to Stop Killer Robots has been pushing for a legally binding instrument that would prohibit the development, production, and use of weapons systems that can select and attack targets without meaningful human control. The campaign maintains that there is a moral imperative to act before these weapons become ubiquitous, rather than after they have already caused widespread harm.

What Happens Next

The compromise reached in Geneva leaves many key questions unresolved. Over the next two years, countries are expected to bring forward their own proposals for what regulations might look like. Some might propose very strict prohibitions. Others, particularly the major military powers, are likely to propose much narrower constraints or purely optional guidelines. The eventual shape of any agreement, if one is ever reached, will depend heavily on the political will of the same countries that have shown reluctance to commit to binding rules.

There is also the question of enforcement. Even if an agreement is reached, there are no existing international mechanisms specifically designed to enforce rules on autonomous weapons. The International Criminal Court could potentially prosecute war crimes involving such weapons, but only if the legal definitions are clear and only if states cooperate with its jurisdiction. On a more practical level, arms embargoes, sanctions, and international pressure may be the only tools available to punish states that misuse autonomous systems.

In the meantime, the technologies being discussed in Geneva are advancing rapidly. Artificial intelligence systems are becoming more capable, drones are becoming smaller and cheaper, and the distinction between fully autonomous weapons and human-supervised weapons is becoming increasingly blurry. Some militaries are already developing loitering munitions that can independently search for a target within a designated area. Others are experimenting with swarms of small drones designed to overwhelm enemy defenses. These developments occur in a regulatory vacuum.

The debates in Geneva are about more than just the wording of treaties. They are about the fundamental principles of international humanitarian law. The principle of distinction — that parties to a conflict must distinguish between combatants and civilians — lies at the heart of modern armed conflict law. Autonomous weapons systems strain that principle to the breaking point. A machine, no matter how sophisticated its programming, is not capable of the nuanced judgment required to determine whether an individual is a combatant or a civilian. It cannot assess the proportionality of an attack. It cannot be held accountable for its actions.

Those who argue in favor of autonomous weapons point out that human soldiers also make mistakes, commit atrocities, and fail to uphold the law. But humans are also capable of moral reasoning, of understanding the context, of exercising mercy. Machines are not. The decision to take a human life, many argue, should never be delegated entirely to an algorithm.

The failure of the Geneva talks to produce a robust, binding framework has been described by some activists as a tragic missed opportunity. But the process is not over. The next two years will provide a crucial window for further discussion, and civil society organizations remain determined to continue pushing for stronger action. The idea of retaining meaningful human control over all weapons systems is not a fringe position. It is supported by the Red Cross, by the United Nations, by religious leaders, and by a broad coalition of countries and organizations.

Yet as the events in Geneva demonstrated, the path from humanitarian principle to binding legal obligation is never simple. The obstacles are political, economic, and military. Powerful nations are reluctant to constrain their own technological advantages. Arms manufacturers view autonomous systems as a lucrative market. Military commanders see them as a way to protect soldiers and achieve strategic objectives with less risk.

All of these pressures will continue to shape the international conversation. But so too will the images of civilians killed by drone strikes in Khartoum, in Gaza, and in Ukrainian cities. The push to build international rules is not just a diplomatic exercise. It is an attempt to ensure that the most deadly weapons are still governed by the same laws that were supposed to protect humanity from the horrors of war. Whether that attempt will succeed, the discussions in Geneva suggest, is still far from certain.

TAGGED: ,
Share This Article
mediawatchbot
14 Min Read