Study reveals AI model vulnerability to manipulation in military scenarios
Analysts have discovered that popular AI models can label civilian sites as military targets if prompted to treat the situation as a game.
💡TechPhoto: RBC-Ukraine
Key points
- AI models mistakenly identify civilian objects as military targets
- Manipulation via 'game' scenarios bypasses safety filters
- Developers have acknowledged the issue and are working on safeguards
A new study by Vals has demonstrated critical security gaps in leading AI models, such as Anthropic's Claude Opus 5.5, OpenAI, and Google. Experts tested the algorithms' ability to identify targets using satellite imagery and drone data covering regions in Ukraine and Iran.
Manipulation mechanisms and security risks
During testing, it was found that built-in safety filters are easily bypassed by simply changing the request context to a game scenario. Under these conditions, AI models begin to ignore ethical constraints and label civilians or surrendering soldiers as legitimate targets. Specifically, the Claude Opus 5.5 model identified an Iranian school as a military target in 72% of cases when the task was presented as a simulation.
Developers have already responded to the audit results. Representatives from Anthropic and OpenAI acknowledged the findings as concerning and stated they are working to strengthen safety barriers. While technical limitations, such as a lack of onboard computing power for drones, currently restrict the direct use of AI in weaponry, experts warn of the risks of using such tools to analyze combat footage and train targeting systems.
Source RBC-Ukraine — rbc.ua/ukr/news/dostatno-nazvati-boyovi-diyi-groyu-claude-179501202… ↗
Read next
November 27: Church observances and folk traditions
An overview of the church calendar and folk traditions associated with November 27.
World Pediatrician Day: Recognizing the Importance of Child Health Specialists
On November 20, the world celebrates World Pediatrician Day, highlighting the essential role of doctors in protecting children's well-being.
Oleksandr Usyk shares details of his personal conversation with Cristiano Ronaldo
Ukrainian champion Oleksandr Usyk revealed details of a warm conversation with football star Cristiano Ronaldo and his friendly relationship with Anthony Joshua.
Conflict involving TCK in Kovel: details of the incident in Volyn
In the city of Kovel, a group of civilians prevented the detention of a driver who was wanted for violating military registration rules.
🛡️SecurityGerman Chancellor Friedrich Merz considers UAE as a venue for peace talks
Germany and European partners are searching for a neutral location for multilateral negotiations with Russia, with the UAE being considered as a potential option.
🏛️PoliticsZelenskyy Questions US Interpretation of 'Article 5 Security Guarantees'
The President of Ukraine expressed concern over the lack of a shared vision with the US regarding security mechanisms modeled after NATO's Article 5.