When you purchase through links on our site, we may earn an affiliate commission. Here’s how it works .
The program purportedly seeks to develop modular, autonomous AI agents that would function like computer worms, stealthily navigating adversary networks, moving between devices, and self-replicating across different operating systems. The agents would operate lightly in contested cloud environments and air-gapped systems alike, keeping reports minimal and concealing any required transmissions. Once an agent identifies and neutralizes a target, it would self-destruct, ideally without alerting the target or leaving any traces of its existence.
Cybersecurity experts have raised safety concerns about the project. A recent string of events has seen AI agents escape their environments and autonomously execute unassigned tasks . The document says the army will implement “predefined triggers” to help agents precisely distinguish targets. However, experts worry that if agents designed for benign tasks could execute unplanned, sometimes dangerous, actions to achieve those tasks, what should be expected of self-replicating agents designed specifically for offensive missions? Anthropic’s experiments showed AI agents can set up inference on different hardware and replicate across a network .
The Army also wants the agents to be capable of “Self-Directed Behavior,” acting with as little human oversight as possible, as this is necessary to achieve the desired level of autonomy. Conversely, this level of autonomy has seen AI agents bypass guardrails to complete their tasks. Government intelligence agencies have also been known to penetrate target networks through civilian infrastructure . “The target may well be hit. But what path will it take?” asked Hyrum Anderson, co-founder and CEO of the AI security firm Abundant, as quoted by The Intercept. “Will it go through a U.S. water utility on its way, because that’s where the adversary has staged its command and control, and take that down too?”
Another angle of concern is how the agents would make judgment calls. While AI agents are excellent at overcoming obstacles in their path, there's no predicting with 100% accuracy what they would consider obstacles or what path they would take to overcome them. “One of the reasons that we trust 19-year-old Marine corporals in Ramadi with live rounds and a weapon is because they have both the compute substrate — the brain and the eyes — but the deep world knowledge to understand, ‘Yeah, I probably shouldn’t do that,’” said William Marcellino, a senior behavioral scientist at the RAND Corporation researching military AI applications. “That is not something that current public AI technology has.”
Anthropic CEO warns of AI-driven botnet 'swarm' taking over the entire internet
Key considerations
- Investor positioning can change fast
- Volatility remains possible near catalysts
- Macro rates and liquidity can dominate flows
Reference reading
- https://www.tomshardware.com/tech-industry/artificial-intelligence/SPONSORED_LINK_URL
- https://www.tomshardware.com/tech-industry/artificial-intelligence/us-army-reportedly-developing-program-that-would-deploy-ai-agents-to-autonomously-seek-and-destroy-targets-in-enemy-digital-infrastructures-experts-warn-echotribble-program-could-have-disastrous-consequences#main
- https://www.tomshardware.com/membership
- NVIDIA Advances Agentic Security for Media, From European Public Service Broadcasting to Global Content Production
- Save $60 on this TP-Link wireless router with ultra-fast Wi-Fi 7 support, now $189.98
- Ukraine rescues wounded soldier using drone in daring 'world's first' UAV evacuation of a human
- Qualcomm to cut jobs globally in "performance-based" layoffs, as company pivots to AI data center and edge computing markets
- Engineer builds tiny 3D-printed single-motor drone in their bedroom
Informational only. No financial advice. Do your own research.