According to a recent UN report, an autonomous drone hunted down and attacked humans without being told to do so from human commanders. The attack, which took place in Libya in March 2020, was the first time such an attack by artificial intelligence (AI) took place on humans. It is unclear whether the drone killed any people during the attack.
The report to the UN Security Council states that on March 27, 2020, Libyan Prime Minister Fayez al-Sarraj ordered “Operation PEACE STORM”, under which unmanned combat aerial vehicles (UCAV) were used against Haftar Affiliated Forces.
Drones have been used in combat for years, but this attack was different because they were used without human input.
“Logistics convoys and retreating HAF were subsequently hunted down and remotely engaged by the unmanned combat aerial vehicles or the lethal autonomous weapons systems such as the STM Kargu-2 (see annex 30) and other loitering munitions,” the report states.
“The lethal autonomous weapons systems were programmed to attack targets without requiring data connectivity between the operator and the munition: in effect, a true ‘fire, forget and find’ capability,” it continues.
The KARGU is a rotary-wing attack drone designed for asymmetric warfare or anti-terrorist operations. According to the manufacturers, it “can be effectively used against static or moving targets through its indigenous and real-time image processing capabilities and machine learning algorithms embedded on the platform.”
A video showcasing the drone shows it targeting mannequins in a field before diving at them and detonating an explosive charge.
Against human targets, the drones proved effective.
“Units were neither trained nor motivated to defend against the effective use of this new technology and usually retreated in disarray,” the report says. “Once in retreat, they were subject to continual harassment from the unmanned combat aerial vehicles and lethal autonomous weapons systems, which were proving to be a highly effective combination.”
The report did not specify whether there were casualties or deaths connected with the attack. But it did note that the drones were “highly effective” in helping to inflict “significant casualties” on enemy Pantsir S-1 surface-to-air missile systems. It’s perfectly possible that the first human has been attacked or killed by a drone operated by a machine learning algorithm.
The attack, whether it produced casualties or not, will not be welcomed by campaigners against the use of “killer robots.”
“There are serious doubts that fully autonomous weapons would be capable of meeting international humanitarian law standards, including the rules of distinction, proportionality, and military necessity, while they would threaten the fundamental right to life and principle of human dignity,” the Human Rights Watch says. “Human Rights Watch calls for a preemptive ban on the development, production, and use of fully autonomous weapons.”
Another concern is that AI algorithms used by the robots may not be robust enough. As well as being open to errors (such as a Tesla tricked into swerving off the road) there are countless examples of biases within machine-learning tech, from facial recognition that doesn’t recognize non-white skin tones, to cameras that tell Asian people to stop blinking, to racist soap dispensers that won’t give you soap if you’re black and self-driving cars that are more likely to run you over if you are not white.
Now, it appears we could be trusting life and death decisions to tech that may be open to similar problems.
312 thoughts on “Drone “Hunts Down” Humans Without Command”
Hi there! Someone in my Myspace group shared this site with us so I came to give it a look. I’m definitely enjoying the information. I’m book-marking and will be tweeting this to my followers! Superb blog and superb design and style.|
Hi there would you mind letting me know which web host you’re utilizing? I’ve loaded your blog in 3 completely different web browsers and I must say this blog loads a lot quicker then most. Can you suggest a good internet hosting provider at a reasonable price? Thanks, I appreciate it!|
Genuinely no matter if someone doesn’t understand then its up to other visitors that they will help, so here it happens.|
Hi, yeah this post is truly pleasant and I have learned lot of things from it regarding blogging. thanks.|
Hey I know this is off topic but I was wondering if you knew of any widgets I could add to my blog that automatically tweet my newest twitter updates. I’ve been looking for a plug-in like this for quite some time and was hoping maybe you would have some experience with something like this. Please let me know if you run into anything. I truly enjoy reading your blog and I look forward to your new updates.|
Hi, Neat post. There’s a problem together with your website in internet explorer, could check this? IE nonetheless is the marketplace leader and a huge component to people will leave out your great writing because of this problem.|
Appreciating the commitment you put into your blog and detailed information you present. It’s awesome to come across a blog every once in a while that isn’t the same out of date rehashed information. Fantastic read! I’ve bookmarked your site and I’m including your RSS feeds to my Google account.|
Heya i’m for the first time here. I found this board and I find It really useful & it helped me out much. I hope to give something back and help others like you aided me.|
This information is worth everyone’s attention. Where can I find out more?|
hello there and thank you for your information â€“ I have certainly picked up something new from right here. I did however expertise several technical points using this site, since I experienced to reload the site lots of times previous to I could get it to load correctly. I had been wondering if your web hosting is OK? Not that I am complaining, but slow loading instances times will very frequently affect your placement in google and can damage your quality score if advertising and marketing with Adwords. Anyway I am adding this RSS to my email and can look out for much more of your respective intriguing content. Make sure you update this again very soon.|