Overclock.net › Forums › Industry News › Hardware News › [Dailytech]New Navy-funded Report Warns of War Robots Going "Terminator"
New Posts  All Forums:Forum Nav:

[Dailytech]New Navy-funded Report Warns of War Robots Going "Terminator"

post #1 of 31
Thread Starter 
Quote:
Robots must learn to obey a warrior code, but increasing intelligence may make keeping the robots from turning on their masters increasingly difficult


Robots gone rogue killing their human masters is rich science fiction fodder, but could it become reality? Some researchers are beginning to ask that question as artificial intelligence advances continue, and the world's high-tech nations begin to deploy war-robots to the battlefront. Currently, the U.S. armed forces use many robots, but they all ultimately have a human behind the trigger. However, there are many plans to develop and deploy fully independent solutions as the technology improves.

Some mistakenly believe that such robots would only be able to operate within a defined set of behaviors. Describes Patrick Lin, the chief compiler of a new U.S. Navy-funded report, "There is a common misconception that robots will do only what we have programmed them to do. Unfortunately, such a belief is sorely outdated, harking back to a time when . . . programs could be written and understood by a single person."

The new report points out that the size of artificial intelligence projects will likely make their code impossible to fully analyze and dissect for possible dangers. With hundreds of programmers working on millions of lines of code for a single war robot, says Dr. Lin, no one has a clear understanding of what going on, at a small scale, across the entire code base.

He says the key to avoiding robotic rebellion is to include "learning" logic which teaches the robot the rights and wrongs of ethical warfare. This logic would be mixed with traditional rules based programming.

The new report looks at many issues surrounding the field of killer robots. In addition to code malfunction, another potential threat would be a terrorist attack which reprogrammed the robots, turning them on their owners. And one tricky issue discussed is the question of who would take the blame for a robotic atrocity -- the robot, the programmers, the military, or the U.S. President.

The Ethics and Emerging Technology department of California State Polytechnic University created the report of the U.S. Navy's Office of Naval Research. It warns the Navy about the dangers of premature deployment or complacency on potential issues. U.S. Congress has currently mandated that by 2010 a "deep strike" unmanned aircraft must be operational, and by 2015 on third of the ground combat vehicles must be unmanned.

The report warns, "A rush to market increases the risk for inadequate design or programming. Worse, without a sustained and significant effort to build in ethical controls in autonomous systems . . . there is little hope that the early generations of such systems and robots will be adequate, making mistakes that may cost human lives."

Simple laws of ethics, such as Isaac Asimov's three laws of robotics, the first of which forbids robots from harming humans, will not be sufficient, say the report's authors. War robots will have to kill, but they will have to understand the difference between enemies and noncombatants. Dr. Lin describes this challenge stating, "We are going to need a code. These things are military, and they can’t be pacifists, so we have to think in terms of battlefield ethics. We are going to need a warrior code."

The U.S. Army had a scare earlier this year when a software malfunction caused war robots deployed in the field to aim at friendly targets. While the humans still had control of the trigger, the incident highlighted the challenges a fully autonomous system would face. The offending robots were serviced and are still deployed in Iraq.
source

One step closer to Skynet....

And of course, some of my favorite classic lines from T2:

"Yes, Cyberdyne Systems model 101."
"I'm a cybernetic organism, living tissue over a metal endoskeleton."
    
CPUMotherboardGraphicsRAM
X2 5000+ BE Gigabyte GA-MA78GM-S2H AM2+ Integrated HD3200 2x2GB OCZ DDR2 
Hard DriveMonitorPowerCase
Maxtor 40GB Samsung 2220WM 22" Antec Neo HE 550W Ultra Wizard 
  hide details  
Reply
    
CPUMotherboardGraphicsRAM
X2 5000+ BE Gigabyte GA-MA78GM-S2H AM2+ Integrated HD3200 2x2GB OCZ DDR2 
Hard DriveMonitorPowerCase
Maxtor 40GB Samsung 2220WM 22" Antec Neo HE 550W Ultra Wizard 
  hide details  
Reply
post #2 of 31
Not in news but posted here: http://www.overclock.net/off-topic/4...come-true.html
Once again...
(13 items)
 
  
CPUMotherboardGraphicsRAM
i7 920 [4.28GHz, HT] Asus P6T + Broadcom NetXtreme II VisionTek HD5850 [900/1200] + Galaxy GT240 2x4GB G.Skill Ripjaw X [1632 MHz] 
Hard DriveOSMonitorKeyboard
Intel X25-M 160GB + 3xRAID0 500GB 7200.12 Window 7 Pro 64 Acer H243H + Samsung 226BW XARMOR-U9BL  
PowerCaseMouseMouse Pad
Antec Truepower New 750W Li Lian PC-V2100 [10x120mm fans] Logitech G9 X-Trac Pro 
  hide details  
Reply
Once again...
(13 items)
 
  
CPUMotherboardGraphicsRAM
i7 920 [4.28GHz, HT] Asus P6T + Broadcom NetXtreme II VisionTek HD5850 [900/1200] + Galaxy GT240 2x4GB G.Skill Ripjaw X [1632 MHz] 
Hard DriveOSMonitorKeyboard
Intel X25-M 160GB + 3xRAID0 500GB 7200.12 Window 7 Pro 64 Acer H243H + Samsung 226BW XARMOR-U9BL  
PowerCaseMouseMouse Pad
Antec Truepower New 750W Li Lian PC-V2100 [10x120mm fans] Logitech G9 X-Trac Pro 
  hide details  
Reply
post #3 of 31
Believe i7
(13 items)
 
  
CPUMotherboardGraphicsRAM
Intel Core i7 920 @ 3.8GHz Asus Rampage II Extreme EVGA GeForce GTX 280 SSC Corsair Dominator 3x2GB DDR3 1600 
Hard DriveOptical DriveOSMonitor
Western Digital VelociRaptor 150GB idk generic disk drive Windows Vista Home Premium x64 SP1 Acer AL2216W 22" 
KeyboardPowerCaseMouse
Logitech G11 Corsair HX1000W Antec 1200 Logitech MX518 
Mouse Pad
Xtrac Ripper 
  hide details  
Reply
Believe i7
(13 items)
 
  
CPUMotherboardGraphicsRAM
Intel Core i7 920 @ 3.8GHz Asus Rampage II Extreme EVGA GeForce GTX 280 SSC Corsair Dominator 3x2GB DDR3 1600 
Hard DriveOptical DriveOSMonitor
Western Digital VelociRaptor 150GB idk generic disk drive Windows Vista Home Premium x64 SP1 Acer AL2216W 22" 
KeyboardPowerCaseMouse
Logitech G11 Corsair HX1000W Antec 1200 Logitech MX518 
Mouse Pad
Xtrac Ripper 
  hide details  
Reply
post #4 of 31
These robots will have to have some damn advanced intelligence to understand ethics like this. I just don't see how making all possibilities on the battlefield understandable to a robot and have them make the "right" decisions will happen without a lot of intelligence and learning built in. But then again... maybe it will work because robots will "think" in a different way than people are used to thinking. There are some creative people out there with some great ideas.

Whole thing worries me a bit actually.
The Core
(5 items)
 
  
CPUMotherboardGraphicsGraphics
Intel Core i5 Z77 Extreme4 Intel(R) HD Graphics 4000 NVIDIA GeForce GTX 770 
RAM
32GB 
  hide details  
Reply
The Core
(5 items)
 
  
CPUMotherboardGraphicsGraphics
Intel Core i5 Z77 Extreme4 Intel(R) HD Graphics 4000 NVIDIA GeForce GTX 770 
RAM
32GB 
  hide details  
Reply
post #5 of 31
Based on my observation of bots in video games, I think the human race needs not fear a robot takeover.
Windy
(17 items)
 
Full Auto GPU-O
(15 items)
 
 
CPUMotherboardGraphicsRAM
i7 970 B1 @ 4.25GHz EVGA X58 Classified 3 (E770) EVGA GTX 970 SSC 24GB Corsair XMS3 
Hard DriveHard DriveHard DriveOptical Drive
Crucial M500 120GB Crucial M4 256GB Samsung Spinpoint F3 1TB (2) LG BD-RW 
CoolingOSMonitorKeyboard
Corsair H50 w/Scythe SFF21F Windows 10 Home Premium 64-bit Dell S2740L Deck Legend 105 - Fire / Linear 
PowerCaseMouseMouse Pad
Corsair AX 750 Soldam Windy Black Knight Mionix Avior 8200 Rocketfish Speed 
Audio
Creative Soundblaster XTreme Audio 
CPUMotherboardGraphicsRAM
i3 540 Asus P7H55-M-PRO EVGA GTX 1070 FTW2 iCX 4GB Corsair DDR3-1600 
Hard DriveHard DriveOptical DriveOS
256GB Samsung 850 Pro 640GB Western Digital Caviar Black Lite-On CD/DVD Burner Linux Mint 18.1 
OSMonitorKeyboardPower
Windows 7 Home Premium 64-bit Samsung 2333HD Deck Legend 105 - Ice EVGA Supernova 650W P2 
CaseMouseMouse Pad
Lian Li Velocity Micro Custom Logitech G500 Rocketfish Speed 
  hide details  
Reply
Windy
(17 items)
 
Full Auto GPU-O
(15 items)
 
 
CPUMotherboardGraphicsRAM
i7 970 B1 @ 4.25GHz EVGA X58 Classified 3 (E770) EVGA GTX 970 SSC 24GB Corsair XMS3 
Hard DriveHard DriveHard DriveOptical Drive
Crucial M500 120GB Crucial M4 256GB Samsung Spinpoint F3 1TB (2) LG BD-RW 
CoolingOSMonitorKeyboard
Corsair H50 w/Scythe SFF21F Windows 10 Home Premium 64-bit Dell S2740L Deck Legend 105 - Fire / Linear 
PowerCaseMouseMouse Pad
Corsair AX 750 Soldam Windy Black Knight Mionix Avior 8200 Rocketfish Speed 
Audio
Creative Soundblaster XTreme Audio 
CPUMotherboardGraphicsRAM
i3 540 Asus P7H55-M-PRO EVGA GTX 1070 FTW2 iCX 4GB Corsair DDR3-1600 
Hard DriveHard DriveOptical DriveOS
256GB Samsung 850 Pro 640GB Western Digital Caviar Black Lite-On CD/DVD Burner Linux Mint 18.1 
OSMonitorKeyboardPower
Windows 7 Home Premium 64-bit Samsung 2333HD Deck Legend 105 - Ice EVGA Supernova 650W P2 
CaseMouseMouse Pad
Lian Li Velocity Micro Custom Logitech G500 Rocketfish Speed 
  hide details  
Reply
post #6 of 31
Quote:
Originally Posted by kremtok View Post
Based on my observation of bots in video games, I think the human race needs not fear a robot takeover.
Haha look bobby he's walking into the wall! Maybe we can nuke him!
Unto The Void
(16 items)
 
  
CPUMotherboardGraphicsRAM
Intel i7 6800k Gigabyte G1 X99-Phoenix SLI Gigabyte GTX 1080 G1 32GB RipJaw 4 DDR4-3000 
Hard DriveHard DriveHard DriveHard Drive
Samsung 850 500GB Crucial M4 2 x Spinpoint F1 Samsung 850 1TB 
CoolingOSMonitorMonitor
Noctua NH-D15S Windows 10 LG Ultrawide 29" Asus 24" 
KeyboardPowerCaseMouse
Logitech 810 EVGA P2 650 Watt In Win 303 Logitech G502 
  hide details  
Reply
Unto The Void
(16 items)
 
  
CPUMotherboardGraphicsRAM
Intel i7 6800k Gigabyte G1 X99-Phoenix SLI Gigabyte GTX 1080 G1 32GB RipJaw 4 DDR4-3000 
Hard DriveHard DriveHard DriveHard Drive
Samsung 850 500GB Crucial M4 2 x Spinpoint F1 Samsung 850 1TB 
CoolingOSMonitorMonitor
Noctua NH-D15S Windows 10 LG Ultrawide 29" Asus 24" 
KeyboardPowerCaseMouse
Logitech 810 EVGA P2 650 Watt In Win 303 Logitech G502 
  hide details  
Reply
post #7 of 31
The Potential For Bad is Amazing, Do it.
Awesome
(13 items)
 
  
CPUMotherboardGraphicsRAM
Core i7 950 Asus Sabertooth X58 6870 8GB DDR3 
Hard DriveMonitorPowerCase
2x500GB WD 23" Samsung 2333T 700W OCZ Lian Li PC 8NWX 
  hide details  
Reply
Awesome
(13 items)
 
  
CPUMotherboardGraphicsRAM
Core i7 950 Asus Sabertooth X58 6870 8GB DDR3 
Hard DriveMonitorPowerCase
2x500GB WD 23" Samsung 2333T 700W OCZ Lian Li PC 8NWX 
  hide details  
Reply
post #8 of 31
More mobile suits, less androids.
00-Raiser
(13 items)
 
  
CPUMotherboardGraphicsRAM
Core i7 920@3.4GHz ASUS P6T X58 Sapphire ATI 4870 512MB Gskill 6GB 1333MHz 
Hard DriveOptical DriveOSMonitor
2x640GB WD Black (RAID 0) 22x Samsung DVD Burner Windows Server 2008: Enterprise Edition Dell S2309W 
KeyboardPowerCaseMouse
Logitech G15 Corsair 850TX Cooler Master Cosmos 1100 Logitech G9 
  hide details  
Reply
00-Raiser
(13 items)
 
  
CPUMotherboardGraphicsRAM
Core i7 920@3.4GHz ASUS P6T X58 Sapphire ATI 4870 512MB Gskill 6GB 1333MHz 
Hard DriveOptical DriveOSMonitor
2x640GB WD Black (RAID 0) 22x Samsung DVD Burner Windows Server 2008: Enterprise Edition Dell S2309W 
KeyboardPowerCaseMouse
Logitech G15 Corsair 850TX Cooler Master Cosmos 1100 Logitech G9 
  hide details  
Reply
post #9 of 31
Even my Robotics professor talked about how scholars believe that this could be a possibility.
|Jolly Roger|
(13 items)
 
  
CPUMotherboardGraphicsRAM
Q9650 @ 4.05GHz Gigabyte GA-EP45-UD3R Rev. 1.1 BFG GTX 280 8GB OCZ Reaper PC2-8500 
Hard DriveOptical DriveOSMonitor
1TB WD Black FALS | 1.5TB SG | 500GB WD Caviar Pioneer DVD-RW/CD-RW Windows 7 Ultimate x64 27" LED & 22" LCD 
KeyboardPowerCaseMouse
Logitech G15 v2 (Orange Back lit) Corsair 750TX NZXT Zero (Full Tower w/8 120mm Fans) MX518 (aka G3) and G5 
Mouse Pad
Bitch please... 
  hide details  
Reply
|Jolly Roger|
(13 items)
 
  
CPUMotherboardGraphicsRAM
Q9650 @ 4.05GHz Gigabyte GA-EP45-UD3R Rev. 1.1 BFG GTX 280 8GB OCZ Reaper PC2-8500 
Hard DriveOptical DriveOSMonitor
1TB WD Black FALS | 1.5TB SG | 500GB WD Caviar Pioneer DVD-RW/CD-RW Windows 7 Ultimate x64 27" LED & 22" LCD 
KeyboardPowerCaseMouse
Logitech G15 v2 (Orange Back lit) Corsair 750TX NZXT Zero (Full Tower w/8 120mm Fans) MX518 (aka G3) and G5 
Mouse Pad
Bitch please... 
  hide details  
Reply
post #10 of 31
Quote:
Originally Posted by onexero View Post
More mobile suits, less androids.
Agreed I want a mobile suit!!!! lol
Quadcore!!
(13 items)
 
  
CPUMotherboardGraphicsRAM
AMD Phenom X4 9850 2.5Ghz BIOSTAR TFORCE TA790GX NVIDIA 8600GTS 256MB GDDR3 G.SKILL 4GB (2 x 2GB) DDR2 1066 (PC2 8500) 
Hard DriveOSMonitorPower
Seagate Barracuda 7200.11 ST31000333AS 1TB Win 7 RC ASUS VH222H Black 21.5" 5ms PC POWER AND COOLING SILENCER MKIII 600W 
  hide details  
Reply
Quadcore!!
(13 items)
 
  
CPUMotherboardGraphicsRAM
AMD Phenom X4 9850 2.5Ghz BIOSTAR TFORCE TA790GX NVIDIA 8600GTS 256MB GDDR3 G.SKILL 4GB (2 x 2GB) DDR2 1066 (PC2 8500) 
Hard DriveOSMonitorPower
Seagate Barracuda 7200.11 ST31000333AS 1TB Win 7 RC ASUS VH222H Black 21.5" 5ms PC POWER AND COOLING SILENCER MKIII 600W 
  hide details  
Reply
New Posts  All Forums:Forum Nav:
  Return Home
  Back to Forum: Hardware News
Overclock.net › Forums › Industry News › Hardware News › [Dailytech]New Navy-funded Report Warns of War Robots Going "Terminator"