Accessibility links Telegraph.
co.
uk Thursday 04 January 2018 Advertisement Threat from Artificial Intelligence not just Hollywood fantasy Oxford academic Dr Stuart Armstrong warns humanity runs the risk of creating super intelligent computers that eventually destroy us all Ex Machina 2015 Ex Machina 2015 Patrick Sawer By Patrick Sawer 11:00PM BST 27 Jun 2015 Follow From the dystopian writings of Aldous Huxley and HG Wells to the sinister and apocalyptic vision of modern Hollywood blockbusters, the rise of the machines has long terrified mankind.
 But it now seems that the brave new world of science-fiction could become all too real.
 An Oxford academic is warning that humanity runs the risk of creating super intelligent computers that eventually destroy us all, even when specifically instructed not to harm people.
 Dr Stuart Armstrong, of the Future of Humanity Institute at Oxford University, has predicted a future where machines run by artificial intelligence become so indispensable in human lives they eventually make us redundant and take over.
 And he says his alarming vision could happen as soon as the next few decades.
 Dr Armstrong said: "Humans steer the future not because we're the strongest or the fastest, but because we're the smartest.
 "When machines become smarter than humans, we'll be handing them the steering wheel.
" He spoke as films and TV dramas such as Channel 4's Humans and Ex-Machina, - which both explore the blurred lines between man and robot - have once again tapped into man's fear of creating a machine that will eventually come to dominate him.
 Dr Armstrong envisages machines capable of harnessing such large amounts of computing power, and at speeds inconceivable to the human brain, that they will eventually create global networks with each other - communicating without human interference.
 It is at that point that what is called Artificial General Intelligence (AGI) - in contrast to computers that carry out specific, limited, tasks, such as driverless cars - will be able to take over entire transport systems, national economies, financial markets, healthcare systems and product distribution.
 "Anything you can imagine the human race doing over the next 100 years there's the possibility AGI will do very, very fast," he said.
 But while handing over mundane tasks to machines may initially appear attractive, it contains within it the seeds of our own destruction.
 In attempting to limit the powers of such super AGIs mankind could unwittingly be signing its own death warrant.
 Indeed, Dr Armstrong warns that the seemingly benign instruction to an AGI to "prevent human suffering", could logically be interpreted by a super computer as "kill all humans", thereby ending suffering all together.
 Furthermore, an instruction such as "keep humans safe and happy", could be translated by the remorseless digital logic of a machine as "entomb everyone in concrete coffins on heroin drips".
 While that may sound far fetched, Dr Armstrong says the risk is not so low that it can be ignored.
 "There is a risk of this kind of pernicious behaviour by a AI," he said, pointing out that the nuances of human language make it all too easily liable to misinterpretation by a computer.
 "You can give AI controls, and it will be under the controls it was given.
 But these may not be the controls that were meant.
" Dr Armstrong, who was speaking at a debate on artificial intelligence organised in London by the technology research firm Gartner, warns that it will be difficult to tell whether a machine is developing in a benign or deadly direction.
 He says an AI would always appear to act in a way that was beneficial to humanity, making itself useful and indispensable - much like the iPhone's Siri, which answers questions and performs simple organisational tasks - until the moment it could logically take over all functions.
 "As AIs get more powerful anything that is solvable by cognitive processes, such as ill health, cancer, depression, boredom, becomes solvable," he says.
 "And we are almost at the point of generating an AI that is as intelligent as humans.
" Dr Armstrong says mankind is now involved in a race to create 'safe AI' before it is too late.
 "Plans for safe AI must be developed before the first dangerous AI is created," he writes in his book Smarter Than Us: The Rise of Machine Intelligence.
 "The software industry is worth many billions of dollars, and much effort is being devoted to new AI technologies.
 "Plans to slow down this rate of development seem unrealistic.
 So we have to race toward the distant destination of safe AI and get there fast, outrunning the progress of the computer industry.
" One solution to the dangers of untrammelled AI suggested by industry experts and researchers is to teach super computers a moral code.
 Unfortunately, Dr Armstrong points out, mankind has spent thousands of years debating morality and ethical behaviour without coming up with a simple set of instructions applicable in all circumstances which it can follow.
 Imagine then, the difficulty in teaching a machine to make subtle distinctions between right and wrong.
 "Humans are very hard to learn moral behaviour from," he says.
 "They would make very bad role models for AIs.
" telegraphsciencetech Follow @telegraph Top news galleries Woody Allen's 30 best one-liners Woody Allen Comedy Martin Chilton selects 30 great one-liners from the comedian and film star Woody Allen The best British political insults Jeremy Corbyn Culture A hilarious history of political insults and putdowns, from Churchill to Corbyn Culture stars who died in 2016 Culture News We celebrate and remember the culture stars who have passed away in 2016 US Presidents: 30 great one-liners Abraham Lincoln, John F Kennedy, Barack Obama and George W Bush Books Great quotes from White House incumbents: will Donald Trump be joining them?
 100 funny jokes by 100 comedians Timeless comedy: a lot of what used to be funny has gone out of date, but not Tommy Cooper Comedy One hundred whip-smart wisecracks History's greatest conspiracy theories From global warming to 9/11, Shakespeare to Elvis, Diana to JFK, peak oil to Roswell, conspiracy theories abound.
 Grand stand views of London In pics: Stunning aerial shots of London's football stadia by photographer Jason Hawkes Russia's abandoned space shuttles Russia's abandoned space shuttles at the Baikonur Cosmodrome In pics: The crumbling remains of the Soviet Union's space programme Home-made in China Fifty-year-old farmer Chen Lianxue with his homemade plane on the roof of his house in Qifu village of Pingliang, Gansu province, China.
 The plane took Chen about 28,000 yuan (£2,900) and over two years time to make, local media reported.
 Ambitious Chinese inventors take on crazy do-it-yourself projects Sinkholes around the world Vehicles following a cave-in of car park in Meridian, Mississippi In pics: Sinkholes, craters and collapsed roads around the world Comments The biggest companies in the world in 2015 The Fortune Global 500 has been released – the annual ranking of the largest companies in the world by revenues.
 Here is a list of the 20 biggest corporate money-makers Kim Jong-un: His bizarre photoshoots North Korean leader Kim Jong-un speaks at an event declaring the construction of Ryomyong Street, in this photo released by North Korea's Korean Central News Agency (KCNA) in Pyongyang The bizarre photo opportunities of North Korea's leader Kim Jong-un.
 The 10 hardest universities to get into The Complete University Guide has revealed the universities with the toughest entry criteria.
 Does your university make the list?
 Blood Moon in pictures Blood moon:Amazing photos of total 'supermoon' lunar eclipse seen around the world Amazing photos of total 'supermoon' lunar eclipse seen around the world The most exclusive boarding schools With private school fees at their least affordable since the 1960s, we take a look at some of the most expensive schools in the world Advertisement Telegraph on Facebook Advertisement Latest Video» Rat climbs over man Large rat climbs on sleeping commuter Teenager 'groped' and pepper-sprayed at Wisconsin Donald Trump rally Teen pepper-sprayed at Trump rally Disabled great-grandfather denied stairlift and forced to crawl Old and frail wombat is rescued Elderly wombat rescued after being attacked Passengers from hijacked flight arrive in Cairo EgyptAir crew finally arrive in Cairo Scientist in lab Sponsored When media meets medicine More from The Telegraph Advertisement Advertisement More from the web Loading More from The Telegraph Loading News Progress 17 supply vehicle departs from the International Space Station The latest news, opinion and analysis View Football Catch up on all the latest football news and results View Film All the latest film trailers, reviews and features View Competitions Enter one of our exciting new competitions View Back to top Terms and Conditions Today's News Archive Style Book Weather Forecast