Accessibility links Telegraph. co. uk Sunday 31 December 2017 Advertisement Google network learns to play Space Invaders in breakthrough for artificial intelligence The DQN network learned how to play classic video games including Space Invaders and Breakout without programming The network mastered the Atari game Space Invaders after being given just minimal information The network mastered the Atari game Space Invaders after being given just minimal information Photo: ALAMY Sarah Knapton By Sarah Knapton, Science Editor 7:18PM GMT 25 Feb 2015 Follow Artificial intelligence has taken a major step forward after Google created a network which learned to play a range of computer games on its own without being pre-programmed. The Deep Q Network (DQN) was given just the basic data from one Atari game and an algorithm which learned by trying out different scenarios to come up with the best score. Without any further programming the network worked out how to play a further 48 classic video games including Space Invaders and Breakout. Demis Hassabis of Google’s artificial intelligence arm DeepMind said the ultimate goal was to create a computer which had the mental capabilities of a toddler. “This work is the first time that anyone has built a single general learning system that can learn directly from experience to learn a wide range of challenging tasks,” he said. Related Articles 20 Apr 2016 06 Feb 2015 25 Feb 2015 billions and achieving little 19 Feb 2015 “In this case a set of Atari games and perform at better or human level on those fames “DQN can learn to play dozens of the games straight out of the box. We don’t preprogramme it between its games. “It has minimal sets of assumptions and all it gets access to are the raw pixel inputs and the game score and from there it has to figure out what it controls in the game world and how to get points and master the game just by playing the game directly. “It’s the first artificial agent that is capable of learning to excel over a diverse array of challenging tasks. ” Mr Hassabis said the network was far superior to the computer Deep Blue which became the first machine to surpass humans when it beat chess grand master Garry Kasparov in 1997. “With Deep Blue it was the team of chess grand masters which instilled the chess knowledge into a programme and that programme effectively executed that without adapting or learning anything," he said. “What we’ve done is build algorithms which learn from the ground up, so you give them perceptual experience and they learn how to do thinks directly. “The idea is that these types of systems are more human like in the way they learn because that is how humans learn, by learning from, the world around us, using our senses, to allow us to make decisions and plans. ” Google programmers said they had been amazed with some of the solutions that the network had come up with for winning the game, such as keeping the submarine just below water level in SeaQuest to stay alive and creating a tunnel in Breakout so that the ball passed through and could hit more bricks. “One of the things we’re trying to do we’re trying to build the ability of two or three year toddler, pre-linguistic toddler and we aren’t anywhere close to that," Mr Hassabis said. “But this is as good as a professional human game tester. ” The research was published in the journal Nature. Science News In Science News A combination photograph shows the beginning (top L) to the end (top L to bottom R) of a total solar eclipse as seen from the beach of Ternate island, Indonesia Total eclipse, in pictures Scott Kelly returns to Earth The remote economy of the Svalbard archipelago An astonishing image of a pregnant pony uterus has been selected as the overall winner for the 2015 Wellcome Image Awards. The photograph was taken by Michael Frank, and is of an historic specimen from the Lanyon Anatomy Museum of the Royal Veterinary College in London. It shows the preserved uterus of a New Forest pony, approximately five months into the pregnancy Wellcome Image Awards The first space 'selfie' Named after Sir David Space selfie by European Space Agency astronaut Alexander Gerst Pictures of the year- part 4 Top news galleries Woody Allen's 30 best one-liners Woody Allen Comedy Martin Chilton selects 30 great one-liners from the comedian and film star Woody Allen The best British political insults Jeremy Corbyn Culture A hilarious history of political insults and putdowns, from Churchill to Corbyn Culture stars who died in 2016 Culture News We celebrate and remember the culture stars who have passed away in 2016 US Presidents: 30 great one-liners Abraham Lincoln, John F Kennedy, Barack Obama and George W Bush Books Great quotes from White House incumbents: will Donald Trump be joining them? 100 funny jokes by 100 comedians Timeless comedy: a lot of what used to be funny has gone out of date, but not Tommy Cooper Comedy One hundred whip-smart wisecracks History's greatest conspiracy theories From global warming to 9/11, Shakespeare to Elvis, Diana to JFK, peak oil to Roswell, conspiracy theories abound. Grand stand views of London In pics: Stunning aerial shots of London's football stadia by photographer Jason Hawkes Russia's abandoned space shuttles Russia's abandoned space shuttles at the Baikonur Cosmodrome In pics: The crumbling remains of the Soviet Union's space programme Home-made in China Fifty-year-old farmer Chen Lianxue with his homemade plane on the roof of his house in Qifu village of Pingliang, Gansu province, China. The plane took Chen about 28,000 yuan (£2,900) and over two years time to make, local media reported. Ambitious Chinese inventors take on crazy do-it-yourself projects Sinkholes around the world Vehicles following a cave-in of car park in Meridian, Mississippi In pics: Sinkholes, craters and collapsed roads around the world Comments The biggest companies in the world in 2015 The Fortune Global 500 has been released – the annual ranking of the largest companies in the world by revenues. Here is a list of the 20 biggest corporate money-makers Kim Jong-un: His bizarre photoshoots North Korean leader Kim Jong-un speaks at an event declaring the construction of Ryomyong Street, in this photo released by North Korea's Korean Central News Agency (KCNA) in Pyongyang The bizarre photo opportunities of North Korea's leader Kim Jong-un. The 10 hardest universities to get into The Complete University Guide has revealed the universities with the toughest entry criteria. Does your university make the list? Blood Moon in pictures Blood moon:Amazing photos of total 'supermoon' lunar eclipse seen around the world Amazing photos of total 'supermoon' lunar eclipse seen around the world The most exclusive boarding schools With private school fees at their least affordable since the 1960s, we take a look at some of the most expensive schools in the world Advertisement Telegraph on Facebook Advertisement Latest Video» Rat climbs over man Large rat climbs on sleeping commuter Teenager 'groped' and pepper-sprayed at Wisconsin Donald Trump rally Teen pepper-sprayed at Trump rally Disabled great-grandfather denied stairlift and forced to crawl Old and frail wombat is rescued Elderly wombat rescued after being attacked Passengers from hijacked flight arrive in Cairo EgyptAir crew finally arrive in Cairo Scientist in lab Sponsored When media meets medicine More from The Telegraph Advertisement Advertisement More from the web Loading More from The Telegraph Loading News Progress 17 supply vehicle departs from the International Space Station The latest news, opinion and analysis View Football Catch up on all the latest football news and results View Film All the latest film trailers, reviews and features View Competitions Enter one of our exciting new competitions View Back to top Terms and Conditions Today's News Archive Style Book Weather Forecast