Google AI project apes memory, programs (sort of) like a human

Neural Turing Machines attempt to emulate the brain's short-term memory

Artificial intelligence concept illustration

An artificial intelligence concept illustration.

abstract, android, artificial, binary, blue, brain, cell, communication, computer, concept, connection, creative, cyber, cybernetic, cyberspace, cyborg, data, digit, digital, fantasy, fiction, future, futuristic, fuzzy, head, human, idea, illustration, imagination, informatics, information, dreamstime

dreamstime_29416761
Artificial intelligence concept illustration An artificial intelligence concept illustration. abstract, android, artificial, binary, blue, brain, cell, communication, computer, concept, connection, creative, cyber, cybernetic, cyberspace, cyborg, data, digit, digital, fantasy, fiction, future, futuristic, fuzzy, head, human, idea, illustration, imagination, informatics, information, dreamstime dreamstime_29416761

The mission of Google's DeepMind Technologies startup is to "solve intelligence." Now, researchers there have developed an artificial intelligence system that can mimic some of the brain's memory skills and even program like a human.

The researchers developed a kind of neural network that can use external memory, allowing it to learn and perform tasks based on stored data.

Neural networks are interconnected computational "neurons." While conventional neural networks have lacked readable and writeable memory, they have been used in machine learning and pattern-recognition applications such as computer vision and speech recognition.

The so-called Neural Turing Machine (NTM) that DeepMind researchers have been working on combines a neural network controller with a memory bank, giving it the ability to learn to store and retrieve information.

The system's name refers to computer pioneer Alan Turing's formulation of computers as machines having working memory for storage and retrieval of data.

The researchers put the NTM through a series of tests including tasks such as copying and sorting blocks of data. Compared to a conventional neural net, the NTM was able to learn faster and copy longer data sequences with fewer errors. They found that its approach to the problem was comparable to that of a human programmer working in a low-level programming language.

The NTM "can infer simple algorithms such as copying, sorting and associative recall from input and output examples," DeepMind's Alex Graves, Greg Wayne and Ivo Danihelka wrote in a research paper available on the arXiv repository.

"Our experiments demonstrate that it is capable of learning simple algorithms from example data and of using these algorithms to generalize well outside its training regime."

A spokesman for Google declined to provide more information about the project, saying only that the research is "quite a few layers down from practical applications."

In a 2013 paper, Graves and colleagues showed how they had used a technique known as deep reinforcement learning to get DeepMind software to learn to play seven classic Atari 2600 video games, some better than a human expert, with the only input being information visible on the game screen.

Google confirmed earlier this year that it had acquired London-based DeepMind Technologies, founded in 2011 as an artificial intelligence company. The move is expected to have a major role in advancing the search giant's research into robotics, self-driving cars and smart-home technologies.

More recently, DeepMind co-founder Demis Hassabis wrote in a blog post that Google is partnering with artificial intelligence researchers from Oxford University to study topics including image recognition and natural language understanding.

Join the newsletter!

Error: Please check your email address.
Show Comments

Blog Posts

The competitive advantage Australian retailers have over Amazon

With all of the hype around Amazon, many online retailers have been trying to understand how they can compete with the American retail giant.

Joel Milligan

Performance manager, Columbus Agency

How to become the customer experience custodian

The number one objective enterprises give for embarking on a digital transformation is to improve customer experiences with new engagement models, according to IDC’s 2017 global study.

Fear not: It's only a robot

Every time I pass through the automated border controls at the Sydney airport I walk away with a feeling of exasperation on the one hand and relief on the other. Exasperation, because the face recognition technology inevitably always fails to recognise me. Relief, because we seem to be safely years away from the Orwellian reality of states controlling every aspect of our lives; something the media is keenly warning us against each day.

Dan Kalinski

CEO, iProspect Australia and New Zealand

And to add after looking at event pictures plus, observing all AU's visible Blonde Bimbos (think Julie Bishop to this Georgie Gardnerare)...

absolutelyconcerned

In pictures: CMO 50 2017: The who's who of Australian marketing leadership

Read more

CMO 50 2017 announcement mentioning "innovation". I checked date and its November not April so its wasn't an April Fools' Joke. Australia...

absolutelyconcerned

In pictures: CMO 50 2017: The who's who of Australian marketing leadership

Read more

I worked at Momentum when the transformation started way back in 2013 (not 2015 as stated in the article). It was a painfully slow and co...

Jay

How Momentum Energy has transformed its entire business to be customer-led

Read more

Another buzzword thoughtlessly latched onto, without any thought for the implications on the organisations that have to lumber through th...

Tired

Rolling out agile marketing at Deakin

Read more

Useful., also don’t miss out on these 5 features of Adobe Experience Cloud - Visit here > http://www.softcrylic.com/b...

Sunil Joseph

Adobe debuts Advertising Cloud, Experience Cloud

Read more

Latest Podcast

More podcasts

Sign in