Google AI project apes memory, programs (sort of) like a human

Neural Turing Machines attempt to emulate the brain's short-term memory

Artificial intelligence concept illustration

An artificial intelligence concept illustration.

abstract, android, artificial, binary, blue, brain, cell, communication, computer, concept, connection, creative, cyber, cybernetic, cyberspace, cyborg, data, digit, digital, fantasy, fiction, future, futuristic, fuzzy, head, human, idea, illustration, imagination, informatics, information, dreamstime

dreamstime_29416761
Artificial intelligence concept illustration An artificial intelligence concept illustration. abstract, android, artificial, binary, blue, brain, cell, communication, computer, concept, connection, creative, cyber, cybernetic, cyberspace, cyborg, data, digit, digital, fantasy, fiction, future, futuristic, fuzzy, head, human, idea, illustration, imagination, informatics, information, dreamstime dreamstime_29416761

The mission of Google's DeepMind Technologies startup is to "solve intelligence." Now, researchers there have developed an artificial intelligence system that can mimic some of the brain's memory skills and even program like a human.

The researchers developed a kind of neural network that can use external memory, allowing it to learn and perform tasks based on stored data.

Neural networks are interconnected computational "neurons." While conventional neural networks have lacked readable and writeable memory, they have been used in machine learning and pattern-recognition applications such as computer vision and speech recognition.

The so-called Neural Turing Machine (NTM) that DeepMind researchers have been working on combines a neural network controller with a memory bank, giving it the ability to learn to store and retrieve information.

The system's name refers to computer pioneer Alan Turing's formulation of computers as machines having working memory for storage and retrieval of data.

The researchers put the NTM through a series of tests including tasks such as copying and sorting blocks of data. Compared to a conventional neural net, the NTM was able to learn faster and copy longer data sequences with fewer errors. They found that its approach to the problem was comparable to that of a human programmer working in a low-level programming language.

The NTM "can infer simple algorithms such as copying, sorting and associative recall from input and output examples," DeepMind's Alex Graves, Greg Wayne and Ivo Danihelka wrote in a research paper available on the arXiv repository.

"Our experiments demonstrate that it is capable of learning simple algorithms from example data and of using these algorithms to generalize well outside its training regime."

A spokesman for Google declined to provide more information about the project, saying only that the research is "quite a few layers down from practical applications."

In a 2013 paper, Graves and colleagues showed how they had used a technique known as deep reinforcement learning to get DeepMind software to learn to play seven classic Atari 2600 video games, some better than a human expert, with the only input being information visible on the game screen.

Google confirmed earlier this year that it had acquired London-based DeepMind Technologies, founded in 2011 as an artificial intelligence company. The move is expected to have a major role in advancing the search giant's research into robotics, self-driving cars and smart-home technologies.

More recently, DeepMind co-founder Demis Hassabis wrote in a blog post that Google is partnering with artificial intelligence researchers from Oxford University to study topics including image recognition and natural language understanding.

Join the newsletter!

Or

Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.
Show Comments

Latest Videos

Conversations over a cuppa with CMO: Microsoft's Pip Arthur

​In this latest episode of our conversations over a cuppa with CMO, we catch up with the delightful Pip Arthur, Microsoft Australia's chief marketing officer and communications director, to talk about thinking differently, delivering on B2B connection in the crisis, brand purpose and marketing transformation.

More Videos

JP54,D2, D6, JetA1 EN590Dear Buyer/ Buyer mandateWe currently have Available FOB Rotterdam/Houston for JP54,D2, D6, JetA1 with good and w...

Collins Johnson

Oath to fully acquire Yahoo7 from Seven West Media

Read more

Hi This is George, Thanks for sharing this nice information about foodpanda blockchain. During this pandemic situation food delivery indu...

George David

foodpanda launches blockchain-based out-of-home advertising campaign

Read more

Did anyone proofread this document before it was published?

Beau Ushay

CMO Momentum 2020: How to embrace agile marketing

Read more

JP 54, D2, and D6 EN590,JET A1 AVAILABLE ON FOB DIP AND TEST IN SELLER TANKWe Can supply Aviation Kerosene,Jet fuel (JP 54-A1,5), Diesel ...

Collins Johnson

Oath to fully acquire Yahoo7 from Seven West Media

Read more

An honest and hardworking conveyancer doesn't need a marketing strategy. His past clients will spread the word for him. These days the ho...

Bagen Andrea

What this millennial marketer is doing to shake up conveyancing

Read more

Blog Posts

Commissioning personas that get used

How to avoid the bottom drawer, and how to get value from the work you’ve paid for

Melanie Wiese

Chief strategy officer, Wunderman Thompson

Why It’s Going To Be A Bumper Holiday Season Despite the Pandemic

Behavioural science expert Dan Monheit, co-founder and strategy director of creative agency, Hardhat, writes that marketing chiefs should hold their nerve, as they have reason to be optimistic

Dan Monheit

Co-founder, Hardhat

Why marketing and UX teams must join IT on cyber security

For far too long, cyber security has been considered the sole domain and concern of the IT department, with other departments including marketing, UX and design, firmly entrenched in the belief it is not their concern. The reality could not be further from the truth. In fact, this view is dangerous as it could lead to irreparable brand damage and a lack of trust in consumer behaviour.

Nicki Doble

CIO, Cover-More Group

Sign in