'Ex Machina', here we come: A new algorithm helps computers learn the way we do

In a 'visual Turing test,' human judges couldn't tell them apart

Machine learning is all about getting computers to "understand" new concepts, but it's still a pretty inefficient process, often requiring hundreds of examples for training. That may soon change, however, thanks to new research published on Friday.

Aiming to shorten the learning process and make it more like the way humans acquire and apply new knowledge based on just a few examples, a team of researchers has developed what they call a Bayesian Program Learning framework and then used it to teach computers to identify and reproduce handwritten characters based on just a single example.

Whereas standard pattern-recognition algorithms represent concepts as configurations of pixels or collections of features, the BPL approach learns by “explaining” the data provided to the algorithm -- in this case, the sample character. Concepts are represented as probabilistic computer programs and the algorithm essentially programs itself by constructing code to produce the letter it sees. It can also capture variations in the way different people draw a given letter.

The model also “learns to learn” by using knowledge from previous concepts to speed learning on new ones, so it can use knowledge of the Latin alphabet to learn letters in the Greek alphabet more quickly, for example.

Most compelling of all is that the algorithm allowed computers to pass a sort of "visual Turing test." Specifically, the researchers asked both humans and computers to reproduce a series of handwritten characters after being shown just a single example of each; in some cases, subjects were asked to create entirely new characters in the style of those originally shown. Bottom line: human judges couldn't tell the results apart.

The researchers have applied their model to more than 1,600 types of handwritten characters in 50 writing systems, including Sanskrit, Tibetan, Gujarati and Glagolitic. They even tried it on invented characters such as those from the television series "Futurama."

A paper describing the research was published Friday in the journal Science. Its authors were Brenden Lake, a Moore-Sloan Data Science Fellow at New York University; Ruslan Salakhutdinov, an assistant professor of Computer Science at the University of Toronto; and Joshua Tenenbaum, a professor at MIT in the Department of Brain and Cognitive Sciences and the Center for Brains, Minds and Machines.

“It has been very difficult to build machines that require as little data as humans when learning a new concept,” said Salakhutdinov. “Replicating these abilities is an exciting area of research connecting machine learning, statistics, computer vision, and cognitive science.”

Join the CMO newsletter!

Error: Please check your email address.
Show Comments

Supporting Association

Blog Posts

Top tips to uncovering consumer insights for business innovation

An in-depth understanding of consumers sits at the heart of what we all need to do, but we know it’s not always easy to uncover insights that will unlock a true innovation opportunity.

Matt Whale

Managing director, How To Impact

Is your customer experience program suffering bright shiny object syndrome?

You may have heard of ‘bright shiny object syndrome’. The term is used to describe new initiatives undertaken by organisations that either lack a strategic approach, or suffer from a failure to effectively implement.

Leveraging technology to stand out in the sea of sameness

The technology I'm talking about here is data and marketing automation. Current digital marketing methodology, much as it is practiced at Bluewolf, dictates the need for a strategy that does four things: Finds the right audience, uses the right channel, delivers the right content, and does all of that at the right time.

Eric Berridge

CEO and co-founder of Bluewolf, an IBM Company

Lead Management is very important part of the process. For anyone running Facebook Lead Ads I would recommend using this service.Get your...

Dirk Lo

How this fintech startup is improving content marketing and lead generation

Read more

I am agreeing with Mr. Tyron Hayes that a measured test-and-learn approach could be missing opportunities to not only better engage custo...

rush essay reviews

CMO interview: How Curtin University’s marketing chief is using test and learn to cope with complexity

Read more

Excellent!

Dr Sadasivan,US

Shakespeare shows data and creativity aren’t Montagues and Capulets

Read more

Great article! Agreed with all... Matthew Lerner, Deeps De Silva... When a company has a great product that solves customers needs, a gre...

James Tyler

Why marketers are embracing growth hacking techniques

Read more

Very good article, Social media analytics helps in problem identification. They can serve as an early warning system for negative custome...

BizVinu

Four ways to use social media to boost customer loyalty

Read more

Latest Podcast

More podcasts

Sign in