Human-level concept learning through probabilistic program induction -- visual Turing tests

By Brenden Lake, Ruslan Salakhutdinov, and Joshua Tenenbaum
Email: brenden at-sign nyu dot edu

Visual Turing Tests for Alternative and Lesioned Models

This is a complete set of visual Turing tests organized by the task. The main tests can be accessed at this link.


Generating new exemplars
Full model
Lesioned learning-to-learn (token level)
Lesioned learning-to-learn (type level)
Lesioned compositionality
Five background alphabets (Set 1)
Five background alphabets (Set 2)

Generating new exemplars (dynamic)
Full model
Full model (random stroke order and directions)
Full model (reversed stroke order and directions)
Lesioned learning-to-learn (type-level; optimal stroke order and directions)
Lesioned learning-to-learn (type-level; random stroke order and directions)

Generating new concepts (from type)
Full model
Lesioned learning-to-learn (type level)
Novelty control
Style control

Generating new concepts (unconstrained)
Full model (non-parametric extension)
Full model (no extension)
Lesioned learning-to-learn (type-level)
Lesioned compositionality

Also, you can try our "visual Turing tests" with feedback after every trial. This version was not run or reported for the paper.

Feedback versions

Generating new exemplars
Full model
Lesioned learning-to-learn (token level)
Lesioned learning-to-learn (type level)
Lesioned compositionality
Five background alphabets (Set 1)
Five background alphabets (Set 2)

Generating new exemplars (dynamic)
Full model
Full model (random stroke order and directions)
Full model (reversed stroke order and directions)
Lesioned learning-to-learn (type-level; optimal stroke order and directions)
Lesioned learning-to-learn (type-level; random stroke order and directions)

Generating new concepts (from type)
Full model
Lesioned learning-to-learn (type level)
Novelty control
Style control

Generating new concepts (unconstrained)
Full model (non-parametric extension)
Full model (no extension)
Lesioned learning-to-learn (type-level)
Lesioned compositionality