The ultimate goal of AR is to create living enchanted worlds that see and interact with their inhabitants. Existing commercial products can already digitize the static world and modify it with photorealistic computer graphics. One of the last barriers to democratizing AR is the ability to effortlessly digitize humans.

We will describe in detail how to use AI to digitize human motion and behavior from standard video cameras without traditional motion capture or depth sensing hardware. We will present a live “MagicMirror” in which an audience member can be beamed from a mobile phone camera into an Augmented Reality application.