Using AI to build enchanted worlds: Frictionless Digitization of Human Motion and Behaviours from standard video for AR/VR Applications

Room GH

The ultimate goal of AR is to create living enchanted worlds that see and interact with their inhabitants. Existing commercial products can already digitize the static world and modify it with photorealistic computer graphics. One of the last barriers to democratizing AR is the ability to effortlessly digitize humans.

We will describe in detail how to use AI to digitize human motion and behavior from standard video cameras without traditional motion capture or depth sensing hardware. We will present a live “MagicMirror” in which an audience member can be beamed from a mobile phone camera into an Augmented Reality application.

Develop Track