Omote real time face tracking and mapping

Real-time Face Tracking & Projection Mapping

Maybe the most beautiful of use face tracking technology you have ever seen.

Omote is a Japanese word for face, or a mask. .Face-mapping technology already exists, often used in marketing initiatives.  But Japanese media artist Nobumichi Asai wanted to focus on the expression of [beauty] and [make-up art] instead of technological gimmicks and impacts.  But this demands a higher level of technological precision.  A subtle mismatch in projection would ruin the effect. We think it is stunning and breathtaking beautiful, as you can see for yourself in this video:

The overall system was created and developed by Paul Lacroix and Nobumichi Asai. Technically, it’ s very difficult to project with real-time tracking.

As Nobumichi explains:

Nobody has done it before, so we had to start from scratch. The process was complicated, capturing with sensors, processing the data, creating CG renderings, and using projectors. Getting the timing right was also challenging, fixing delays and making sure the projection technology had the maximum precision to get the face and visuals matched.

For this project, we used OptiTrack sensors for speedy response, and developed original program C++. To reduce minimal latency (delay), we devised ways to integrate the whole process into one program. This creates amazing effects.

More? Visit the Omote project’s website.