mario - http://archive.pkmital.com https://archive.pkmital.com computational audiovisual augmented reality research Thu, 18 Nov 2010 01:48:50 +0000 en-US hourly 1 https://wordpress.org/?v=6.9.4 6DOF Head Tracking https://archive.pkmital.com/2010/11/18/6dof-head-tracking/ https://archive.pkmital.com/2010/11/18/6dof-head-tracking/#respond Thu, 18 Nov 2010 01:41:26 +0000 http://pkmital.com/home/?p=420 The following demo works with SeeingMachines FaceAPI in openFrameworks controlling a Mario avatar.  It also has some really poor gesture recognition (and learning but it’s not shown here), though a threshold on the rotation DOF would have produced better results for the simple task of looking up/down left/right gestures.

6DOF Head Tracking from pkmital on Vimeo.

interfacing seeingmachines faceapi with openFrameworks to control a 3D mario avatar

This is just with the non-commercial license. The full commercial license (~$3000?) gives you access to lip/mouth tracking and eye-brows, as well as much more flexibility in how to use their api with different/multiple cameras and accessing image data.

Of course, there are other initiatives at producing similar results. Mutual information based template trackers, for instance, seem to be state-of-art. Take a look at recent work by Panin and Knoll using OpenTL:

 

I imagine a lot of people would like this technology.… Continue reading...

The post 6DOF Head Tracking first appeared on http://archive.pkmital.com.

]]>
https://archive.pkmital.com/2010/11/18/6dof-head-tracking/feed/ 0