 |
| HTC announces lip tracking module for the Vive Pro |
HTC has announced a suite of tracking devices for its Vive Pro virtual reality glasses, including devices for capturing facial expressions and mouth movements.
The $ 130 Vive Facial Tracker connects to Vive Pro glasses and uses two cameras and infrared illumination to record lip, cheek and chin movements, then convert them into virtual facial expressions.
VIVE Facial Tracker precisely tracks expressions and gestures through 38 combinations of lips, chin, teeth, tongue, cheeks and chin.
HTC has announced that the Vive Face Tracker, which can track up to 38 facial movements, will be available to users soon.
HTC launched an experimental VR face tracker in 2019 and released the product on Twitter earlier this week.
Some developers (like Neos VR Social Space developers) have already used the tool, but so far HTC has not confirmed a large-scale commercial release.
VIVE Face Tracker can be combined with built-in eye tracking in VIVE Pro Eye to track the entire face and can effectively convert most of the user's face into an avatar or motion detection system.
HTC Global Virtual Reality Tracker also features a new version of the 3rd generation VIVE Tracker.
The Tracker palm is 33% smaller than the previous generation and the weight is reduced by 15%. HTC promises to extend battery life by 75% and should roll out as soon as possible for $ 130.
Depending on the exact date, they will likely compete with the upcoming Tundra Tracker, a smaller SteamVR-based alternative that's expected to ship this summer.
These HTC devices enable accurate tracking of body parts not detected by standard VR sensors.
Many social experiments in virtual reality rely on sound to estimate people's lip movement. However, the new face tracker can directly capture facial movement and reflect expressions such as smiling and frowning.
Likewise, a VR tracker can be attached via a dedicated console or attached to a strap on a person's leg or foot - this usually displays the basic animation or is not at all viewable in VR.
The Face Tracker appears to have limited compatibility because it is suitable for use with the professional Vive Pro series, but not with the newer and more consumer-oriented Vive Cosmos.
As VR developer Olivier JT noted on Twitter, the face tracker doesn't appear to support the Valve indicator. This is an advanced interface whose hardware settings affect Vive Pro.
However, face tracking could become an increasingly important part of virtual reality today.
Facebook CEO Mark Zuckerberg said earlier this week that Oculus' virtual reality division is prioritizing capturing eye movements and facial expressions in future devices and releasing more photorealistic virtual avatars.