Hand Tracking for VR Cardboard
This project is an implementation of the “Virtual Hand” tutorial from the Master‘s Degree in Computer Science at the University of Castilla-La Mancha.
It demonstrates how to create a virtual hand in an Unreal Engine application that follows the user’s hand movements. The application is designed to run on an Android device with “Cardboard VR” style goggles.
The core of the project is the use of the rear camera of a smartphone to track fiducial markers placed on the user‘s hand. This tracking data is then used to animate a virtual hand in the Unreal Engine environment, creating an immersive virtual reality experience. The project is based on the “Augmented Unreality” plugin, which leverages the ArUco library for marker detection.
Furthermore, the use of two groups of markers allows the detection of the grab pose.
