MINT is now open source.
From first-person RGB video, MINT reconstructs 3D camera trajectories and bimanual hand motion in a shared world coordinate system. Reconstructed human hand motion can also be retargeted to WUJI Hand.
The release includes model weights, training and inference code, visualization and evaluation tools, EgoPipeline reference code, and structured annotations for 560,649 episodes covering 1,021 hours of first-person video.
Project:
Code:
#
MINT# #
EmbodiedAI# #
Robotics# #
WUJIHand#