DexTacWAM: A Visuo-Tactile World-Action Model for Dexterous Manipulation
Teaching robots to feel what they see during delicate hand tasks
Researchers built a system that combines touch and vision to help robots perform delicate manipulation tasks like in-hand object rotation and manipulation. The system outperformed existing approaches on all six tested tasks, nearly doubling the success rate (70.6 versus 38.0), because it actually modeled how contact forces change over time rather than just sensing them passively.
Robots currently struggle with fine-motor tasks that require constant feedback about finger contact — tasks humans do effortlessly. This approach works with existing pretrained vision systems and learns from just 100 demonstrations per task, making it practical to deploy on real robotic hands without months of retraining. Better dexterous robots could accelerate automation in assembly lines, surgery, and delicate manufacturing where precision and feel matter.