In HapTile, the person teleoperating the robot feels the contact, and the dataset logs what they felt. A UR5e arm is teleoperated through contact-rich tabletop tasks, and the feedback level the operator received through the rig is logged as firm , mild or soft , next to the robot state and the video.
What is in it
HapTile comes from the authors listed on the source release and the paper "HapTile: A Haptic-Informed Vision-Tactile-Language-Action Dataset for Contact-Rich Imitation Learning" ( arXiv:2606.04825 ). The Voxel51 version converts it to multimodal MCAP episodes. It has 1,699 episodes across 38 tasks, 664,045 frames and 12.36 hours.
Each gripper finger carries a vision-based tactile sensor. It films a gel pad printed with a marker grid, so contact shows up as the markers moving.…