Menu

HapTile: 1,699 UR5e Episodes With Tactile Video and Haptic Levels, in FiftyOne
📰

HapTile: 1,699 UR5e Episodes With Tactile Video and Haptic Levels, in FiftyOne

DEV Community: computervision·Harpreet Sahota·8 days ago
#upbndF5V
Reading 0:00
15s threshold

In HapTile, the person teleoperating the robot feels the contact, and the dataset logs what they felt. A UR5e arm is teleoperated through contact-rich tabletop tasks, and the feedback level the operator received through the rig is logged as firm , mild or soft , next to the robot state and the video.

What is in it

HapTile comes from the authors listed on the source release and the paper "HapTile: A Haptic-Informed Vision-Tactile-Language-Action Dataset for Contact-Rich Imitation Learning" ( arXiv:2606.04825 ). The Voxel51 version converts it to multimodal MCAP episodes. It has 1,699 episodes across 38 tasks, 664,045 frames and 12.36 hours.

Each gripper finger carries a vision-based tactile sensor. It films a gel pad printed with a marker grid, so contact shows up as the markers moving.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.