Menu

1 / 16

Robots Can See. They Still Can't Feel: 8 Tactile LeRobot Datasets in FiftyOne

DEV Community: computervision·Harpreet Sahota·about 2 hours ago
#R4aRpJHT
Reading 0:00
15s threshold

A field guide to touch as a robot-learning modality, plus 8 LeRobot v3.0 datasets that record it (1,679 episodes of gel-sensor video, taxel grids, and fingertip force/torque), loaded into FiftyOne with their exact keys and quirks.

Try tying your shoes with numb fingers. You can watch your hands the whole time and still fumble it, because the information you need lives at the point of contact. Is the lace slipping? Is the knot tight? How hard am I pulling? Your eyes can't answer any of that. Your fingertips answer it constantly, and you never notice.

That's roughly where most robot learning sits today. Vision-language-action models have gotten good at the "where": where's the cup, where's the gripper, where should the arm go next. They're still mostly blind to what's happening at the contact surface.

Tactile sensing fills that gap.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.