Menu

Post image 1
Post image 2
Post image 3
Post image 4
Post image 5
Post image 6
Post image 7
Post image 8
Post image 9
Post image 10
Post image 11
Post image 12
Post image 13
Post image 14
Post image 15
Post image 16
Post image 17
Post image 18
Post image 19
Post image 20
Post image 21
Post image 22
Post image 23
Post image 24
Post image 25
Post image 26
Post image 27
Post image 28
Post image 29
Post image 30
Post image 31
Post image 32
Post image 33
Post image 34
Post image 35
Post image 36
Post image 37
Post image 38
Post image 39
Post image 40
Post image 41
Post image 42
Post image 43
Post image 44
Post image 45
Post image 46
Post image 47
Post image 48
Post image 49
Post image 50
Post image 51
1 / 51
0

A General Goal-Conditioned Minecraft Model - Pantograph

Hacker News·2 months ago
#wmGEaydB
Reading 0:00
15s threshold

At Pantograph, we're working on training fully general robotics models that can act autonomously for hours at a time. Especially in robotics, it's difficult to get diverse data at scale. Learning to act from internet video data could allow models to scale with compute, rather than being limited by small action datasets. In this work, we develop a simple method for learning goal-directed behavior through pretraining on internet-scale video. Usually, goal-directedness is taught in a post-training phase, which limits the extent to which it can generalize. Here, we learn goal-directedness during pretraining on internet-scale video, which greatly improves the models' ability to achieve complex goals. Video games are a useful testing ground for robotics. We're starting with Minecraft because it's open-ended, and supports commanding diverse, long-horizon goals.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.

Read More