Menu

1 / 2

xrun: smoke-test on a free Kaggle GPU, train on vast.ai, let the agent read the metrics

DEV Community: rust·Ilya Kalinin·14 days ago
#zwTraeNI
#devtorust#devto#dev#xrun#kaggle
Reading 0:00
15s threshold

I train 3D computer vision models, and classical ones at hackathons. For a long time every run came with the same chores: vastai create instance , scp the data up, start the script, check on it, scp the checkpoint back, remember to destroy the instance. Kaggle had its own version of that with kaggle kernels push . I wanted to hand the whole loop to an agent: launch on whichever platform fits, smoke-test on a free Kaggle GPU before paying for the real training, and collect metrics the same way everywhere, so the agent can read them and decide what to do next.

That became xrun, a Rust CLI with a Python Textual TUI on top. One YAML manifest describes a run: where the GPU comes from, what to upload, what to run and what to bring back. xrun rents the instance, uploads the data, starts training, follows stages and metrics, pulls the checkpoints and destroys the instance when it's over.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.