Menu

Building a Letta Code custom provider: static first, live second
📰

Building a Letta Code custom provider: static first, live second

DEV Community: typescript·Dawncoral·about 20 hours ago
#3hraE5xF
#devtotypescript#devto#dev#model#provider
Reading 0:00
15s threshold

Fresh sessions in Letta Code failed on their first message with Unknown model "wallaby/kimi-k3" . Opening /model once fixed it. That symptom sent us down the wrong path for two releases, and the real cause had been public in the issue tracker for ten days.

Letta Code is the CLI for stateful agents from the Letta project (formerly MemGPT). A provider mod teaches its local runtime about a new model endpoint.

This is the build log behind wallaby-letta-provider 0.1.2, a small npm package that puts our gateway inside Letta Code's /connect flow. It is also the checklist we would hand to anyone shipping a provider mod: three lessons, one wrong turn, and a live catalog that now updates without a release.

What the package gives a Letta Code user today:

kimi-k3 with a 1M context window, image input, and effort levels from off to max

A live catalog: a new model id appears in /model once it is listed and priced, without another npm release

Costs read from the same public price file the gateway bills against

Why a…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.