Menu

Baseten's joey-1 makes AI decisions for a penny per million tokens
📰

Baseten's joey-1 makes AI decisions for a penny per million tokens

#thenextweb#joey#baseten#decision#model
Reading 0:00
15s threshold

Baseten released joey-1, a 2B open-weights “ decision model ” that returns an answer and a probability rather than text. It costs $0.01 per million tokens and answers in about 20ms, Baseten says. It joins the larger mammoth-1 and elephant-1 launched last week.

Baseten has released joey-1, a small open AI model that answers yes-or-no and multiple-choice questions instead of writing text, the company said on Thursday . It costs $0.01 per million tokens.

Joey-1 has 2B parameters and joins the larger mammoth-1 and elephant-1, which Baseten’s research lab, Base Labs, released last week. Rather than writing a reply, the models return an answer with a probability score.

That makes them cheaper and faster for jobs such as routing support tickets, spotting spam or blocking harmful prompts. TypeSafe AI’s Jev , launched in September, works the same way.

Baseten says joey-1 answers a typical 2,000-token request in 20 milliseconds, about 2.5 times faster than elephant-1.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.