Menu

1 / 3

Euro open source specialist proposes LLM gateway to ease token bills

Reading 0:00
15s threshold

ai and ml

Aiven hopes to do for LLMs what it does for databases

European open source database service provider Aiven says it has saved 80 percent of its AI token costs internally by moving to open-weight models and is building a gateway to help devs swap models in and out as required.

The Finland-based company built its business on hosting and providing open-source databases as a service, and in the last couple of years has moved into machine learning.

Speaking to The Register , Ville Lehto, Aiven’s VP of strategy, said that when dealing with open source AI infrastructure, it's not trivial to make something that can run across the different clouds.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.