Menu

I got logic's AI Assistant to run locally with Qwen on oMLX

Reddit r/Logic_Studio·u/Plokhi·4 days ago
#yQD6N5cl
#logic#assistant#tokens#apple#qwen
Reading 0:00
15s threshold

I've discovered something interesting while doing this.

Logic's AI Assistant sends Gemini roughly 72K tokens of context per request, including about 32K tokens of Interface API documentation alone.

Instead of sending only the relevant API commands, Apple sends the entire assistant instruction set, regardless of what you're asking it to do.

For my local implementation, I reduced the context to the relevant parts of Logic's API based on the requested operation. For something as simple as creating a new software instrument track, that brought the request down to roughly 3K tokens, and Qwen successfully executed the command through Logic's original Assistant interface.

Local inference took just 2.9 seconds on an M5 Pro.

To clarify, this is a proof of concept, and it still needs apple creator studio subscription because perpetual logic license binary does not have the AI assistant code.

But broadly speaking, Apple's decision to make Logic's AI Assistant cloud-only and subscription-exclusive was a product…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.