Menu

Post image 1
Post image 2
Post image 3
Post image 4
Post image 5
Post image 6
Post image 7
Post image 8
Post image 9
Post image 10
Post image 11
Post image 12
Post image 13
Post image 14
Post image 15
Post image 16
Post image 17
Post image 18
1 / 18
123

GitHub - itsthelore/wayfinder-router: Simple CLI tool for deterministic routing of queries between local and hosted LLM models

Hacker News·Hacker News·3 months ago
#pUduG6w3
#github#wayfinder#router#model#gateway#local
Reading 0:00
15s threshold

Deterministic prompt-complexity routing — send each prompt to your local or cloud model, offline, with no model call to decide. Quickstart · Benchmark · How it compares · Explainer · Changelog No model call to decide the route Deterministic and fully offline Calibrate on your own data Bring your own key self-hosted Wayfinder reads the shape of a prompt — its length, headings, lists, and code — plus difficulty cues in the wording, like proofs, math, and hard constraints, and tells you whether to send it to your small local model or your big cloud one. It decides in microseconds, runs offline, and never calls another model to make the call. No API key, no network, no model call to decide. You get a score and a recommendation; what you do with it is up to you. Cheap prompts stay local, hard ones go to the expensive model, and you stop paying frontier prices for "summarize this" and "fix my typo." How it compares Most routers decide by calling a model: a trained classifier, an LLM judge, or a hosted API.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.

Read More