#+HashtagPLUS
In

Menu

MU

Mushfiq Rahman

Author Profile

Claim This Author Profile

Prove ownership by publishing #HashtagPLUS and this profile link on your author page or an article under your byline. A moderator or admin will review the request before it merges into your real HashtagPLUS username.

Sign In To Claim
0 karma0 postsjoined 4 months ago

Building a fast LLM gateway in Go: Lua + pgvector

🌐 dev.toSource

How llm0 gets to 3 ms p50 cache-hit latency on a 4 vCPU droplet — three Redis Lua scripts, a two-tier cache, and pgvector instead of a separate vector DB.

#dev#redis#fullscreen#cache#gateway#article#ama#englishlanguage
4 months ago