#Cache

Could we get more cache space with the same hardware? We prototyped compression inside Cloudflare's cache to find out.

Run the full 2.78-trillion-parameter Kimi K3 model beyond available RAM by streaming activated weights directly from NVMe. A dependency-free, embeddable C inference engine. - sqliteai/waste

I was recently trying to validate some performance improvements related to lld at $DAYJOB and it was a little frustrating to see the improvements in our benchmarks but not in the live-production dashboards.

KO | EN As technology has advanced, processor speed has risen quickly, but memory speed hasn’t kept up. No matter how fast a processor is, if memory responds slowly the whole system ends up slow. The device that addresses this is the cache.…

It’s the same cache amount and core count as Genoa-X, but with far faster cores.

We measured what Claude Code and OpenCode spend before reading your prompt, then added instruction files, MCP servers and subagents to the bill.

We hold frontier models to a high bar, and for four months nothing beat Claude Opus. GPT-5.6 did. Here's the migration guide we wish we'd had.

If you happen to find yourself in a sysadmin position, or a position where you just so happen to maintain someone’s infrastructure, chances are that at some point in time the topic “we need a cache” comes up.

A Proof-of-Concept using Cache Smuggling + Exif data to passively download a second stage payload - signalblur/exifsmugglingpoc

A deep dive into memory fragmentation, paged memory management, and why PagedAttention can deliver up...

KVarN is a native vLLM KV-cache quantization backend for your agents: 3-5x more context, throughput above FP16, and FP16-level accuracy. Calibration-free, one flag. - huawei-csl/KVarN

Building a Resilient Frontend Data Layer with Suspense, Caching, and Optimistic UI ...

Intel’s dense Xeon 6+ design marks the first time 18A is being deployed in the data center.

I once worked on a frontend app where total loading time went from 15 seconds to 1.1 seconds. The...

Exploring Backend Development with Rust and Go: Insights from Web Developer Travis McCracken As a...

Modern LLM serving is hard to tune because each deployment is a stack of interacting choices: model backend, tensor-parallel shape, prefill/decode split…

How to design systems for your actual scale — a practical system design tutorial ...