#Kafka

Problem Adding large language model capabilities to an established multi-tenant SaaS...

A quick, concise visual guide to Kafka's core architecture: Brokers, Partitions, ISR replication, Offsets, and Zero-Copy.

Our Kafka transactions were working perfectly. The payment provider was processing requests correctly. Somehow, we still managed to charge…

Part 2 of CDC in Production: prepare Postgres, configure the Debezium connector line by line, and see how the snapshot hands off to streaming with no gap.

Every Kafka tutorial says the same thing: messages in a partition are ordered. Every production...

Quick Answer Explore a production‑grade microservices-based photo feed architecture that...

As our system moved from a monolith towards microservices, services needed a way to communicate...

Decouple CI webhook ingestion with Kafka: stateless receivers, per-ref partition keys, idempotent consumers, dead-letter queues, and production lessons.

I’ve always found Kafka to be one of the most interesting distributed systems to study because the...

A practical engineering guide to Redis Streams vs Apache Kafka: Consumer Groups, Ack Semantics, and Offset Storage. Learn core mechanics, production tradeoffs, and best practices.

If you're learning data engineering, you'll probably meet Apache Kafka very early. You'll see it in...

Building a Resilient Event-Driven Architecture with Apache Kafka and Stream Processing ...

Introduction Apache Kafka and Apache Cassandra pair effectively because they complement...

I Built a Production-Style RAG Backend — Focused on What Happens When Things Break Most...

The 2026 Context: From "Testing" to "Triage" In my previous post, I discussed why AV1 is no longer...

A while ago, I worked on a project for a North America-based logistics and freight operations company...

Not only did Kafka create a new language to describe the world, he also invented a new punctuation: he put question marks where there had never been any before. “Why” is the word that k…

Debezium Won't Start? The Whitespace Bug That Stumped Our Client We recently got a support...

Building a data reconciliation system from scratch requires decisions at several layers: how to...

From Dev.to - opensource: Kafka Under the Hood: A Visual Guide to KRaft and Internal Architecture (2026)