On October 29, real-time mode went generally available in Lakeflow pipelines, on classic and serverless compute. The number in the docs is the one everybody quoted: end to end latency as low as five milliseconds.
Five milliseconds, in Spark. That is a genuine piece of engineering, and it closes a gap people have been complaining about ever since Flink started winning the "but we actually need low latency" arguments.
Then I read the rest of the page. Specifically the part that never makes it into a keynote slide: the list of things real-time mode does not support. And that list tells you far more about your architecture than the latency number does.
Here is the short version, and it is the sentence that should make you sit up:
Delta is not supported as a source or as a sink in real-time mode.
Read it again if you run a medallion architecture.
What actually changed under the hood
Micro-batch has always worked the same way.…