Menu

I built an SSTable storage engine
📰

I built an SSTable storage engine

DEV Community: rust·Vamsi·3 days ago
#E38mRNH1
#devtorust#devto#dev#block#index
Reading 0:00
15s threshold

Hello people!

I've been working on a project called Stryx — github , for a couple of weeks. I don't really have a motivation for as to why I built it — I read about "Sorted String Tables" somewhere, found them cool, coincidentally at the same time I'd been itching to build something involving binary formats. So I thought it would be fun, and here we are.

Contents

Part I: Background

What's an SSTable?

Designing the Stryx Table

Part II: The File Format

How Records are Stored

Index

Filter

Footer, and How open() Works

Part III: Reading and Writing

The Whole Flow: get(b"cherry")

Building a Table

Reading Records

Part IV: Behavior, Performance and Getting started

Compression, Concurrency and Caching

Benchmarks

Limitations

Getting Started

If you'd rather see the format before reading about it, I built an interactive explorer that walks through the exact byte layout described below —

→ Explore the Stryx table format

Part I: Background

1.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.