Introduction

Hi, this is futahashi from Japan. In this post, I'd like to share my experience trying out Datadog Archive Search. Logs are something everyone uses on a daily basis, but they are also notoriously hard to design well and easy to overspend on, so I'm sure many of you will appreciate this update as much as I do.

A small note before we begin : I'm not a native English speaker, so please bear with any awkward phrasing. I've done my best to keep the technical content accurate — feedback and corrections are very welcome.

This article focuses on AWS only.

TL;DR

You can stream-query archived logs immediately, without Rehydration

You can also run a Rehydration on top if you need to

You can narrow the scan by time or attribute

Pricing is based on the scanned data size

Each search keeps up to 100k events of search results for 24 hours, for free

Without Rehydration:

No advanced analysis such as aggregations or visualizations

No references from other features (Dashboard / Notebook / Log Explorer,…