Menu

1 / 2

Transform Logs with Vector By DataDog

DEV Community: cloud·William Kwabena Akoto·14 days ago
#d7jPnYQU
#devtocloud#devto#dev#vector#logs
Reading 0:00
15s threshold

Introduction

Managed platforms make deployment easy, but they decide where your logs can go. If the destination you need is a custom HTTP endpoint, that decision can leave you stuck.

This article shows how to get past it with Vector , an open-source data pipeline maintained by Datadog. The example is DigitalOcean App Platform forwarding its logs to a custom HTTP endpoint, App Platform sends logs the way it would to Datadog, Vector reshapes them, and your endpoint receives them in the format it expects.

The same idea applies well beyond App Platform. Wherever a managed service exports logs in a fixed format or to a fixed set of destinations, Vector can sit in the middle and reshape them:

AWS: CloudWatch Logs can stream through Amazon Data Firehose, which delivers to an HTTP endpoint in its own wrapper format.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.