Menu

Building an End-to-End Spatial Data Pipeline with AWS S3 Express & Athena Iceberg
📰

Building an End-to-End Spatial Data Pipeline with AWS S3 Express & Athena Iceberg

DEV Community: aws·Jayesh Khade·10 days ago
#DVmRmQk9
#devtoaws#devto#dev#amazon#athena
Reading 0:00
15s threshold

Data is far more powerful when you can see and interact with it on a map.

I built Cary EV Charging Explorer —a spatial analytics pipeline and interactive map application that ingests over 20,000 public EV charging session records from the Town of Cary, NC. The architecture processes raw JSON records through a serverless AWS ETL pipeline and renders them on a dynamic browser interface.

Here is a full breakdown of how the data pipeline and frontend visualization fit together.

🏗️ AWS Pipeline Architecture

Stage 1 (Raw Dataset): Municipal JSON records ingested into AWS.

Stage 2 (Staging): Amazon S3 Express One Zone for low-latency directory storage.

Stage 3 (ETL & Geocoding): AWS Lambda + Amazon Location Service for parsing and address resolution.

Stage 4 (Processed Storage): Amazon S3 Standard for clean CSV data storage.

Stage 5 (Analytics Catalog): AWS Glue Data Catalog + Amazon Athena running Apache Iceberg tables.

Stage 6 (Frontend Visualization): Leaflet.js + Esri Basemaps for interactive web map…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.