Introduction

Aurora PostgreSQL has a built-in feature that allows direct data exchange with S3. This capability enables you to import data directly from S3 to PostgreSQL without going through your application layer , which was previously the standard approach.

This approach offers several advantages:

No need to handle files on the application side

No concerns about application disk space

Simpler implementation

In this article, I'll demonstrate this feature and compare it with traditional import methods.

For more details about this feature, please refer to the AWS documentation .

Test Environment

AWS Tokyo Region

Aurora PostgreSQL 17.4 (db.t3.medium)

large_test_data.csv (10 million rows test data)

test_table (table for data storage)

Importing Files from S3

First, install the extension for S3 integration:

CREATE EXTENSION IF NOT EXISTS aws_s3 CASCADE ;

Enter fullscreen mode

Exit fullscreen mode

Import the file from S3:

postgres => SELECT aws_s3 .…