Menu

1 / 2

How a Simple Warehouse Resize Saved Us 11% in Daily Credits While Boosting Performance

DEV Community·Krishna Tangudu·6 months ago
#KrEYiP5p
Reading 0:00
15s threshold

Our team hit a familiar Snowflake paradox: slower ETL runs arrived at the same time as FinOps alerts about rising credits.

The warehouse in question was WH_ETL_BRONZE_01 , a multi-cluster warehouse dedicated to Bronze layer ingestion and merge workloads. What looked like a simple cost problem turned out to be a workload-isolation and concurrency problem.

The Problem

We started with this setup:

ALTER WAREHOUSE WH_ETL_BRONZE_01 SET WAREHOUSE_SIZE = 'XSMALL' , MAX_CLUSTER_COUNT = 10 , MIN_CLUSTER_COUNT = 1 , SCALING_POLICY = 'STANDARD' , AUTO_SUSPEND = 60 , MAX_CONCURRENCY_LEVEL = 8 ; -- default behavior

Enter fullscreen mode

Exit fullscreen mode

And we saw both of these at once:

Higher queue times ( queued_overload_time )

Higher daily credits

The critical issue was workload mix. Long-running MERGE statements (30 to 60 minutes) were running alongside tiny queries.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.