Menu

Rekognition ProvisionedThroughputExceededException: TPS limits and backoff that holds up
📰

Rekognition ProvisionedThroughputExceededException: TPS limits and backoff that holds up

DEV Community: computervision·Ashish Sikka·16 days ago
#eJY9ugG4
Reading 0:00
15s threshold

TL;DR Rekognition's default quota for IndexFaces , SearchFacesByImage and SearchFaces is 5 transactions per second per account in most regions , and 50 in us-east-1, us-west-2 and eu-west-1. A naive parallel backfill blows through that in under a second and gets ProvisionedThroughputExceededException (or ThrottlingException ). Retries alone don't fix it. Rate-limit on the client to just under the quota, share one limiter across every worker in the account and region, set the SDK to adaptive retry mode, and request a quota increase before a big job, not during it.

The usual story: a face-search feature works fine in development, then someone kicks off a backfill of 200,000 existing photos with a thread pool of 32 workers.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.