Menu

Scraping 50k Spanish Public Tenders (PLACSP) into Clean JSON in <26s with Apify
📰

Scraping 50k Spanish Public Tenders (PLACSP) into Clean JSON in <26s with Apify

DEV Community: api·Pablo Martinez·17 days ago
#uKHU2frN
#devtoapi#devto#dev#govtech#opendata
Reading 0:00
15s threshold

Scraping 50k Spanish Public Tenders (PLACSP) into Clean JSON in <26s with Apify

Public procurement in Spain represents over €100 billion annually . The Spanish central government, 17 autonomous regions, and thousands of municipal councils publish every tender, contract award, and minor RFP on the official procurement platform: PLACSP ( Plataforma de Contratación del Sector Público ) .

Under Spanish Law 37/2007 (Reutilización de la Información del Sector Público / RISP), this data is legally public and open. However, if you have ever tried to consume PLACSP data programmatically, you already know the engineering horror behind the curtain.

In this technical showcase, we break down why traditional web scraping fails against PLACSP, how we engineered an Apify Actor that bypasses slow government XML feeds in sub-26 seconds using a dual-tier cache strategy, and how you can query active tenders in Python or cURL for $0.02 per result.

The Engineering Problem: Why Scraping PLACSP is a Nightmare

PLACSP provides…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.