Menu

Built a Self Hosted Web Scraping API
📰

Built a Self Hosted Web Scraping API

#backend#redditbackend#xpath#class#contains
Reading 0:00
15s threshold

I've been building a self-hosted web scraping API that makes automation easy.

Relinos can handle JavaScript and challenging websites , performs browser interactions, and executes multiple scraping requests concurrently.

Key features:

Browser automation: Navigate, click, type, scroll, and interact with websites.

Concurrent execution: Run multiple browser sessions simultaneously.

Structured extraction: Extractions are very easy to define here an extraction for google for example:

​

{ "query": { "$xpath": "//*[@id='ti6dpd']" }, "result_count": { "$xpath": "//div[@class='XhWQv qd6zO ApHyTb']", "$extract": "\\D*(\\d[,\\d]*) .*" }, "ai": { "$xpath": "//*[@class='mZJni Dn7Fzd']", "$format": "md" }, "results": { "$xpath": "//div[contains(@class, 'MjjYud')]", "title": { "$xpath": ".//h3[contains(@class, 'LC20lb MBeuO DKV0Md')]" }, "url": { "$xpath": ".//a[contains(@class, 'zReHs')]/@href" }, "site": { "$xpath": ".//span[contains(@class, 'VuuXrf')]" }, "snippet": { "$xpath": ".//div[contains(@data-snf,…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.