I've been building a self-hosted web scraping API that makes automation easy.
Relinos can handle JavaScript and challenging websites , performs browser interactions, and executes multiple scraping requests concurrently.
Key features:
Browser automation: Navigate, click, type, scroll, and interact with websites.
Concurrent execution: Run multiple browser sessions simultaneously.
Structured extraction: Extractions are very easy to define here an extraction for google for example:
{ "query": { "$xpath": "//*[@id='ti6dpd']" }, "result_count": { "$xpath": "//div[@class='XhWQv qd6zO ApHyTb']", "$extract": "\\D*(\\d[,\\d]*) .*" }, "ai": { "$xpath": "//*[@class='mZJni Dn7Fzd']", "$format": "md" }, "results": { "$xpath": "//div[contains(@class, 'MjjYud')]", "title": { "$xpath": ".//h3[contains(@class, 'LC20lb MBeuO DKV0Md')]" }, "url": { "$xpath": ".//a[contains(@class, 'zReHs')]/@href" }, "site": { "$xpath": ".//span[contains(@class, 'VuuXrf')]" }, "snippet": { "$xpath": ".//div[contains(@data-snf,…