Menu

1 / 2

PageSift 1.2: ITNA, an access-barrier recovery engine — plus the 1.1 roundup

DEV Community: rust·ゴエンチョウ·9 days ago
#8zc9YniQ
#devtorust#devto#dev#pagesift#github
Reading 0:00
15s threshold

PageSift started as a Rust crawler chasing extreme performance. It has since grown into a web content engine — web scraping, document parsing, structured extraction, and an AI-agent surface — and 1.2 adds one more engine to it.

GitHub: https://github.com/YOLOW92/pagesift

1.2: ITNA, an access-barrier recovery engine

When an HTTP fetch gets blocked, it decides intelligently whether to escalate to a browser retry

TLS/HTTP2 browser fingerprinting over HTTP, HTTPS, and SOCKS5 proxies

A session identity pool: cookies, egress, and fingerprint managed together, isolated per user

Safe HTTP → browser handoff of session state

Tuned browser automation markers, with waiting for non-interactive JS challenges

A shared request budget that caps retries, timeouts, and resource use

ITNA is off by default and enabled on demand.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.