Menu

PageSift 1.0: the Rust web content engine is feature-complete
πŸ“°

PageSift 1.0: the Rust web content engine is feature-complete

DEV Community: rust·ゴエンチョウ·12 days ago
#Uv9jTSaG
#devtorust#devto#dev#pagesift#release
Reading 0:00
15s threshold

Fifteen days, twenty-five releases. PageSift went public as 0.20 on October 20; today it ships 1.0 .

PageSift is a web content engine written in Rust. It turns URLs, PDFs and Office files into clean Markdown and structured data for AI agents and LLM pipelines β€” one self-hosted binary with a Firecrawl-compatible HTTP API, a Jina Reader-compatible endpoint (including /s/ ), an MCP server, and Python / Node.js / Rust SDKs.

1.0 is not a speed release β€” performance landed with the 0.9 architecture rebuild. 1.0 is feature completion .

What 1.0 adds

OCR, built from scratch. Scanned PDFs were PageSift's documented weak spot. 1.0 ships its own OCR pipeline β€” text detection, recognition, formula recognition (LaTeX out), layout analysis β€” running on a self-written inference runtime (safetensors executor; no ONNX Runtime) and a self-written CUDA GPU layer. Models are open weights, downloaded on first use, off by default.…

Continue reading β€” create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.