Menu

1 / 2

I automated reading 600+ RSS feeds into one daily India news brief

DEV Community·Aman Sachan·6 months ago
#NycROux1
#python#india#automation#feeds#velocity
Reading 0:00
15s threshold

Every morning I used to spend an hour jumping between news sites — NDTV, The Hindu, Economic Times, scrolling through dozens of RSS feeds. Then I built a script to do it for me.

The problem with more sources

More feeds actually made quality worse until I built a velocity scoring system. Without it, breaking stories drowned in noise and structural trends kept resurfacing even after I had already read them.

What I built

600+ RSS feeds, deduplicated, ranked by source authority and story velocity — synthesized into one email delivered at 8:30 AM IST. Politics, economy, tech, environment, markets — all in one readable brief.

The pipeline:

Fetch — parallel HTTP requests to all feeds, 10-second timeout per feed

Deduplicate — simhash-based near-duplicate detection across all sources

Rank — source authority weight × story velocity × recency score

Summarize — Groq AI generates a 3-paragraph situational brief from top stories

Email — formatted HTML email, direct to inbox

The hardest part

The velocity…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.