Menu

#Chunks

57 posts

Feed·
20 of 57 posts
0Read More

[RAG / pgvector] How do you handle vector chunks when a document is soft-deleted?

#database#redditdatabase#chunks#vector#delete

Hi everyone, I'm building an ingestion pipeline for a RAG system. My tech stack relies on PostgreSQL for relational data and pgvectore for storing text chunks and performing similarity searches.…

15s
Whisper Hallucinates on Silence: 61 of 700 Pauses Became 'Thank You'
📰
0Read More

Whisper Hallucinates on Silence: 61 of 700 Pauses Became 'Thank You'

DEV Community: python·jidonglab·6 days ago
#O2E3pqjg
#devtopython#devto#dev#whisper#chunks

Whisper hallucinates on silence: 61 of 700 silent pauses came back as text. Why no_speech_threshold didn't catch it, and the 3 fixes that did.

15s
Half the JavaScript on our static FAQ page never runs, and 98 KB of it is the framework's server code
📰
0Read More

Half the JavaScript on our static FAQ page never runs, and 98 KB of it is the framework's server code

DEV Community: javascript·Daniel Pertu·8 days ago
#H051p1T1
#devtojavascript#devto#dev#cent#coverage

V8 precise coverage over 18 chunks on a prerendered marketing page. 1,131,567 characters shipped, about 49 per cent executed, 2,140 of 4,656 functions called, and the two least-used chunks are full of strings like prerender-ppr and generate-static-params.

15s
Going from top-5 to top-20 retrieval makes every RAG answer 2.7x more expensive
📰
0Read More

Going from top-5 to top-20 retrieval makes every RAG answer 2.7x more expensive

DEV Community: beginners·Andrey Altrouter·10 days ago
#WQN0wiUs
#devtobeginners#devto#dev#answer#chunks

In a RAG bot, the question is a fraction of a percent of the bill. Most of it is the chunks you paste in to answer it. At 500 tokens a chunk, top_k = 20 instead of 5 makes every answer 2.7 to 2.8 times more expensive on any of five popular models.…

15s
Turn PDFs and Word files into Markdown, table rows and RAG chunks, priced per page
📰
0Read More

Turn PDFs and Word files into Markdown, table rows and RAG chunks, priced per page

DEV Community: ai·Aurelix Solutions·10 days ago
#N1WKIjrq
#devtoai#devto#dev#pages#chunks

Convert PDF and DOCX links into per-page Markdown with tables as JSON rows and ready-made chunks with page citations, OCR for scans, and how the PDF extractors on the Apify Store compare per page and per file.

15s
Turn PDFs into Markdown chunks for RAG in 10 lines of Python (with OCR for scanned pages)
📰
0Read More

Turn PDFs into Markdown chunks for RAG in 10 lines of Python (with OCR for scanned pages)

DEV Community: python·Caspian Data·16 days ago
#lAxQxnE3
#devtopython#devto#dev#pages#chunks

If you have ever fed PDFs into an LLM pipeline, you know the problem: pdftotext gives you one long...

15s
RAG in plain English: how my college helpdesk answers from documents only
📰
0Read More

RAG in plain English: how my college helpdesk answers from documents only

DEV Community: node·SURAJ NANDAN·19 days ago
#JYBDjKzl
#devtonodejs#devto#dev#chunk#model

Internal GPT is a helpdesk I built for college environments. Administrators upload institutional...

15s
Cooked soya chunks vs cooked chicken breast: Which packs more protein per 100 grams?
🖼️
0Read More

Cooked soya chunks vs cooked chicken breast: Which packs more protein per 100 grams?

The Indian Express·22 days ago
#8K2HbEY8
#indianexpress#protein#grams#soya#chunks

Soya chunks are a popular vegetarian alternative to chicken, but which provides more protein? Dietician Garima Goyal compares their protein content in raw and cooked forms and explains their nutritional benefits.

15s
What Actually Happens When You Build a Production RAG Chatbot on Amazon Bedrock
📰
0Read More

What Actually Happens When You Build a Production RAG Chatbot on Amazon Bedrock

DEV Community: aws·Le Trung Hieu·24 days ago
#QWLzrMpZ
#devtoaws#devto#dev#chunks#enter

How we built a document Q&A system with NestJS, PostgreSQL, pgvector, Hybrid Search (RRF), Prompt...

15s
Lost in the Middle: Find Your LLM's Context Dead Zone and Fix It Before the Call
📰
0Read More

Lost in the Middle: Find Your LLM's Context Dead Zone and Fix It Before the Call

DEV Community: machinelearning·Orvi Das·24 days ago
#PzaP9ydC

In Lost in the Middle, GPT-3.5 did worse with 20 docs than with none when the answer sat mid-prompt. Measure your dead zone, reorder chunks, gate tokens.

15s
Lazy-loading reasoning Documedic clinical decision support
📰
0Read More

Lazy-loading reasoning Documedic clinical decision support

DEV Community: react·Subhendu Das·24 days ago
#hxJVJRdi
#devtoreact#devto#dev#chunk#reasoning

Explore how Documedic’s lazy‑loading of reasoning chunks speeds up clinical decision support, reduces bandwidth, and improves the user experience for…

15s
Building a RAG Pipeline with LLM Embeddings and Scikit-learn - MachineLearningMastery.com
🖼️
0Read More

Building a RAG Pipeline with LLM Embeddings and Scikit-learn - MachineLearningMastery.com

In this article, you will learn how to build a lightweight, end-to-end RAG pipeline using scikit-learn for vector retrieval and open-source models for embeddings and text generation, without the use of paid APIs or heavyweight frameworks.

15s