Menu

What an offline evidence finder guarantees about a quote
📰

What an offline evidence finder guarantees about a quote

DEV Community: opensource·十方空烬 · Ember ☄️·8 days ago
#tExM5wYm
#devtoopensource#devto#dev#quote#start
Reading 0:00
15s threshold

Two questions get run together. Did this sentence appear in my documents? And does this document support the claim? The first is decidable by a string slice, the second is not. Offline Evidence Finder, a static page I built, does only the first: lexical search over an editable English and Chinese collection, returning a source id, the exact quote, and the quote's UTF-16 start and end offsets inside source.text. It does not generate answers or judge whether a passage supports a factual claim.

Live at the Space and the standalone app , fixed commit d309763 . The behavior below is from that commit.

A query that hits without answering

The sample has an unanswerable query, 今天火星咖啡价格 . Of four unanswerable queries it is the only one that returns a hit (1/4), a single character 天 inside the unrelated excerpt router-zh.

Fixed development sample, not a new benchmark. The unanswerable query matches the single character 天 in an unrelated excerpt, score 1.597193.

Returning this hit is correct by design.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.