Menu

I use an LLM to check fake citations, but I don't let it decide anything
📰

I use an LLM to check fake citations, but I don't let it decide anything

DEV Community: java·milo4210·15 days ago
#He8ULIXF
#devtojava#devto#dev#search#first
Reading 0:00
15s threshold

I'm building CiteWise, a tool that checks whether an academic reference points to a real paper. You paste a citation, it looks the work up in Crossref, DataCite, OpenAlex, Semantic Scholar, PubMed and arXiv, and shows you which fields match and which don't.

The obvious way to build this in 2026 is "send the reference to an LLM and ask if it's real". I tried a version of that early on and it's a bad idea for the same reason people need this tool in the first place: LLMs are very good at producing things that look right.

So the LLM is in the pipeline, but it isn't allowed to decide anything.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.