Menu

A dated benchmark of NPOV disputes on English Wikipedia, and what it says about catching bias early
📰

A dated benchmark of NPOV disputes on English Wikipedia, and what it says about catching bias early

Diff·AgarwalMahima·19 days ago
#rX8NceKu
#drift#npov#dispute#templates#article
Reading 0:00
15s threshold

Wikipedia’s neutral point of view (NPOV) is one of its founding principles, and editors enforce it in part with maintenance templates, the {{POV}} banner and its relatives that flag an article (or a section) as disputed. A natural question follows: could a tool watch articles and catch one sliding away from neutrality before an editor has to flag it? That was the premise we set out to test. The answer turned out to be more interesting than a yes or no.

Most of the work was getting the ground truth right. Dating an NPOV dispute is harder than it looks:

Bots backdate templates. About 26% of dated maintenance templates were last touched by a bot stamping them with a month. If you date the dispute by the template alone, you’re measuring the bot’s run, not when a human actually raised the concern.

Edit summaries miss half the story. Searching edit summaries for tag additions recovers only about 53% of the human edits that really added a template.

Controls can be dormant.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.