Evidence and retrieval
AI Found the Right Topic. Did It Find the Answer?
A volunteer list cannot tell you who is staffing an entrance. Before acting on an AI search, check that its source answers your exact question.

In a 2018 study, Pranav Rajpurkar, Robin Jia and Percy Liang added 53,775 unanswerable questions to a reading test. The questions matched the topic of a Wikipedia paragraph and the paragraph contained something that looked like an answer. One question asked for a sea-level projection in the Fourth Assessment Report, while the passage supplied the Third Assessment Report’s figure.
The test asked whether a system could answer from the supplied paragraph or recognise that the paragraph did not support an answer. An assistant searching your files faces an extra problem: it must first find the document that could answer the question. A match on names or keywords is not enough.


