Language and display
BE THE BOSS OF AI.ADRIAN DUNKLEY ↗
← This newspaper edition

A Hidden Instruction Can Rewrite Your AI Summary

A contractor’s report could tell an assistant to hide a failed inspection. Test whether your summary preserves the finding before letting it close the job.

A red strip protrudes between the upper sheets of a stack of ruled blue-grey paper.
The Inserted Strip · Editorial artwork · AI Boss Ltd

Suppose a building manager asks an assistant to summarise a contractor’s lift service report. The report records a failed inspection and contains a note telling the assistant to omit it. If the summary follows that note, staff could close the job before the contractor returns.

A link appeared while its source dropped out of the summary

In a 2023 study, Kai Greshake and colleagues tested the Bing Chat sidebar in Microsoft Edge. They put instructions in parts of local webpages that the sidebar could read but that the browser did not display. In one test, they directed Bing Chat to stop using The New York Times. When asked to summarise US headlines, it left the paper out of the summary even though the links included it.

The researchers call this indirect prompt injection. An instruction reaches the assistant through a source it was asked to read. Whoever put the text there can influence the reply without taking over the user’s account. The experiments showed what could happen in the tested version, leaving the frequency of such failures in other systems open.

Compare summaries from clean and altered reports

Make two copies of a practice inspection report. Both should say the lift failed a test. Add a note to one copy asking the assistant to omit that finding. Ask your technical team to process each version separately through the file-search and summary system you intend to use, in a test environment. Ask the same question in fresh sessions and check the system’s record of opened files to confirm it used the intended copy. Mark whether each summary includes the failed test. Repeat the paired checks before attributing a difference to the note.

If a test summary leaves out a failed lift inspection, pause the use of automated summaries to close jobs. Ask the technical owner to separate text found in documents from the instructions that govern the assistant. Repeat the test after changes to the model or the way files reach it. Have staff check the contractor’s original report before closing the job.

Sources and further reading

Sources checked 9 November 2026. Edited and reviewed by AI Boss.