AI can now read a decade of code, tickets and change logs faster than any engineering team ever could. What it still can't do, Forrester analyst Biswajeet Mahapatra argued this week, is tell you why any of it is still there. 'A rule found in code may represent a valid business requirement, an obsolete policy, a workaround for a retired system, or a defect that has persisted unnoticed for years,' the article says. 'Only people can explain why it exists and whether it belongs in the future-state application.'
Why it matters: Mahapatra's argument is aimed at software modernization budgets, and it names a failure mode most of them fund only half of. AI can accelerate behavioral discovery, mapping what a system actually does. But it cannot substitute for intent discovery, interviewing the people who know which of those behaviors are load-bearing and which are debris. 'AI can accelerate each of those activities,' the article says. 'It cannot decide which parts of the past deserve a place in the future.' A company that skips the second kind of discovery doesn't find out until the rule it deleted turns out to have been a regulatory requirement, or the one it kept turns out to have been a workaround nobody still needed.
The stakes when nobody answers it in time: a federal court is already running the experiment. A judge in the Southern District of New York ordered OpenAI in May 2025 to preserve ChatGPT output logs that would otherwise be deleted after 30 days. News publishers led by The New York Times filed a sanctions motion in July 2026 alleging OpenAI kept deleting logs anyway and had, for more than two years, told the court it could not search data it had already built the capability to search. A 20-million-record sample OpenAI did produce came back so heavily redacted the court called it unusable, according to an August 2026 legal analysis. The company's own system did not preserve, in a form anyone could later explain, why it had done what it did.
The government hit the same wall from its own side: the National Archives told federal records officers on August 21 which uses of AI create a record the government is not allowed to simply delete. A records-management critique published nine days later, by Andrew Potter, a records-management writer who publishes as Meta Archivist, argued the memo answers the easy version of Mahapatra's question, custody, and skips the harder one, appraisal: what must survive so an AI-mediated decision can later be checked. NARA's own appraisal policy is unrevised since 2007.