Company documentation has a second audience, and on one platform it already sends more traffic than people do. This week researchers published a framework for discussing the quality of what those software readers are handed, and research libraries started flowing into the assistants employees already use.
In August, AI agents made 257 million requests to documentation hosted by Mintlify, a documentation software company, against 131 million page loads by people, according to its State of Knowledge report published last week. Agents were also directed to update those documents about 367,000 times between February and August. (Mintlify, Sep 16)
What's new: Until now, a company wrote its documentation for people, and a stale page misled whoever happened to read it. With agents now sending more traffic to Mintlify-hosted docs than people do, a wrong page gets repeated to everyone downstream, and only 7% of the 329 respondents Mintlify surveyed said all of their company's knowledge surfaces are readable by agents. The question moves from whether a company has written its knowledge down to whether that writing is accurate, current and cleared for the software reading it.
The big picture: Researchers from DX, an Atlassian subsidiary, with GitHub, Google, Capital One and the University of Victoria, published a framework in ACM Queue called CAFE(S) that gives teams a shared vocabulary for five dimensions of the context handed to AI tools: clarity, actionability, fidelity, efficiency and, set apart, security. The authors describe it as a way to discuss and evaluate context, not a measurement system. Brian Houck, a distinguished scientist at DX and co-author, said AI 'dramatically increases the cost of poor knowledge management. When agents receive poor context, they are forced to guess.' (ACM Queue release, Sep 24)
Between the lines: LinkedIn already keeps its procedures in a form its coding agents can read. Ajay Prakash, a LinkedIn software engineer, described a shared context layer that serves about 8,000 daily users and more than 600 playbooks of how the company does things; LinkedIn reports a 20% productivity gain. (InfoQ, Sep 19)
The opening: Research a company already paid for is starting to reach everyday AI tools. Stravito, a company that stores consumer research for its clients, launched a connector that lets ChatGPT, Claude and Copilot answer from that research with sources cited and each user's existing permissions enforced. Its chief executive, Thor Olof Philogene, said 'The most valuable consumer research is worthless if it never actually guides real business decisions.' (PR Newswire, Sep 24) Panopto, a video platform company, did the same for recorded video, citing research in which 68% of learning and training leaders reported that most of their recorded video training is not searchable. (PR Newswire, Sep 23)
Yes, but: A map of company knowledge built once goes stale. Andi Gutmans, who runs Google Cloud's data business, said 'Anyone who says, "I have a Knowledge Graph today" is trivializing the problem.' (diginomica, Sep 23)