Standardizing AI Knowledge with Google's OKF
AI LABSgo watch the original →
the gist
Google's Open Knowledge Format (OKF) standardizes knowledge bases using the LLM Wiki pattern, utilizing index.md files and YAML front matter to reduce token usage and improve agentic retrieval accuracy.
The Breakthrough
Google introduced the Open Knowledge Format (OKF), a standardized structure for organizing knowledge bases that enables AI agents to navigate file systems efficiently by using index files and metadata rather than relying on keyword-based vector search.
What Actually Worked
- Adopted the LLM Wiki pattern: Replaced traditional RAG-based vector databases with a structured markdown file system, allowing agents to gather context incrementally.
- Implemented index.md files: Created an
index.mdat the root and within every subfolder to provide the agent with a map of available content before it attempts to open specific files. - Applied YAML front matter: Added a standardized YAML block to the top of every markdown file to describe the file's contents, enabling the agent to load only necessary metadata to determine relevance.
- Enforced minimalism: Restricted each concept file to represent exactly one topic, preventing the agent from loading irrelevant information when searching for specific data.
- Updated claude.md instructions: Explicitly defined the OKF navigation logic within the
claude.mdsystem prompt, which forced the agent to traverse the index structure instead of falling back to default keyword matching.
Context
Developers often struggle with scaling "second brain" systems because agents lack a standardized way to navigate deeply nested directories. Traditional RAG approaches rebuild context from scratch, leading to high token consumption and frequent retrieval errors. By adopting OKF, teams can package knowledge into portable bundles that are readable by both humans and LLMs, ensuring that agents can reliably locate information without duplicating files or guessing folder structures.
Content References
- tool: Mobbin, mentioned as a sponsor and MCP server provider.
- other: LLM Wiki pattern, authored by Andrej Karpathy, cited as the foundational concept for OKF.