CLI 0.1.0-alpha.8 replaces the growing single-list discovery index with automatically split topic indexes. Adding pages no longer requires trimming unrelated summaries to keep the entry index small.
Follow a topic to a page
Start with /llms.min.txt. Small sites still list pages directly. Larger sites group pages by publication and primary taxonomy area, falling back to page type when no area is declared. Follow a matching topic or title range until you reach the page you need.
Every compact index is limited to 2,000 cl100k_base tokens. Growing topic and navigation-section indexes split again automatically. The limit applies to each index response, not the total cost of every reading task.
Keep complete discovery
All published pages remain reachable, including pages outside navigation. Standalone-section links retain their sizes and full-page fallbacks. Draft pages stay excluded. /llms.txt remains the complete catalog; agents do not need to download it before choosing a topic.
Compatibility: Consumers must follow topic-index links when present instead of assuming every page appears directly in /llms.min.txt. An individual title or summary that cannot fit within the index limit produces an explicit build error.
Validation
Regression checks cover growth from 160 to 1,600 pages, one large topic, hundreds of topics, mounted sites, navigation scope, and complete page and section coverage. All 728 framework tests and five packaged skill checks passed.
Read Agent-friendly documentation for the discovery workflow. Package publication and documentation-site deployment remain separate actions.