26.24%
Denominator: 987 conclusive domains. Coverage: 98.70% of the panel.
Provenance
This is why this page exists: the exact run that produced this figure, frozen alongside it rather than left to be inferred later.
| Vintage | 1 |
|---|---|
| Methodology | agents=2;protego=0.6.2 |
| Collector | 08ab15b+2d38a47+7e6d49e+e400bfe+f793c6d |
| Computed at |
Every series value for this period
| Series | Value |
|---|---|
| Effective (named or blanket) | 29.28% |
| Blanket disallow (closed to every crawler) | 5.88% |
| Coverage | 98.70% |
| Unreadable robots.txt | 0.60% |
| Change (week over week) | 1.12% |
| AI2Bot | 6.18% |
| AI2Bot-Dolma | 4.96% |
| Amazonbot | 11.85% |
| Applebot-Extended | 12.87% |
| Brightbot | 3.65% |
| Bytespider | 16.72% |
| CCBot | 18.03% |
| ChatGLM-Spider | 3.14% |
| ChatGPT-User | 11.55% |
| Claude-SearchBot | 9.63% |
| Claude-User | 9.02% |
| Claude-Web | 10.13% |
| ClaudeBot | 17.22% |
| DeepSeekBot | 4.46% |
| Devin | 2.63% |
| Diffbot | 11.65% |
| DuckAssistBot | 7.50% |
| GPTBot | 18.34% |
| Gemini-Deep-Research | 3.24% |
| Google-CloudVertexBot | 7.09% |
| Google-Extended | 15.91% |
| Google-NotebookLM | 2.94% |
| GoogleAgent-Mariner | 2.33% |
| ImagesiftBot | 7.19% |
| MistralAI-User | 5.78% |
| OAI-SearchBot | 10.74% |
| PanguBot | 5.47% |
| Perplexity-User | 8.31% |
| PerplexityBot | 14.59% |
| PhindBot | 2.53% |
| SBIntuitionsBot | 2.94% |
| TavilyBot | 2.43% |
| Timpibot | 8.00% |
| WrtnBot | 2.43% |
| YouBot | 8.61% |
| anthropic-ai | 10.94% |
| cohere-ai | 11.75% |
| cohere-training-data-crawler | 5.78% |
| iaskspider | 2.63% |
| meta-externalagent | 13.88% |
| meta-externalfetcher | 6.99% |
| meta-webindexer | 4.05% |
| omgili | 11.35% |
| omgilibot | 8.21% |
| webzio-extended | 5.98% |
Restatements
This period has never been restated: the value above is the only one ever published for it.
Suggested citation
Agent Accessibility Index, 2026-11-02: 26.24% (vintage 1). https://allanderek.github.io/tallyhouse/agent-accessibility/releases/2026-11-02/index.html
The two ledgers below carry this period's rows among every other period's; anything named for this period alone is listed with them.
Downloads
Every figure published on this site can be re-derived from these files. The two ledgers below are served as the exact bytes committed to the repository, not regenerated.
| File | Rows | Size | Description |
|---|---|---|---|
| Headline ledger | 24 | 3.1 KB | Every headline figure ever published, for both indices, including superseded vintages and the reason each was restated. Served as the exact bytes committed to the repository. |
| Series ledger | 1148 | 158.9 KB | Every sub-series: the per-crawler rates, effective and blanket blocking, coverage, the unreadable share and the like-for-like change. Same vintage rules as the headline ledger, same exact bytes. |
| Panel, 2026-11-02 | 1000 | 17.1 KB | The domains measured in this period, with their Tranco rank. This is the denominator of every figure published for the period. |
| Verdicts, 2026-11-02 | 44415 | 2.1 MB | One row per domain per tracked crawler: the stance that domain's robots.txt takes toward that token. The evidence behind every rate published for the period. |