Agent Accessibility Index — 2026-09-28

A permanent, citable page for this period's figure.

Agent Accessibility Index · All releases

24.10%

Denominator: 996 conclusive domains. Coverage: 99.60% of the panel.

Provenance

This is why this page exists: the exact run that produced this figure, frozen alongside it rather than left to be inferred later.

Vintage1
Methodologyagents=2;protego=0.6.2
Collector09f8f02+4de4916
Computed at

Every series value for this period

SeriesValue
Effective (named or blanket)27.11%
Blanket disallow (closed to every crawler)5.82%
Coverage99.60%
Unreadable robots.txt0.20%
AI2Bot5.62%
AI2Bot-Dolma4.62%
Amazonbot9.54%
Applebot-Extended10.74%
Brightbot3.41%
Bytespider14.26%
CCBot16.16%
ChatGLM-Spider3.01%
ChatGPT-User11.14%
Claude-SearchBot8.53%
Claude-User8.03%
Claude-Web8.03%
ClaudeBot14.86%
DeepSeekBot4.22%
Devin2.51%
Diffbot9.54%
DuckAssistBot6.73%
GPTBot16.27%
Gemini-Deep-Research3.01%
Google-CloudVertexBot5.02%
Google-Extended13.96%
Google-NotebookLM2.61%
GoogleAgent-Mariner2.21%
ImagesiftBot6.83%
MistralAI-User5.22%
OAI-SearchBot9.94%
PanguBot4.92%
Perplexity-User7.33%
PerplexityBot14.06%
PhindBot2.31%
SBIntuitionsBot2.81%
TavilyBot2.21%
Timpibot7.53%
WrtnBot2.21%
YouBot7.93%
anthropic-ai9.14%
cohere-ai9.64%
cohere-training-data-crawler5.02%
iaskspider2.51%
meta-externalagent11.55%
meta-externalfetcher6.53%
meta-webindexer3.21%
omgili9.34%
omgilibot7.93%
webzio-extended5.72%

Restatements

This period has never been restated: the value above is the only one ever published for it.

Suggested citation

Agent Accessibility Index, 2026-09-28: 24.10% (vintage 1). https://allanderek.github.io/tallyhouse/agent-accessibility/releases/2026-09-28/index.html

The two ledgers below carry this period's rows among every other period's; anything named for this period alone is listed with them.

Downloads

Every figure published on this site can be re-derived from these files. The two ledgers below are served as the exact bytes committed to the repository, not regenerated.

FileRowsSizeDescription
Headline ledger202.6 KBEvery headline figure ever published, for both indices, including superseded vintages and the reason each was restated. Served as the exact bytes committed to the repository.
Series ledger948130.2 KBEvery sub-series: the per-crawler rates, effective and blanket blocking, coverage, the unreadable share and the like-for-like change. Same vintage rules as the headline ledger, same exact bytes.