iaskspider

iAsk โ€” Search

All crawlers ยท Agent Accessibility Index

Purpose: Search. Indexes pages so an answer engine can retrieve and cite them.

Indexes pages for the iAsk answer engine.

2.51%

of the panel names this token in robots.txt and disallows it, for the week of 2026-10-05.

How sites treat this token

StanceDomainsWhat it means
FullBlock25Every path is disallowed for this token.
PartialBlock0Some paths are disallowed for this token; others are not.
Allowed0The token is named and explicitly allowed.
Unmentioned970The file never names this token. This is not consent โ€” the site may still close it off with a blanket rule for every crawler.

iaskspider's three-year history

iaskspider over time, 16 quarterly periods from 2023-01 to 2026-08.iaskspider rose from 0.00% at 2023-01 to 3.45% at 2026-08.0%1%2%3%4%2023-012023-092024-052025-012025-102026-083.45%

A site in the historical panel first named and disallowed this token in 2025-10; its most recent reading is 3.45%.

Note: this chart reads Common Crawl's own 611-domain historical panel, not the panel behind the stance table above โ€” a different population from the live index panel, so levels are not comparable between the two indices.