ImagesiftBot

Hive — Images

All crawlers · Agent Accessibility Index

Purpose: Images. Crawls images rather than text.

Crawls for images rather than text, building image datasets. The only agent in the panel that no site blocked partially in this period — sites that block it block it outright, fitting a crawler whose value is the whole image corpus rather than particular pages.

6.83%

of the panel names this token in robots.txt and disallows it, for the week of 2026-10-05.

How sites treat this token

StanceDomainsWhat it means
FullBlock68Every path is disallowed for this token.
PartialBlock0Some paths are disallowed for this token; others are not.
Allowed3The token is named and explicitly allowed.
Unmentioned924The file never names this token. This is not consent — the site may still close it off with a blanket rule for every crawler.

ImagesiftBot's three-year history

ImagesiftBot over time, 16 quarterly periods from 2023-01 to 2026-08.ImagesiftBot rose from 0.00% at 2023-01 to 8.75% at 2026-08.0%2%4%6%8%10%2023-012023-092024-052025-012025-102026-088.75%

A site in the historical panel first named and disallowed this token in 2024-02; its most recent reading is 8.75%.

Note: this chart reads Common Crawl's own 611-domain historical panel, not the panel behind the stance table above — a different population from the live index panel, so levels are not comparable between the two indices.