Purpose: User-initiated. Fetches a specific page because a user asked, rather than crawling broadly. Blocking this stops people using an assistant to read the site; it does not prevent training.
Not a crawler. Devin is an AI coding agent that fetches specific pages when a user's task requires it — documentation, an issue, a reference — rather than crawling broadly.
2.51%
of the panel names this token in robots.txt and disallows it, for the week of 2026-10-05.
How sites treat this token
| Stance | Domains | What it means |
|---|---|---|
| FullBlock | 24 | Every path is disallowed for this token. |
| PartialBlock | 1 | Some paths are disallowed for this token; others are not. |
| Allowed | 0 | The token is named and explicitly allowed. |
| Unmentioned | 970 | The file never names this token. This is not consent — the site may still close it off with a blanket rule for every crawler. |
Devin's three-year history
A site in the historical panel first named and disallowed this token in 2025-10; its most recent reading is 3.71%.