Cloudflare replaces its blanket AI bot block with granular controls for search, training, and agent crawlers
Cloudflare is giving all customers granular AI bot controls. Site owners can now manage Search, Training, and Agent bots separately instead of blocking them all at once. Starting September 15, 2026, Training and Agent bots will be blocked by default on ad-supported pages. The article Cloudflare replaces its blanket AI bot block with granular controls for search, training, and agent crawlers appeared first on The Decoder .
The Decoder
·Matthias Bastian
·
// relacionados
Leia também
Editorial
EdgeBench: 38 mil horas de agentes trabalhando revelam uma lei de escala inesperada
Editorial
Hy3: a Tencent libera seu modelo de 295 bilhões sob Apache 2.0 — e sem fronteiras
Editorial
InternVLA-A1.5: o robô que imagina o próximo segundo antes de mover o braço
Editorial