导航|地址|刷新
Block AI Bots

Skip to contentDocumentation Index
Fetch the complete documentation index at: https://developers.cloudflare.com/bots/llms.txt
Use this file to discover all available pages before exploring further.



DocsDirectoryAPISDKsChangelog

Search

Log in






Bots

/




Overview

Plans


Get started


Bot Fight Mode

Super Bot Fight Mode

Bot Management






Concepts



Bots


Overview

Verified bots





Bot scores

Bot tags

Bot Feedback Loop

Bot detection engines






Additional configurations



JA3/JA4 fingerprint


Overview

Signals Intelligence






Detection IDs


Overview

Account takeover detections

Scraping detections

Additional detections





JavaScript detections ↗

Sequence rules

AI LabyrinthBeta

Block AI Bots

Custom rules

robots.txt setting

Static resource protection





Bot Analytics

BotBase

Attribution Business Insights


Workers templates


Delay action





Account Abuse ProtectionEarly Access


Troubleshooting


Bot Management skips

Super Bot Fight Mode for WordPress

False positives






Reference



Bot verification methods


Web Bot Auth

IP validation





Bot Management variables

Machine Learning models

Bot Detection Alerts

Sample terms





Glossary

Changelog


Agent resources


Agent setup ↗

Cloudflare Skills ↗

Code Mode MCP Server ↗

Domain-specific MCP Servers ↗MCP

Bots llms.txt ↗

Bots llms-full.txt ↗

Cloudflare Docs llms.txt ↗

Cloudflare Docs llms-full.txt ↗













Home

/Bots

/Additional configurations

/Block AI Bots



Block AI Bots


Last updated Jul 1, 2026|Copy as Markdown|View as Markdown|Agent setup

OverviewConfigure AI bot policies New defaults on September 15, 2026Block AI bots [Deprecating on September 15, 2026]





Configure AI bot policies



New defaults on September 15, 2026


On September 15, 2026, Cloudflare will set updated defaults for new domains: bots classified as Training or as Agent will be blocked on pages that display ads, and Search will remain allowed. Mixed-purpose crawlers that combine Search and Training will also be blocked by all configurations to block AI training, including the legacy "Block AI bots" option. Before September 15, all customers can opt out of these new defaults ↗.

All Cloudflare customers can choose to block AI bots and agents based on their behavior. Cloudflare offers presets for the most common AI behaviors to give customers the option to treat different AI use cases distinctly:

Search: crawlers that collect or index your content to answer questions about it later.

Agent: automated activity acting in real time on a person's behalf, such as chat fetch bots and browser-use agents.

Training: crawlers taking your content to train or fine-tune a model, including mixed-purpose crawlers that are used both for Training and for Search.

Each blocking option will block Verified bots classified with that behavior, plus additional unverified bots that fall under these classifications.

Each setting includes three mitigation options:

Block (on all pages) - Issues the block across the entire zone.

Block on pages with ads - Uses Cloudflare automated detection for pages that display ads on your zone to block only on those pages.

Allow (do not block) - Does not add any blocking.

To configure these policies, customers can go to Security Settings > Configure AI bot policies.


Block AI bots [Deprecating on September 15, 2026]


This setting blocks verified bots that are classified as crawling for the purpose of AI training, as well as a number of unverified bots that behave similarly.


Note


This option excludes mixed-purpose bots that are used both for Training and for Search.



To configure this setting and set their preference for blocking mixed-purpose bots, customers can go to Security Settings > Block AI bots.


PreviousAI LabyrinthNextCustom rules


Was this helpful?

YesNo

Edit pageReport issue




On this page

Overview

Configure AI bot policies

New defaults on September 15, 2026

Block AI bots [Deprecating on September 15, 2026]


Edit pageReport issue














Getting started
PlansContact salesPartnersFind a partnerStartupsUnder attack?Domain name search


Company
AboutCareersInvestorsPressPress kitGlobal network




Public interest
Project GalileoAthenian ProjectCloudflare for CampaignsProject FairshotImpact/ESG


Compliance
Compliance resourcesTrust HubData ProtectionResponsible AITransparency reportReport abuse




Resources
App innovation reportCloudflare RadarCase studiesStatusSupportEventsBlog


Developers
DocumentationLearning centerCommunity




Solutions
SSE and SASE platformCloudflare AI CloudAI SecurityFrontend Development PlatformMulti-Tenant Platform DevelopmentWeb Security Platform


Start BuildingLog In












© 2026 Cloudflare, Inc.

Privacy policy|Report security issues|Terms of use|Trademark
|
Your privacy choices








Docs




------
导航页 打开网址