导航|地址|刷新
Bots

Skip to contentDocumentation Index
Fetch the complete documentation index at: https://developers.cloudflare.com/bots/llms.txt
Use this file to discover all available pages before exploring further.



DocsDirectoryAPISDKsChangelog

Search

Log in






Bots

/




Overview

Plans


Get started


Bot Fight Mode

Super Bot Fight Mode

Bot Management






Concepts



Bots


Overview

Verified bots





Bot scores

Bot tags

Bot Feedback Loop

Bot detection engines






Additional configurations



JA3/JA4 fingerprint


Overview

Signals Intelligence






Detection IDs


Overview

Account takeover detections

Scraping detections

Additional detections





JavaScript detections ↗

Sequence rules

AI LabyrinthBeta

Block AI Bots

Custom rules

robots.txt setting

Static resource protection





Bot Analytics

BotBase

Attribution Business Insights


Workers templates


Delay action





Account Abuse ProtectionEarly Access


Troubleshooting


Bot Management skips

Super Bot Fight Mode for WordPress

False positives






Reference



Bot verification methods


Web Bot Auth

IP validation





Bot Management variables

Machine Learning models

Bot Detection Alerts

Sample terms





Glossary

Changelog


Agent resources


Agent setup ↗

Cloudflare Skills ↗

Code Mode MCP Server ↗

Domain-specific MCP Servers ↗MCP

Bots llms.txt ↗

Bots llms-full.txt ↗

Cloudflare Docs llms.txt ↗

Cloudflare Docs llms-full.txt ↗













Home

/Bots

/Concepts

/Bots



Bots


Last updated Jul 1, 2026|Copy as Markdown|View as Markdown|Agent setup

OverviewAI bots Classification




A bot is a software application programmed to do certain tasks.

Bots can be used for good (chatbots, search engine crawlers) or for evil (inventory hoarding, credential stuffing).


More information


For more background, refer to What is a bot? ↗.




AI bots


AI crawlers and agents interact with your site for very different reasons, and you may want to treat those reasons differently. Rather than relying on a single "AI bot" label, Cloudflare classifies bots by behavior — what a bot does on your site — so you can allow the behavior that helps your business and block the behavior that harms it. A single bot can have more than one behavior.


Classification


Cloudflare lets all customers manage three AI-related use cases directly:

Behavior	What it does
Search	Collects or indexes your content so it can answer questions about it later.
Agent	Automated activity acting in real time on a person's behalf to get something done, such as chat fetch bots and browser-use agents.
Training	Crawls your content to train or fine-tune a model, permanently absorbing your data into the model.

Cloudflare classifies other behaviors, too — refer to Verified bots.


PreviousBot ManagementNextVerified bots


Was this helpful?

YesNo

Edit pageReport issue




On this page

Overview

AI bots

Classification


Edit pageReport issue














Getting started
PlansContact salesPartnersFind a partnerStartupsUnder attack?Domain name search


Company
AboutCareersInvestorsPressPress kitGlobal network




Public interest
Project GalileoAthenian ProjectCloudflare for CampaignsProject FairshotImpact/ESG


Compliance
Compliance resourcesTrust HubData ProtectionResponsible AITransparency reportReport abuse




Resources
App innovation reportCloudflare RadarCase studiesStatusSupportEventsBlog


Developers
DocumentationLearning centerCommunity




Solutions
SSE and SASE platformCloudflare AI CloudAI SecurityFrontend Development PlatformMulti-Tenant Platform DevelopmentWeb Security Platform


Start BuildingLog In












© 2026 Cloudflare, Inc.

Privacy policy|Report security issues|Terms of use|Trademark
|
Your privacy choices








Docs




------
导航页 打开网址