Cloudflare AI Visibility Integration

Stream every AI crawler and search bot request from your Cloudflare zone into Finseo. See which pages ChatGPT, Claude, Perplexity, Gemini, and Bing crawlers fetch, how often, and which crawlers never show up, on every Cloudflare plan including Free.

Bot Traffic · via Cloudflare

Live

1,420

visits · last 7 days

Live answerSearch indexTraining

AI crawlers · last 7 days

GPTBot detected

Training · from Ashburn, US · 312 visits

Built by
Finseo
Category
Bot Traffic
Connection
Worker or Logpush
Resources
WebsiteDocs

Overview

AI crawler tracking with Cloudflare.

See which AI crawlers, such as GPTBot, ClaudeBot and PerplexityBot, fetch your pages through Cloudflare, and which ones never arrive. Finseo deploys a small Worker named finseo-bot-traffic on your Cloudflare zone.

01

See which pages AI crawlers actually fetch

Bot Traffic groups Cloudflare requests by crawler and URL, so you know whether GPTBot, ClaudeBot, and PerplexityBot reach your pricing, product, and documentation pages or stop at the homepage.

02

Catch crawlers that never come

If Google-Extended or Claude-SearchBot has not requested a single page in 30 days, your robots.txt, a firewall rule, or a WAF setting is probably blocking it.

03

Correlate crawls with citations

Compare which URLs OAI-SearchBot and Perplexity-User fetch with the sources ChatGPT and Perplexity cite in your tracked prompts.

04

Verify indexing after content changes

After publishing a new FAQ section or schema markup from a Finseo visibility task, watch the Cloudflare feed for the next GPTBot or Bingbot visit to that URL instead of guessing when AI engines picked it up.

05

Spot errors AI bots hit

Cloudflare sends the HTTP status per request. Bot Traffic shows 3xx redirects, 4xx client errors, and 5xx server errors by crawler, so broken paths that keep Gemini and Microsoft Copilot from reading a page surface quickly.

Examples

How teams use Cloudflare with Finseo.

Four examples of what happens in Finseo once Cloudflare is connected, shown with the fields and labels from the app.

01 Example A

Who reads your pages

Every visit is sorted by purpose: live answers while someone asks, the search index, or model training.

/pricing · by purpose

ChatGPT-UserLive answer142
OAI-SearchBotSearch index118
GPTBotTraining52

02 Example B

Where crawlers come from

Countries and data-centre cities of the bots' servers, so you know which regions your firewall must let through.

Bot server locations

🇺🇸Ashburn, US41 %
🇮🇪Dublin, IE18 %
🇩🇪Frankfurt, DE9 %

03 Example C

Blocked crawlers, flagged

401, 403 and 429 answers show up as Blocked, with what it means and which rule to change.

Errors & Blocks

Blocked

96

ClaudeBot requests answered with 403

Check firewall and bot-manager rules for ClaudeBot

04 Example D

Crawl budget

See how much of each crawler's time goes to content pages, technical endpoints, assets or robots.txt and llms.txt.

Crawl Budget · PerplexityBot

52 % Content pages

30 % Technical endpoints

10 % Assets

8 % robots.txt & llms.txt

Comparison

Cloudflare alone vs Cloudflare with Finseo.

How using Cloudflare on its own compares to pairing it with Finseo for AI visibility and attribution.

AI crawler visibility

Cloudflare alone

Invisible to JavaScript analytics

Cloudflare + Finseo

Every GPTBot, ClaudeBot, PerplexityBot request

Latency

Cloudflare alone

Weekly or monthly log exports

Cloudflare + Finseo

Seconds (Worker) or minutes (Logpush)

Setup

Cloudflare alone

Download, filter, and upload logs by hand

Cloudflare + Finseo

One-click Worker deploy with an API token

Data volume

Cloudflare alone

Full access logs, gigabytes per month

Cloudflare + Finseo

Only crawler requests are transmitted

Plan requirement

Cloudflare alone

Enterprise logs for raw HTTP data

Cloudflare + Finseo

Worker runs on every plan including Free

Privacy

Cloudflare alone

Visitor data leaves your CDN

Cloudflare + Finseo

Regular visitor traffic never sent

How it connects

How the Cloudflare AI visibility integration works.

Why it matters

Why Cloudflare customers need AI visibility tracking.

Cloudflare sits in front of roughly 20 percent of all websites, which makes it the most common edge for the sites AI engines crawl. AI crawlers like GPTBot, ClaudeBot, and PerplexityBot do not execute JavaScript, so a client-side analytics snippet never sees them.

Connect Cloudflare

Bot Traffic · via Cloudflare

Live

1,420 visits

Live answer46 %
Search index38 %
Training16 %
Top: Ashburn, US6 crawlers

How to connect

Connect Cloudflare to Finseo.

In 5 steps, no code required.

  1. Step 01

    Collect your Cloudflare IDs

    Open dash.cloudflare.com, select your domain, and copy the Zone ID and Account ID from the API section on the Overview page. Both are needed for the Worker method; Logpush needs only the Zone ID.

  2. Step 02

    Create a custom API token

    Under Profile, API Tokens, create a custom token with Account: Workers Scripts: Edit, Zone: Workers Routes: Edit, and Zone: Zone: Read. For Logpush, the token needs Zone: Logs: Edit instead. Finseo uses the token once and never stores it.

  3. Step 03

    Open the Cloudflare connect dialog in Finseo

    In Finseo, go to Bot Traffic, Sync, and click Connect on the Cloudflare card. Choose Cloudflare Worker (all plans, recommended) or Logpush (Enterprise plan only).

  4. Step 04

    Deploy with one click or paste manually

    Paste the token, Account ID, and Zone ID and click Deploy Worker. Finseo uploads the Worker and adds a route for *yourdomain.com/* covering apex and subdomains. Prefer not to share a token? Copy the Worker script and deploy it yourself under Workers & Pages.

  5. Step 05

    Wait for the first crawler

    The card shows Awaiting first push until the first bot visit arrives, then switches to Connected. Depending on crawl volume this can take a few hours. Logpush sends a test upload immediately.

FAQ

Cloudflare and AI search visibility.

Was Kunden sagen

Mit 5,0 bewertet — und bereit für euren Security-Check.

Single Sign-on, Rollen pro Projekt und Hosting in Deutschland, mit Auftragsverarbeitungsvertrag für jede Organisation.

Robin Koppelmann

„Wir nutzen Finseo bei über 30 Kundenprojekten. Ausschlaggebend waren die besseren Features, das Content-Tool ist eine glatte 10/10.“

Robin Koppelmann

Gründer & GF, SEOLabs

SSO via SAML

Login über deinen Identity Provider

Daten in Deutschland

EU-Datenhaltung, DSGVO

Rollen & Audit-Trail

Jede Änderung protokolliert

Demo buchen

Wo steht deine Marke in KI-Antworten?

Trag deine Arbeits-E-Mail ein — wir zeigen dir in 30 Minuten, was ChatGPT, Gemini und Perplexity über deine Marke sagen.