Agent & Attribution
Cloudflare

Cloudflare

Stream every AI crawler and search bot request from your Cloudflare zone into Finseo. See which pages ChatGPT, Claude, Perplexity, Gemini, and Bing crawlers fetch, how often, and which crawlers never show up, on every Cloudflare plan including Free.

Overview

What you getwith the Cloudflare integration

Finseo deploys a small Worker named finseo-bot-traffic on your Cloudflare zone. The Worker passes every request through unchanged and, only when the User-Agent matches a known crawler such as GPTBot, ClaudeBot, PerplexityBot, Google-Extended, OAI-SearchBot, or Bingbot, reports the visit to Finseo in the background. Enterprise customers can use a Logpush job on the http_requests dataset instead. Both methods send the same fields per bot request: IP address and User-Agent, host, method, path and query string, referrer, HTTP status and response size, country, city and region, timestamp, and time to first byte. Visits are deduplicated and appear in Bot Traffic alongside manually uploaded logs.

Use cases

What you can dowith Cloudflare and Finseo

01

See which pages AI crawlers actually fetch

Bot Traffic groups Cloudflare requests by crawler and URL, so you know whether GPTBot, ClaudeBot, and PerplexityBot reach your pricing, product, and documentation pages or stop at the homepage.

02

Catch crawlers that never come

If Google-Extended or Claude-SearchBot has not requested a single page in 30 days, your robots.txt, a firewall rule, or a WAF setting is probably blocking it. Fix the block before working on AI visibility.

03

Correlate crawls with citations

Compare which URLs OAI-SearchBot and Perplexity-User fetch with the sources ChatGPT and Perplexity cite in your tracked prompts. Pages that get crawled but never cited need better structure or clearer answers.

04

Verify indexing after content changes

After publishing a new FAQ section or schema markup from a Finseo visibility task, watch the Cloudflare feed for the next GPTBot or Bingbot visit to that URL instead of guessing when AI engines picked it up.

05

Spot errors AI bots hit

Cloudflare sends the HTTP status per request. Bot Traffic shows 3xx redirects, 4xx client errors, and 5xx server errors by crawler, so broken paths that keep Gemini and Microsoft Copilot from reading a page surface quickly.

Why it matters

Why Cloudflare customersneed AI visibility tracking

Cloudflare sits in front of roughly 20 percent of all websites, which makes it the most common edge for the sites AI engines crawl. AI crawlers like GPTBot, ClaudeBot, and PerplexityBot do not execute JavaScript, so a client-side analytics snippet never sees them. The only reliable record of what ChatGPT, Claude, Perplexity, Gemini, and Google AI Overviews read on your site is the request log at the edge. Manual log uploads work, but they are always days old. A Cloudflare Worker or Logpush job turns that into a live feed, so Answer Engine Optimization (AEO) and Generative Engine Optimization (GEO) decisions rest on what crawlers did today, not last month.

Comparison

Cloudflare alonevs Cloudflare with Finseo

How using Cloudflare on its own compares to pairing it with Finseo for AI visibility and attribution.

AI crawler visibility

Cloudflare alone

Invisible to JavaScript analytics

With Finseo

Every GPTBot, ClaudeBot, PerplexityBot request

Latency

Cloudflare alone

Weekly or monthly log exports

With Finseo

Seconds (Worker) or minutes (Logpush)

Setup

Cloudflare alone

Download, filter, and upload logs by hand

With Finseo

One-click Worker deploy with an API token

Data volume

Cloudflare alone

Full access logs, gigabytes per month

With Finseo

Only crawler requests are transmitted

Plan requirement

Cloudflare alone

Enterprise logs for raw HTTP data

With Finseo

Worker runs on every plan including Free

Privacy

Cloudflare alone

Visitor data leaves your CDN

With Finseo

Regular visitor traffic never sent

How to connect

Connect Cloudflare to Finseoin 5 steps, no code required

Step 01

Collect your Cloudflare IDs

Open dash.cloudflare.com, select your domain, and copy the Zone ID and Account ID from the API section on the Overview page. Both are needed for the Worker method; Logpush needs only the Zone ID.

Step 02

Create a custom API token

Under Profile, API Tokens, create a custom token with Account: Workers Scripts: Edit, Zone: Workers Routes: Edit, and Zone: Zone: Read. For Logpush, the token needs Zone: Logs: Edit instead. Finseo uses the token once and never stores it.

Step 03

Open the Cloudflare connect dialog in Finseo

In Finseo, go to Bot Traffic, Sync, and click Connect on the Cloudflare card. Choose Cloudflare Worker (all plans, recommended) or Logpush (Enterprise plan only).

Step 04

Deploy with one click or paste manually

Paste the token, Account ID, and Zone ID and click Deploy Worker. Finseo uploads the Worker and adds a route for *yourdomain.com/* covering apex and subdomains. Prefer not to share a token? Copy the Worker script and deploy it yourself under Workers & Pages.

Step 05

Wait for the first crawler

The card shows Awaiting first push until the first bot visit arrives, then switches to Connected. Depending on crawl volume this can take a few hours. Logpush sends a test upload immediately.

FAQ

Cloudflare and AI search visibilityquestions people ask before choosing a tool

Finseo offers a native Cloudflare integration that streams AI crawler requests from your zone into its Bot Traffic dashboard using a lightweight Worker or an Enterprise Logpush job. You see which pages the crawlers behind ChatGPT, Claude, Perplexity, Gemini, Google AI Overviews, and Microsoft Copilot fetch, which grounds Answer Engine Optimization (AEO) in real crawl data.

Yes. Connect Cloudflare to Finseo and the Worker reports every request whose User-Agent matches GPTBot, ClaudeBot, PerplexityBot, OAI-SearchBot, Google-Extended, Bingbot, and other known crawlers. Bot Traffic groups them by crawler and URL, so you know whether ChatGPT and Claude reach your pricing and documentation pages or stop at the homepage, within seconds of each visit.

Yes. Finseo is a Generative Engine Optimization (GEO) platform with a native Cloudflare integration. The two do different jobs: Cloudflare delivers and protects your site at the edge, while Finseo turns the crawler requests it sees into AI visibility insight, correlating what GPTBot or PerplexityBot fetch with the sources ChatGPT and Perplexity actually cite.

Copy your Zone ID and Account ID from the Cloudflare Overview page and create a custom API token with Workers Scripts: Edit, Workers Routes: Edit, and Zone: Read. In Finseo, open Bot Traffic, Sync, click Connect on the Cloudflare card, paste the three values, and click Deploy Worker. Alternatively copy the Worker script and deploy it yourself.

Finseo receives only crawler requests: IP address and User-Agent, host, method, path and query string, referrer, HTTP status and response size, country, city, region, timestamp, and time to first byte. Regular visitor traffic never leaves Cloudflare. Your API token is used once to deploy the Worker and then discarded; Finseo never stores it.

Yes. Every Finseo plan includes the Cloudflare integration with no per-integration fee. On the Cloudflare side, the Worker method runs on every plan including Free, while the Logpush method needs a Cloudflare Enterprise plan because the http_requests dataset is only available there. The Worker delivers the same fields with lower latency.

Yes. Enterprise customers can push the Cloudflare http_requests dataset to Finseo through a Logpush job instead of deploying a Worker. The API token then needs Zone: Logs: Edit, and Logpush sends a test upload immediately. Both methods transmit the same fields per bot request and land in the same Bot Traffic project, deduplicated alongside manually uploaded logs.

AI crawlers such as GPTBot, ClaudeBot, and PerplexityBot never execute JavaScript, so client side analytics snippets never see them, and the only record of what ChatGPT, Claude, or Perplexity read on your site is the edge request log. Finseo turns that Cloudflare log into a live feed per crawler and URL for Answer Engine Optimization (AEO) work.

No. The finseo-bot-traffic Worker forwards every request unchanged and reports crawler visits in the background only after the response is sent, so visitors are never delayed or altered. If the Workers Free plan limit of 100,000 requests per day is exceeded, Cloudflare serves traffic normally and simply skips the Worker. Disconnecting in Finseo invalidates the ingest token.

Mit uns sprechen

Connect Cloudflare and dominate AI search

Join hundreds of brands using Finseo to track and improve their visibility in ChatGPT, Perplexity, Claude, Gemini, and Google AI Overviews.