AI LOG ANALYSER

See which AI bots actually read your site

Before an assistant can recommend your brand, it has to read your site. AI Log Analyser — also called AI crawler analytics or AI bot log analysis — works on your server logs and shows which AI bots visit, what they fetch and where they fail.

Enterprise plan. Set up together with your team.

VERIFIED BOTS

Every AI bot, and what it does with your content

Every AI crawler and assistant that visits your site — from OpenAI, Anthropic, Perplexity, Meta, Apple, Amazon and more — with its operator, its purpose (AI search, user requests or model training) and its visits day by day. A visit counts only when the IP address belongs to the operator's published ranges: a request that merely calls itself GPTBot is not counted.

What you get: You know which assistants can actually see your content, instead of assuming that all of them do.

Bots and platforms: every verified AI bot with its platform, type, visits and change, one bot expanded with its daily visits, most fetched addresses and response codes
ACTIVITY

How AI interest in your site changes

Bot activity over time, split into AI search, user requests and model training, next to the platforms that fetch your site most and the change against the previous period.

What you get: You can tell whether a new page, a robots.txt change or a site migration made AI bots come more often — or stop coming.

Activity over time for AI search, user requests and model training, next to the platforms that fetch the site most
PAGES

The pages they read, and the ones they skip

Every address AI bots fetch, the bot that fetches it most, its visits and their change — searchable and grouped by section. A page you care about that never shows up here is a page assistants cannot quote.

What you get: Your content team sees which pages feed AI answers and which ones need internal links, a sitemap entry or a rewrite.

Pages and URLs: addresses fetched by AI bots with the dominant bot, visits, change and last visit
ERRORS

Where they hit a wall

The response codes AI bots get from your server — 404s, 5xx errors, blocks and rate limits — and the addresses with the most errors, each with what to check. Export the list for whoever fixes it.

What you get: You stop losing places in AI answers to broken links and over-eager firewalls you did not know were there.

Errors and HTTP status: response codes seen by AI bots, the error rate against its alert threshold, and the addresses with the most errors with what to check
ENTERPRISE

Set up together with you

AI Log Analyser is part of the Enterprise plan. Logs live in a different place on every site — a CDN, a hosting panel or your own servers — so we connect the source with your team and check the first data together before the dashboard goes live.

PLATFORMS
OpenAI, Anthropic, Perplexity, Meta, Apple, Amazon, DuckDuckGo, ByteDance, Mistral, Cohere
VERIFICATION
Only visits from the operator's published IP ranges are counted
PERIODS
7, 30 or 90 days or a custom range, compared with the previous period
PLAN
Enterprise, configured with your team
SCREENSHOTS
Sample data from a demo site
ALSO CALLED
AI crawler analytics, AI bot tracking, log file analysis for AI search

Find out what AI bots do on your site

Tell us where your site runs, and we will tell you how we would connect it and what it costs.

Enterprise plan. Set up together with your team.