01
See what's read
Crawler hits per page and per bot, including error responses, so you can spot pages AI crawlers can't reach.
Your next customer asked ChatGPT first.
AI assistants now send visitors and read your pages. GoTrace counts both: the people who click through from ChatGPT, Claude, Perplexity, Gemini and Copilot, and the AI crawlers that read your site before an assistant quotes it.
§ 01 AI referrals
A channel of its own, not "Referral".
Most analytics tools file ChatGPT under generic referrals, or lose it in "Direct". Here, every visit from an AI assistant lands in a dedicated AI channel, recognised from the referrer and from the utm_source tags assistants add to links.
- Conversion
- AI visitors' conversion rate side by side with search, social and email.
- Landing pages
- Which pages assistants link to, so you know what they cite you for.
- Alerts
- A new assistant starts sending traffic, or an existing one spikes? It shows up in your brief.
Recognised AI assistants13 sources
ChatGPTClaudePerplexityGeminiCopilotDeepSeekMeta AIGrokLe ChatYou.comPhindPoeHuggingChat
Matched by referrer domain and by the utm_source tag on the link.
AIits own channel in every report
vs searchconversion compared automatically
§ 02 AI crawlers
The visitors your analytics can't see.
GPTBot, ClaudeBot and PerplexityBot don't run JavaScript, so no script-based analytics, ours included, can count them in the browser. Your web server sees every one of them. Send us its access log and we'll show you which AI crawlers read which pages, and how often.
- Upload
- Drop an access log (plain or .gz) on the AI traffic page in your dashboard.
- Or automate
- One cron line sends the last hour's AI crawler lines to the API every hour.
- AI only
- Only lines from known AI crawlers are counted. Everything else in the log is ignored.
- No IPs kept
- IP addresses in the log are never stored. Re-sending the same lines never double-counts them.
# Every hour: send AI crawler hits from nginx 0 * * * * grep -iE 'GPTBot|ClaudeBot|PerplexityBot|…' \ /var/log/nginx/access.log | tail -n 20000 | \ curl -s -X POST \ -H 'Authorization: Bearer YOUR_API_KEY' \ -H 'Content-Type: text/plain' \ --data-binary @- \ https://gotrace.site/api/v1/sites/SITE_ID/crawler-logs
Your dashboard generates this line with the full crawler list, your site ID and the right URL.
Recognised 21 AI crawlers and agents
GPTBot (OpenAI)OAI-SearchBot (OpenAI)ChatGPT-User (OpenAI)ClaudeBot (Anthropic)Claude-User (Anthropic)Claude-SearchBot (Anthropic)anthropic-ai (Anthropic)PerplexityBotPerplexity-UserGoogle-ExtendedApplebot-ExtendedBytespider (ByteDance)CCBot (Common Crawl)cohere-aiMeta-ExternalAgentMeta-ExternalFetcherDiffbotYouBotAmazonbotMistralAI-UserDeepSeekBot
§ 03 Why it matters
Being read is the new being ranked.
When someone asks an assistant for a recommendation, the answer is built from pages its crawler has read. Knowing which of your pages get read, and which ones send buyers back, tells you where to put your effort.
02
See what's cited
AI referral landing pages show which content assistants actually link to when they answer.
03
See what converts
Compare AI visitors' conversion with search, then improve the pages that already earn AI traffic.
§ 04 Questions
About AI traffic.
Why does ChatGPT traffic show up as "Direct" in other tools?
Some assistant apps open links without passing a referrer. ChatGPT usually adds utm_source=chatgpt.com to the links it shows, and we use that tag as well as the referrer, so these visits land in the AI channel instead of Direct.
Is AI crawler traffic included in my visitor numbers?
No. Crawlers and bots are filtered out of your visitor statistics and counted separately, so they never inflate your traffic or skew conversion rates.
Which server logs can I upload?
The standard "combined" access log format used by nginx and Apache by default, plain or gzipped. Lines from the last 30 days are counted.
Should I block AI crawlers?
That's your call. Blocking them in robots.txt keeps your content out of AI answers, but it also stops assistants from recommending you. Measuring first tells you what you'd be giving up.
See how AI finds you.
Install the script, upload one log, and see your AI traffic today.
Start your free trial