Do AI engines actually read you?
Your own server log already knows. Upload it and see which AI crawlers came, what they fetched, whether your firewall blocked them, and how many real visitors ChatGPT, Perplexity and Gemini sent. The GEO measurement nobody can fake.
Your own server log already knows whether AI engines read you.
Which crawlers came, and when
GPTBot and OAI-SearchBot (OpenAI), ClaudeBot (Anthropic), PerplexityBot, Google-Extended and the rest, pulled straight out of your access log. Not a guess from your robots.txt — a record of visits that happened.
What they fetched, and what they were refused
Every 403 and 429 is listed. A firewall rule or bot-protection setting blocking AI crawlers is invisible from the outside and extremely common; this is the only way to see it.
Real visitors sent by AI engines
Referrals from ChatGPT, Perplexity, Copilot and Gemini, counted separately from crawler traffic. This is the number that says whether being cited is turning into anything.
No AI crawler visits at all means blocked, not ignored
These crawlers are active constantly. If a month of logs shows none, something is stopping them — robots.txt, a Cloudflare bot rule, or a firewall setting. Check the 403s first.
Crawled a lot, cited never
That is a content problem, not an access problem. Answer engines quote pages that state facts plainly — a direct answer in the first paragraph under a question heading. Marketing prose gets crawled and passed over.
Allowing them is a business decision
Google-Extended controls whether your content feeds AI answers. Blocking it protects the content and removes you from the answers. There is no neutral setting; pick deliberately rather than by default.
Before you trust the number.
Where do I find my access log?
On most hosting it is in cPanel under Raw Access Logs, or at /var/log/nginx/access.log or /var/log/apache2/access.log on a server you control. Cloudflare users can export from Analytics & Logs. Any common format works.
Is my log uploaded anywhere?
It is parsed to produce the report and not retained afterwards. We do not need, and do not keep, your visitors’ IP addresses.
Should I block AI crawlers?
If your content is the product — paid research, a course, a subscription publication — blocking is reasonable. If you want to be found, blocking removes you from a growing share of how people search. Most businesses should allow them and write pages worth quoting.
Does allowing AI crawlers hurt my Google ranking?
No. Google-Extended is separate from Googlebot; allowing or blocking it has no effect on normal search indexing or ranking.
Ready to grow? Let's find out how far.
Tell us where to look. Within 48 hours you'll have a clear, prioritised plan from a team that has done this for 10 years.
