Can AI crawlers reach your store?
Enter your domain. We request your home page as GPTBot, ClaudeBot, ChatGPT-User, OAI-SearchBot and PerplexityBot, and once as a browser, then compare the answers. It is the method from our measurement of 810 US stores, where 61% refused a request identifying itself as GPTBot.
- GPTBot403 Refused
- ClaudeBot403 Refused
- ChatGPT-User200 Served
- OAI-SearchBot200 Served
- PerplexityBot200 Served
Run the test
What the test does
- Requests your home page six times, identical but for the
User-Agentheader: a browser and five AI crawlers. - Reads your
robots.txtand shows what it says about each crawler. - Counts a crawler as refused when the browser is served and that crawler is not.
Why it matters: most stores that refuse these crawlers never wrote a rule saying so. The refusal comes from a CDN or firewall default, which is why it can go unnoticed for months. Read the findings. Access is one of seven signs; check the other six in two minutes.
FAQ
Is this free? Do I need to sign up?
Free, with no sign-up and no email. You enter a domain and get the result on this page.
Do you save my domain or the result?
Not unless you ask us to email you the report. Without that we keep neither the domain nor the result: only anonymous monthly totals (how many tests, how many refusals) and, for one hour, a counter per address so the tool can't be used to hammer other people's sites. If you do request the report, we keep your domain and email to send it and to write to you about it.
The test says my store refuses GPTBot. Is that final?
It is a strong hint, not a verdict. We send the crawler's name in a header, from our own address. Real crawlers arrive from published IP ranges, and some sites serve those while refusing a request that only claims the name. Either way, it is worth knowing what your server does with a request that says it is GPTBot.
My store passed. Are AI assistants recommending it?
Not necessarily. Access is the first gate, not the whole job: assistants also need product facts in your raw HTML and a reason to name you. Our free AI visibility check covers those too.
What does the test not cover?
It reads your home page and robots.txt, nothing else. It does not check other pages, JavaScript-rendered content, or what assistants say about you.