GEO Data
AI crawler access across the ecommerce sites we audited
Across the 24 ecommerce sites we audited, 100% allow GPTBot to read their public pages, based on each site's robots.txt. These figures describe sites that ran our free audit — not a random sample of the web.
Early data — 24 sites audited so far (we report generalized figures from 30+). Numbers will stabilize as the sample grows.
AI crawler access
Share of audited sites whose robots.txt allows each crawler. Sites where a crawler's state could not be determined are excluded from that crawler's total.
| Crawler | Allowed | Blocked | Measured |
|---|---|---|---|
| GPTBot | 19 | 0 | 19 |
| PerplexityBot | 19 | 0 | 19 |
| ClaudeBot | 19 | 0 | 19 |
| Google-Extended | 19 | 0 | 19 |
Other signals
- 79% of audited sites have a root-level llms.txt file.
- Average GEO score: 42/100 (brand authority averages 28/100 — the weakest signal).
Methodology
- Sample size: 24 sites that ran the TerlihatAI free audit — not a random sample of the web.
- Category distribution: skincare (19), fnb (4), saas (1).
- Crawler rates use a measured-only denominator: sites where a crawler's state is unknown are excluded, never counted as allowed.
- Last updated: 2026-06-22.
Add your site to the data
Run a free readiness audit — get copy-ready fix files and grow this dataset.
Run a free audit