Solutions
By Product
Enterprise AB Testing
By Role
For SEO
For Engineers
For Data analysts
By Use Case
For eCommerce/Retail
For Travel
For Listing Sites
For Job Websites
Pricing
Customers
Resources
All Resources
Newsletter
Articles
Webinars
Podcasts
Presentations
Videos
Latest SEO test results
Latest articles
Podcast
From engineering to SEO: Abishek Surana Rajendra’s formula for growth
Retail
How to make sure you aren't blocking AI crawlers in robots.txt for ecommerce
SEO A/B Testing
Back to basics: explanation of what SearchPilot does
View all articles
Company
About us
Who we are
Careers
Contact us
Login
Get started
Return to Articles
Articles
Posts tagged with
Indexing
Filters
Select a category
Show all articles
AI
Content
Experimentation culture
Growth and high-performing teams
Indexing
Jobs
Listings
Negative test result
Performance
Platform Features
Podcast
Retail
SEO A/B Testing
Travel
Webinar
Winning test result
2 mins read
How to make sure you aren't blocking AI crawlers in robots.txt for ecommerce
by
Will Critchlow
Posted on
January 29, 2025
Dig deeper
