Perplexity vs ChatGPT search: how each reads your website
· Famed
Both Perplexity and ChatGPT search use a dedicated crawler to find sites for their answers: PerplexityBot and OAI-SearchBot. Both respect robots.txt for that crawler, both say changes can take about 24 hours, and both publish IP ranges for firewalls.
The main difference is in how they search: OpenAI says ChatGPT sometimes sends rewritten queries to outside search providers, while Perplexity describes PerplexityBot as surfacing sites in its own results.
Compared
| ChatGPT search | Perplexity | |
|---|---|---|
| Search crawler | OAI-SearchBot | PerplexityBot |
| Visits a user asks for | ChatGPT-User (robots.txt may not apply) | Perplexity-User (generally ignores robots.txt) |
| Training crawler | GPTBot, separate from search | Perplexity says PerplexityBot isn't used for training |
| Time for robots.txt changes | About 24 hours | Up to 24 hours |
| Outside search providers | Sometimes, with rewritten queries | Not described in its crawler documentation |
| Local questions | Uses general location from IP | Not described in its crawler documentation |
Preparing for both
- Allow OAI-SearchBot, ChatGPT-User, PerplexityBot and Perplexity-User in robots.txt.
- Allow both companies' published IP ranges in Cloudflare or any other firewall.
- Keep your main content in the page's HTML, readable without running scripts.
- Since ChatGPT may search through outside providers, being found in regular web search still matters for it.
- Ask both the questions your customers ask, and compare who each one names and cites.
See whether AI names your business
The free check reads your site, your Google listing and the directories AI cites, and asks AI about your business. About 20 seconds, no card.
Run the free AI checkSources
- OpenAI: overview of OpenAI crawlers
- OpenAI Help Center: searching the web with ChatGPT
- Perplexity: Perplexity crawlers
AI search changes often. We check these sources and update the date above when something changes.