The short answer
PerplexityBot is the crawler Perplexity uses to find and index web pages for its AI answer engine. Perplexity says it is not used to train AI foundation models. A second agent, Perplexity-User, fetches pages when a user asks a question. If PerplexityBot cannot reach your site, Perplexity is less likely to cite it.
- PerplexityBot builds the index Perplexity uses to find and cite sources.
- Perplexity says PerplexityBot is not used to train foundation models.
- Perplexity-User handles live fetches when a user asks, and follows different rules.
- Perplexity shows sources prominently, so crawler access matters for citations.
What does PerplexityBot do?
Perplexity is an AI answer engine. It searches the web, reads pages and writes an answer with numbered sources.
PerplexityBot is the crawler that discovers and indexes those pages ahead of time. Perplexity describes its purpose as surfacing and linking websites in its results.
According to Perplexity's documentation, it is not used to crawl content for training AI foundation models. Check the official page, as policies can change.
PerplexityBot vs Perplexity-User
Perplexity runs two main agents. They behave differently, so it helps to know which is which.
| User agent | When it visits | robots.txt |
|---|---|---|
| PerplexityBot | Ahead of time, to build the search index | Follows robots.txt |
| Perplexity-User | Live, when a user's question needs your page | Perplexity says it generally ignores robots.txt, since a user asked |
Check Perplexity's official crawler page before relying on either behavior, as it may change.
Why does PerplexityBot matter for citations?
Every Perplexity answer lists its sources, often at the top. That makes Perplexity one of the clearest places to earn citations.
Pages that PerplexityBot cannot reach are much harder for Perplexity to cite. A competitor with an open site may be cited instead.
Perplexity also looks beyond your site. Directories, reviews and articles that mention you can be cited too.
Because sources are so visible, readers often click them to check a claim. A cited page that loads fast and answers clearly can turn that click into an enquiry.
Blocking Perplexity's crawler is a valid choice for some sites. Just make it on purpose, knowing the trade-off for citations.
How to allow PerplexityBot in robots.txt
Most businesses that want AI visibility allow PerplexityBot across public pages. You can still keep private areas out, as in this example.
If you also have a User-agent: * group, remember that PerplexityBot follows only its own group once one exists. Repeat any blocks you still want it to respect.
User-agent: PerplexityBot Allow: / Disallow: /account/ Disallow: /checkout/
How to check PerplexityBot can reach you
WebValet's free check reads your robots.txt rules for PerplexityBot and other AI bots. WebValet Pro also tracks Perplexity answers to your buyer prompts each week.
- 1
Read your rules
Open yourdomain.com/robots.txt and look for PerplexityBot or broad blocks.
- 2
Check your firewall
Make sure CDN or security settings are not blocking Perplexity's crawler.
- 3
Check your logs
Search server logs for PerplexityBot to confirm real visits.
- 4
Verify the source
Compare visiting IPs against the ranges Perplexity publishes.
- 5
Test in Perplexity
Ask a few buyer questions and see whether your pages appear as sources.
Common PerplexityBot mistakes
Watch for these when you review your setup.
- A blanket User-agent: * block that also shuts out PerplexityBot.
- Security tools that treat all AI bots as threats by default.
- Key content that only appears after JavaScript runs.
- Assuming robots.txt rules also control Perplexity-User.
How does Perplexity pick which pages to cite?
Perplexity does not publish its full ranking rules. What you can see is the result: a handful of sources per answer, shown with numbers.
Pages that answer the question directly and specifically seem to do well. So do well-known sources such as review sites, directories and established publications.
Freshness can matter for topics that change, such as prices or regulations. Keep dates and figures current on pages you want cited.
The practical test is simple. Ask your buyer questions in Perplexity, then study the pages it chose. They show what it rewards in your niche.
Questions people ask
Does Perplexity train on my content?
Perplexity says PerplexityBot is not used to train foundation models. Read its current policy for the exact terms.
Does Perplexity-User respect robots.txt?
Perplexity's documentation says user-triggered fetches generally ignore robots.txt, because a person requested the page. Check the official page for current behavior.
What happens if I block PerplexityBot?
Perplexity will find it harder to index and cite your pages. You may still be mentioned through third-party sources that discuss you.
How do I get cited more often in Perplexity?
Allow PerplexityBot and keep key pages fast and readable. Answer buyer questions plainly near the top. Earn mentions on the sources Perplexity already cites in your niche.
How can I see Perplexity visits in my analytics?
Look for referral traffic from perplexity.ai in Google Analytics 4. That shows clicks from answers, not mentions without a click. It is still a useful sign that citations are reaching real people.