Guide · Framer

AI crawlers and llms.txt on Framer

Shaheer Malik
Shaheer Malik
Founder, WebValet
2 min readUpdated

The short answer

Framer generates a robots.txt for every published site, and you cannot edit it line by line. On Pro and Enterprise plans you can upload your own robots.txt as a static file, which replaces the generated one. llms.txt works the same way: upload the file and give it the path /llms.txt.

  • Framer writes robots.txt automatically; view it at yourdomain.com/robots.txt.
  • To change it, upload a complete replacement robots.txt through static files, on Pro or Enterprise.
  • Upload llms.txt the same way, at the path /llms.txt.
  • Turning off indexing for a page in Framer adds a noindex tag; it does not change robots.txt.

What does Framer's robots.txt allow?

Framer generates robots.txt for each published site, and its help center does not list the default contents. Open yourdomain.com/robots.txt to read it.

Run the free AI crawler checker to see how those rules apply to each AI crawler.

How do you change robots.txt on Framer?

Framer does not offer a robots.txt editor. You replace the whole file instead.

  1. 1

    Copy the current file

    Open yourdomain.com/robots.txt and copy its text, including the sitemap line.

  2. 2

    Write your version

    In a plain-text file named robots.txt, keep the rules you need and add groups for the AI crawlers you want.

  3. 3

    Upload it

    In your project's site settings, open the Files tab for your domain and upload the file with the root path. This needs a Pro or Enterprise plan.

  4. 4

    Publish and check

    Publish, open yourdomain.com/robots.txt, and run the crawler checker.

User-agent: OAI-SearchBot
Allow: /

User-agent: Claude-SearchBot
Allow: /

User-agent: PerplexityBot
Allow: /

Your upload replaces Framer's generated file completely. Keep the sitemap line, or crawlers lose an easy way to find your pages.

How do you add llms.txt on Framer?

Framer's help center says you can upload a file and assign it to a root-level path such as /llms.txt. Like custom robots.txt, this is on Pro and Enterprise plans.

Write the file in Markdown, upload it with the path /llms.txt, publish, then open yourdomain.com/llms.txt to confirm it loads.

How do you hide one page from search on Framer?

Disable indexing in that page's settings. Framer adds a noindex meta tag to the page instead of changing robots.txt.

Questions people ask

Can I edit Framer's robots.txt on the free plan?

Framer's help center lists custom robots.txt uploads as a Pro and Enterprise feature. On other plans you keep the generated file.

Does Framer block AI crawlers?

Read your live robots.txt to see. If your domain uses Cloudflare in front of Framer, check its AI bot settings too.

Is llms.txt required on Framer?

No. Framer's help center calls it optional. It is a helpful map for AI tools, not a ranking requirement.

Put it to work

Check it, track it, or have it done

No trial and no lock-in. Start free, then choose.

  1. 01 · Start here

    Free check

    $0no signup

    See how ready your site is for Google and AI crawlers. About 20 seconds.

    Run a free check
  2. 02 · Track it weekly

    Pro

    $19/month · or $209/year

    25 buyer prompts on ChatGPT, Gemini and Perplexity, against 3 competitors. No trial, cancel anytime.

    Get Pro
  3. 03 · Done for you

    Hire Team Shaheer Malik

    $249/month · Pro included

    Shaheer's team does your SEO and GEO every month: pages, citations, listings and fixes.

    Schedule a call