Access your robots.txt file

Learn how to view your site’s automatically generated robots.txt file

The robots.txt file tells search engines which pages they can crawl and index on your site.

Framer automatically generates a robots.txt file for every published site. You can access it directly from your browser.

  1. Open your browser.

  2. Enter your site’s domain followed by /robots.txt (for example, example.com/robots.txt).

  3. Press Enter to load the file.

You’ll see the live robots.txt file that search engines use when crawling your site.

FAQ

  • What does the robots.txt file do?

    The robots.txt file gives instructions to search engine bots about which pages they can or cannot crawl. It helps manage how your site appears in search results and supports your SEO strategy.

  • Does Framer create a robots.txt file automatically?

    Yes, Framer generates a robots.txt file for every published site. You don’t need to create or upload one manually.

  • Can I edit the robots.txt file in Framer?

    Framer manages the robots.txt file automatically. If you need custom behavior, you’ll need to adjust your site’s SEO settings or structure rather than editing the file directly.

    If you’re unsure whether your site is being indexed correctly, checking your robots.txt file is a quick and helpful first step.

Updated