Access your robots.txt file
Learn how to view your site’s automatically generated robots.txt file
The robots.txt file tells search engines which pages they can crawl and index on your site.
Framer automatically generates a robots.txt file for every published site. You can access it directly from your browser.
Open your browser.
Enter your site’s domain followed by
/robots.txt(for example,example.com/robots.txt).Press Enter to load the file.
You’ll see the live robots.txt file that search engines use when crawling your site.
FAQ
What does the robots.txt file do?
The
robots.txtfile gives instructions to search engine bots about which pages they can or cannot crawl. It helps manage how your site appears in search results and supports your SEO strategy.Does Framer create a robots.txt file automatically?
Yes, Framer generates a
robots.txtfile for every published site. You don’t need to create or upload one manually.Can I edit the robots.txt file in Framer?
Framer manages the
robots.txtfile automatically. If you need custom behavior, you’ll need to adjust your site’s SEO settings or structure rather than editing the file directly.If you’re unsure whether your site is being indexed correctly, checking your
robots.txtfile is a quick and helpful first step.
Updated