Access your robots.txt file

Learn how to view your site’s automatically generated robots.txt file.

The robots.txt file tells search engines which pages on your site can be crawled and indexed. It plays an important role in search engine optimization by guiding bots on how to interact with your content.

Framer automatically generates a robots.txt file for every published site. To view your file:

  1. Open your browser.

  2. Add /robots.txt to the end of your site’s domain.

Once loaded, you’ll see the live robots.txt file that search engines use to crawl your site.

Updated