A robots.txt file tells crawlers which URLs they may crawl on your site. It does not directly control indexing; for indexing control, use noindex and related mechanisms. Configure robots rules carefully to avoid blocking important content. See Access your robots.txt file. See How do I prevent specific pages from getting indexed by search engines?.

A hierarchical list of all pages and content on a website used for search engine indexing and user navigation. XML sitemaps help search engines discover all your pages while HTML sitemaps help visitors find content. Framer automatically generates and updates your XML sitemap. See How to access your sitemap.

eXtensible Markup Language—a format for storing and transporting structured data, used in sitemaps and RSS feeds. XML sitemaps help search engines discover all pages on your site. Framer generates XML sitemaps automatically.