Make your site readable by AI agents

Framer makes your site easy for AI agents to read and understand by automatically serving a clean, structured markdown version of your pages, with no setup or configuration required.

Why Framer sites are visible to AI agents

Although Framer sites are built with React, every page is pre-rendered to HTML on our servers before it is served. AI agents and crawlers that do not execute JavaScript still receive the full text of your page, including headings, paragraphs, semantic HTML, <title> and <meta name="description"> tags, Open Graph and Twitter cards, canonical URLs and any JSON-LD structured data you have added. Framer also generates robots.txt and sitemap.xml for every published site automatically.

You can verify this from any terminal:

curl -A "GPTBot/1.0"

curl -A "GPTBot/1.0"

curl -A "GPTBot/1.0"

In addition to HTML, Framer serves a markdown version of every page on the same URL, which most AI tools prefer. The next section explains how that works.

How markdown delivery works

Framer automatically converts your pages into structured markdown that AI tools can read and reference. This includes tools like Claude, ChatGPT, and Cursor. There are two ways AI agents access markdown.

Content negotiation

When an AI agent requests a page with the Accept: text/markdown HTTP header, Framer returns a markdown version instead of HTML. This is the primary method used by most AI tools.

You can test this behavior using:

curl -H "Accept: text/markdown"

curl -H "Accept: text/markdown"

curl -H "Accept: text/markdown"

?md query parameter

You can also access the markdown version of any page by adding a md query parameter to the URL (no value required).

For example:

• https://framer.com/pricing?md returns markdown for /pricing

• https://framer.com/blog?md returns markdown for /blog

• https://framer.com?md returns markdown for the homepage

How to preview what AI agents see

To preview your site as AI agents see it, add a md query parameter to any page URL in your browser. For example, you can view Framer’s homepage in markdown at https://www.framer.com?md

How AI agents discover your content

AI agents use multiple methods to discover and navigate your site.

• Content negotiation: Most agents request markdown directly using the appropriate header.

• Sitemap: Your sitemap.xml lists all pages and helps agents understand your site structure.

• Navigation links: Framer automatically includes a ## Navigation section at the bottom of each markdown page. This section contains links across your site to improve discoverability.

• Link following: After reading a page, agents follow links within the markdown to find additional content.

Support for multi-site rewrites

Markdown conversion integrates seamlessly with multi-site rewrites. If you're using them to host part of your site outside of Framer, we'll automatically convert your content to markdown when the request contains the ?md query parameter or uses the Accept: text/markdown header.

If your external hosting provider already supports markdown, Framer will simply serve that.

Using llms.txt

Framer supports llms.txt, a proposed standard that helps AI agents quickly understand your site and access important pages. Once added, the file is available at https://www.framer.com/llms.txt

To learn how to add this file, see Adding llms.txt to your site.

Which AI agents and crawlers Framer supports

Framer is regularly tested with major AI agents and search crawlers, including:

• Googlebot, GoogleOther and Google-Extended

• Bingbot

• GPTBot (OpenAI)

• PerplexityBot

• YandexBot

• AhrefsBot

All AI and search crawlers are allowed by default in your auto-generated robots.txt. You can still mark individual pages as noindex or restrict specific agents through your site settings, and those rules are respected. For the full list of supported browsers and crawlers, see Requirements and browser support.

Limitations and considerations

Markdown delivery works automatically, but there are a few important limitations to keep in mind.

• Markdown is only generated for optimized pages. If a page is not optimized, a markdown version will not be available.

• In some cases, markdown may also be unavailable if your site is being rate-limited.

Audit your site

To check how AI agents see your site today, run the AEO scanner. It evaluates server rendering, structure, schema and metadata against the criteria above and returns a prioritized list of fixes.