# Markdown Negotiation beats llms.txt > URL: https://4eck-media.de/en/blog/markdown-negotiation-beats-llms-txt/ > Language: en > Description: Markdown Negotiation means that a website delivers the same URL either as HTML or as Markdown, depending on what the requesting client asks for. An AI bot sends the HTTP header Ac… --- **Markdown Negotiation means** that a website delivers the same URL either as HTML or as Markdown, depending on what the requesting client asks for. An AI bot sends the HTTP header `Accept: text/markdown`; the server responds with the page content alone, without navigation, scripts or layout code. People using a browser continue to see the normal page. Technically, this is classic HTTP content negotiation applied to language models. Under our LinkedIn post about llms.txt, the question came up which GEO measure we currently prioritise more highly. Technically, the answer is clear: Markdown Negotiation. This article presents the figures from our bot logs, explains why Markdown clearly outperforms llms.txt in terms of impact, and shows how to implement it on a WordPress website. We have already described the technical principles in [Markdown vs. HTML: How useful is it for GEO and AI visibility?](https://4eck-media.de/en/blog/markdown-vs-html-how-useful-is-it-for-geo-and-ai-visibility/). Key takeaways - In 30 days (27 August to 25 September 2026), 4eck-media.de delivered 24,293 pages as Markdown to AI bots; llms.txt was requested 13 times in the same period - 98.2% of Markdown requests used the Accept header on the normal URL, i.e. via content negotiation - ChatGPT-User, the bot behind live requests in ChatGPT, received 99.5% of its pages as Markdown - Bots that use Markdown use it almost always: 95% of their page requests were Markdown - llms.txt remains useful because it costs almost nothing. Markdown Negotiation is the more effective GEO measure ## How often do AI bots retrieve Markdown, and how often llms.txt? Markdown is retrieved around 1,870 times more often than llms.txt on 4eck-media.de. Since May 2026, we have logged every bot request with user agent, URL, status code and delivered content type. For this article, we analysed the last 50,000 bot requests, covering the period from 27 August to 25 September 2026. | Metric (27 August to 25 September 2026) | llms.txt and llms-full.txt | Markdown Negotiation | | --- | --- | --- | | Requests | 13 | 24.293 | | Requests per day | 0.4 | 810 | | Successful requests (status 200) | 7 | 24.293 | | Bots involved | 6 | 17 | | URLs retrieved | 6 paths | 1,812 pages | The findings align with the long-term view: between May and September 2026, llms.txt was retrieved 65 times in around 221,000 bot requests, about 0.03%. By contrast, Markdown accounts for 75.3% of all pages successfully delivered in the current period. The volume is growing: during the week from 31 August to 6 September 2026, 5,271 Markdown pages were delivered to bots; in the week from 14 to 20 September 2026, the figure was 6,189—an increase of 17% in two weeks. ## Which AI bots retrieve Markdown? Seventeen bots retrieved Markdown in 30 days, and for almost all major AI providers it is the preferred format. The table shows the share of pages delivered as Markdown rather than HTML. | Bot | Operator | Page requests | Markdown share | | --- | --- | --- | --- | | Meta-ExternalAgent 1.1 | Meta | 17.456 | 99.7% | | ChatGPT-User | OpenAI | 593 | 99.5% | | CCBot | Common Crawl | 179 | 99.4% | | ClaudeBot | Anthropic | 1.571 | 97.9% | | PerplexityBot | Perplexity | 496 | 97.6% | | GPTBot | OpenAI | 75 | 96.0% | | Bytespider | ByteDance | 274 | 95.6% | | OAI-SearchBot | OpenAI | 111 | 95.5% | | Amazonbot | Amazon | 3.075 | 95.3% | | Claude-User | Anthropic | 190 | 47.9% | | Applebot | Apple | 967 | 11.2% | | LinkupBot, PetalBot, FacebookExternalHit, Meta-WebIndexer, GoogleOther | Linkup, Huawei, Meta, Google | 5.958 | 0 % | Status: 25 September 2026. The basis is pages successfully delivered (status 200) as HTML or Markdown, excluding sitemaps, feeds and JSON. Two details are new compared with our analysis from May. Meta has changed its crawler: the older Meta-ExternalAgent 1.0 did not receive Markdown, while the new version 1.1 received 99.7%. Applebot uses the hint in the HTML head. All 108 Markdown requests from Applebot used the linked parameter `?format=markdown`, none used the Accept header. So the unobtrusive entry in the source code is indeed read: ``` ``` ## Why is Markdown Negotiation the better GEO measure? Markdown Negotiation has an effect on every individual page a bot retrieves; llms.txt has an effect in only one place on the domain. llms.txt is a signpost; Markdown delivers the content itself. This results in four advantages: 1. **Quote-ready content without clutter:** No menu, no cookie banner, no footer. Facts, tables and figures sit directly in the text and can be cleanly reused as a passage. 2. **Fewer tokens:** According to Cloudflare, a blog post needs 16,180 tokens as HTML and 3,150 as Markdown. That is around 80% less, allowing more content to fit into the model’s context window. 3. **No JavaScript required:** Most AI crawlers do not execute JavaScript. On pages that load content with scripts, they often see only an empty shell in HTML. The Markdown version contains the finished text. 4. **Fast response for TTFB issues:** A cached Markdown version is small and delivered quickly. For anyone struggling with Time to First Byte, it provides a faster way to deliver content. Websites that rely heavily on JavaScript—such as single-page applications, headless setups or sites with heavy page builders—and sites with long server response times therefore benefit in particular. ## Does that make llms.txt obsolete? No. llms.txt is retrieved and can be created in under an hour, so it remains a standard part of our client projects. On multilingual websites, a separate file should be available for each language: 6 of the 13 requests in the current period led nowhere on /en/, /fr/ or /pl/. However, Markdown Negotiation is clearly the higher priority. | Criterion | llms.txt | Markdown Negotiation | | --- | --- | --- | | What the bot receives | Site table of contents | full page content | | Applies to | one file | every page | | Requests in 30 days on 4eck-media.de | 13 | 24.293 | | Effort in WordPress | under 1 hour | 0.2 to 1 developer day | | Helps with JavaScript-heavy sites | no | yes | | Helps with TTFB issues | no | yes, with caching | ## What does Markdown do for AI visibility? A request is not yet a recommendation, and bot logs do not prove a direct link between Markdown and visibility in AI answers. What we see: around three quarters of our new customers currently come via inquiries prompted by AI recommendations (our own tracking, as of September 2026). Markdown Negotiation is one building block for this, not the sole reason. Yet one thing is clear: when ChatGPT searches live for information about 4eck Media, it receives the clean Markdown version 99.5% of the time. ![Bot-Logger](https://4eck-media.de/wp-content/uploads/2026/09/botlogger.avif "Bot-Logger") ## How do you implement Markdown Negotiation in WordPress? In WordPress, a hook that checks the Accept header and returns the content as Markdown is sufficient. The detailed instructions with code are in our [Markdown vs. HTML](https://4eck-media.de/en/blog/markdown-vs-html-how-useful-is-it-for-geo-and-ai-visibility/) article. The steps in brief: 1. In the `template_redirect` hook, read the Accept header and check for `text/markdown`. 2. Convert the page content using the PHP library `league/html-to-markdown`. 3. Prefix the title, author, date and URL as YAML front matter. 4. Configure caching with `Vary: Accept` so browsers continue to receive HTML. 5. Optionally offer `?format=markdown` and link it in the head with `link rel="alternate"`. Applebot uses precisely this path. 6. Write the delivered content type to the bot log to measure the impact. Anyone using Cloudflare can activate the “Markdown for Agents” feature. Available without extra charge for Pro, Business and Enterprise plans since February 2026, it automatically converts HTML as soon as a bot requests Markdown. ## Sources - 4eck Media: own bot logs from 4eck-media.de, 50,000 requests from 27 August to 25 September 2026 - [4eck Media: Markdown vs. HTML: How useful is it for GEO and AI visibility?](https://4eck-media.de/en/blog/markdown-vs-html-how-useful-is-it-for-geo-and-ai-visibility/), May 2026 - [Cloudflare: Markdown for Agents](https://blog.cloudflare.com/markdown-for-agents/), February 2026 - [Vercel: The Rise of the AI Crawler](https://vercel.com/blog/the-rise-of-the-ai-crawler) ## More about SEO, AI visibility and WordPress More articles and technical insights from our agency work. [![Forest to Table: game-meat shop on tablet and smartphone next to a paper deer and two score circles showing 90 and 92.](https://4eck-media.de/wp-content/uploads/2026/09/wald-zu-tisch-responsive-webdesign-blog-02.avif "Forest to Table after the relaunch: the game-meat shop on tablet and smartphone.")](https://4eck-media.de/en/blog/forest-to-table-shop-relaunch-from-prestashop-to-woocommerce/ "Forest to Table: Shop Relaunch from PrestaShop to WooCommerce") [Forest to Table: Shop Relaunch from PrestaShop to WooCommerce](https://4eck-media.de/en/blog/forest-to-table-shop-relaunch-from-prestashop-to-woocommerce/) Matthias Petri [![Custom ERP for WooCommerce: Case Study of Precious Metals Dealer Goldmichi.de](https://4eck-media.de/wp-content/uploads/2026/09/goldmichi-erp-blog.avif "Custom ERP for WooCommerce: Case Study of Precious Metals Dealer Goldmichi.de")](https://4eck-media.de/en/blog/custom-erp-for-woocommerce-case-study-of-precious-metals-dealer-goldmichi-de/ "Custom ERP for WooCommerce: Case Study of Precious Metals Dealer Goldmichi.de") [Custom ERP for WooCommerce: Case Study of Precious Metals Dealer Goldmichi.de](https://4eck-media.de/en/blog/custom-erp-for-woocommerce-case-study-of-precious-metals-dealer-goldmichi-de/) Matthias Petri [![AI search page structure](https://4eck-media.de/wp-content/uploads/2026/09/ki-suche-checkliste-seitenaufbau.avif "AI search page structure")](https://4eck-media.de/en/blog/the-optimal-page-for-ai-search-structure-checklist-and-research-findings-for-2026/ "The optimal page for AI search: Structure, checklist and research findings for 2026") [The optimal page for AI search: Structure, checklist and research findings for 2026](https://4eck-media.de/en/blog/the-optimal-page-for-ai-search-structure-checklist-and-research-findings-for-2026/) Matthias Petri [![Markdown Negotiation beats LLMS.TXT](https://4eck-media.de/wp-content/uploads/2026/09/llms-txt-vs-markdown.avif "Markdown Negotiation beats LLMS.TXT")](https://4eck-media.de/en/blog/markdown-negotiation-beats-llms-txt/ "Markdown Negotiation beats llms.txt") [Markdown Negotiation beats llms.txt](https://4eck-media.de/en/blog/markdown-negotiation-beats-llms-txt/) Matthias Petri ## FAQ: Markdown Negotiation and llms.txt How do llms.txt and Markdown Negotiation differ? llms.txt is a single file in the domain root that offers language models a table of contents for the website. Markdown Negotiation delivers every individual page as Markdown as soon as a bot requests it with an Accept header. llms.txt shows the way; Markdown delivers the content. Is Markdown Negotiation cloaking? No. The content is identical; only the format differs, and the client determines it itself via the HTTP header. This is standard HTTP and is also offered by Cloudflare, for example. Which AI bots request Markdown? On 4eck-media.de, Meta-ExternalAgent, ChatGPT-User, GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot, Amazonbot and CCBot, among others, received more than 95% of their pages as Markdown. Applebot uses link rel=”alternate” in the HTML head. Among those that did not request Markdown were PetalBot, LinkupBot and GoogleOther. Does Google need Markdown? No. Google crawlers did not request Markdown during our period. Markdown Negotiation targets ChatGPT, Claude, Perplexity, Meta AI and Amazon. Should I still create llms.txt? Yes. It is retrieved and can be created in under an hour. On multilingual websites, you should also provide files under language paths such as /en/llms.txt, because bots actively look for them there. How much work is Markdown Negotiation in WordPress? Plan for half to one developer day. You need a hook for the Accept header, HTML-to-Markdown conversion and caching that distinguishes between HTML and Markdown. ## Is your website read correctly by AI bots? We check which AI crawlers retrieve your pages, what they find there and whether Markdown Negotiation is worthwhile for you. 4eck Media from Waren (Müritz) has been developing [WordPress](https://4eck-media.de/en/competencies/wordpress-agency-websites-that-work-for-your-business/) and [WooCommerce projects](https://4eck-media.de/en/competencies/build-a-woocommerce-online-shop-with-a-specialized-woocommerce-agency/) since 2010, with more than 350 completed projects, and is ranked No. 1 among Germany’s WordPress agencies in the Agenturtipp.de live ranking (as of 21 September 2026). [Talk to us about your AI visibility.](https://4eck-media.de/en/contact/)