Research
The Agent-Ready Web
The agentic web is websites being used by AI agents, not only read by people. Each month we crawl 10,000 popular US web origins from the Chrome UX Report and measure what those agents find: WebMCP tools, which AI crawlers are let in, llms.txt, and SEO basics.
Latest: October 2026
- 4.2% had WebMCP tools active in Chrome (213 of 5,050 (4.2%) sites a browser loaded)
- 12.2% publish an llms.txt (585 of 4,805 (12.2%) sites where it could be checked)
- 32 more sites registered WebMCP tools that stock Chrome did not activate yet
Why we publish this
WebMCP, llms.txt and AI-crawler rules are new, and most of what is written about them is opinion. These reports count what sites actually do, with the method and denominators stated, so anyone can check the numbers or cite them.
The crawl runs on the crawler behind Convertlyft. How this site works.