Do AI Crawlers Actually Read Your AI Discovery Files? 11 Days of Real Server Logs
The SEO field's loudest voices say AI crawlers ignore llms.txt. So we put our WordPress plugin on a brand-new site and logged every bot hit. In 11 days, Meta's AI crawler and Microsoft's Bing read 8 of our 10 AI Discovery Files across 10 of those days, every request a 200. Here is the full server log, and the honest caveat about who didn't show up.
Mark McNeece Read article