Guide Version 1.6.0
Published
Last Modified
Status Stable

This specification is published and recommended for implementation. Backwards-compatible additions may occur in MINOR versions; breaking changes only in MAJOR versions, with deprecation notice. See specification conventions for status definitions.

Quick Start Guide

Implement AI Discovery Files in three progressive tiers

This guide provides a practical path to implementing AI Discovery Files. Start with the Essential tier for immediate impact, then expand to Recommended and Complete as your needs grow.

Important: These tiers are cumulative. Each tier includes all files from the previous tier, plus additional files. Recommended includes Essential. Complete includes Recommended. You cannot skip tiers — if you want Complete, you implement all 10 files including those from Essential and Recommended.

Tiers map to Conformance Classes

The three tiers in this guide (Essential, Recommended, Complete) are the formal conformance classes defined by the specification. A site that has fully implemented a tier conforms to the corresponding class. See the Conformance specification for publisher and validator conformance criteria.

Choose Your Implementation Level

Cumulative Tiers

Tiers build on each other. Recommended = Essential (2 files) + 4 new files. Complete = Recommended (6 files) + 4 new files. If you choose Complete, you implement all files from all tiers.

Essential Implementation

Start here. These two files answer the most fundamental questions AI systems have about your website.

File Purpose Answers
llms.txt Business identity and context "Who are you and what do you do?"
ai.txt AI usage permissions "How may AI use your content?"

What You Get

Implementation Checklist

Quick Test

After creating these files, visit yourdomain.com/llms.txt and yourdomain.com/ai.txt in your browser. Both should display correctly.

What's Missing Without Recommended Tier

← Choose a different tier

Complete Implementation

Includes Essential and Recommended tiers. Complete builds on Recommended by adding four more files. You must also implement all Essential files (llms.txt, ai.txt) and all Recommended files (identity.json, faq-ai.txt, brand.txt, ai.json) — this tier totals all 10 files.

Additional Files (beyond Recommended)

File Purpose When You Need It
llm.txt Redirect variant Some AI systems look for the singular form; this should 301 redirect to llms.txt
llms.html Human-readable version Provides a browsable version with Schema.org structured data
developer-ai.txt Developer context If you have APIs, SDKs, or technical products that developers use with AI assistants
robots-ai.txt AI crawler directives When you need fine-grained control over AI crawlers beyond standard robots.txt

Implementation Checklist

← Choose a different tier

Validate Your Implementation

After implementing your AI Discovery Files, verify they're working correctly:

  1. Accessibility check: Visit each file URL directly in your browser
  2. JSON validation: Run identity.json and ai.json through a JSON validator
  3. Consistency check: Verify your business name matches across all files
  4. Use the 365i Checker: Run the 365i AI Website Visibility Checker to validate your implementation
Next Step

Once implemented, use the Validation Framework to test whether AI systems are correctly interpreting your files.

Resources

Examples

See complete, working examples of all 10 files on the Examples page.

Specifications

For detailed format specifications, see the individual specification pages.

Conflict Resolution

If you're implementing multiple files, see the Interoperability Guide for precedence rules when files contain conflicting information.

Version History

1.6.0

Phase 6 standardisation release. Added /specifications/roadmap/ (theme-pegged forward plan with Active/Next/Future/On hold status flags), /specifications/extensions/ (rules for experimental x- prefixed files and the promotion path), and /specifications/i18n-a11y/ (multi-language publication, locale-tagged identity fields, RTL handling, accessibility of llms.html). Added the Discovery: directive to the robots-ai.txt specification (publishers MAY advertise AI Discovery Files on the same host). Added a formal media-type stance to the HTTP behaviour page (existing IANA types, no bespoke registrations). Expanded the file integrity and signing section on the security and privacy page with four candidate mechanisms, cross-cutting concerns, and interim publisher / consumer guidance. The Discovery: directive is the only normative addition to publisher behaviour; all other additions are forward-looking documentation.

1.5.0

Phase 5 standardisation release. Added /specifications/related-standards/ (positioning vs llmstxt.org, IETF AI Preferences, robots.txt, Schema.org, BCP 14, JSON Schema 2020-12, SemVer) and /specifications/implementations/ (public record of conformant implementations, IETF-style). Added an explicit llmstxt.org backward-compatibility statement to the llms.txt specification. Added a formal multi-domain and subdomain scoping rule to both the llms.txt and identity.json specifications (host-scoped files, cross-host identity asserted via sameAs). No normative requirements changed for existing publishers; the new scoping rules formalise behaviour the specification already implied.

1.4.0

Phase 4 standardisation release. Added /specifications/processing-model/ (seven-stage algorithm for conformant consumers), /specifications/consumer-guidance/ (what AI systems should do with AI Discovery Files), /specifications/test-vectors/ (canonical test suite framing), and reference-implementation framing on the AI Visibility Checker. No normative requirements changed.

1.3.0

Phase 3 standardisation release. Added /specifications/versioning/ (Semantic Versioning 2.0.0 commitments, deprecation timeline, lifecycle), /specifications/governance/ (proposal lifecycle, editorial process, working principles), /specifications/security-privacy/ (trust model, content-injection patterns, GDPR considerations, integrity primitives roadmap), and /specifications/http-behaviour/ (status codes, redirects, soft-404 detection, caching, rate limits). No normative requirements changed.

1.2.0

Phase 2 standardisation release. Added formal conformance specification (Essential / Recommended / Complete classes). Published machine-readable registry at /specifications/registry.json, spec meta-schema, and validator-output schema. Introduced versioned JSON Schema URLs (/v1/) alongside unversioned 'latest' aliases. Added optional BCP 47 language declaration field across all applicable AI Discovery Files. No normative requirements changed.

1.1.0

Phase 1 standardisation release. Added 'Status of This Document' block (Stable). Normalised normative requirement keywords to uppercase per RFC 2119 and RFC 8174. Added References section linking to /specifications/conventions/ and /licensing/. No normative requirements changed.

1.0.2

Added AI Visibility Directory registration guidance. Minor documentation update.

1.0.1

Clarified that tiers are cumulative. Each tier includes all files from previous tiers. Added explicit notes throughout the guide.

1.0.0

Initial publication. Three-tier implementation guide with Essential (2 files), Recommended (6 files), and Complete (10 files) tiers.

References

Free WordPress Plugin

Generate AI Discovery Files from your dashboard

Using WordPress? Install the plugin and create all 10 files in minutes — no coding, no configuration files to edit manually.

Get the Plugin

Register in the AI Visibility Directory

Once your AI Discovery Files are published, register your website in the AI Visibility Directory — the verified registry of websites implementing AI Discovery Files. Registration validates your implementation and lists your site for AI systems and industry peers to discover.

Basic Listing

Card entry in the directory with automated file validation. Open to any site with a valid llms.txt file. No cost.

Full Listing Recommended

Dedicated profile page on the directory with dofollow backlinks to your website — a genuine SEO authority signal from a topically relevant, verified source. Includes an attribution badge and enhanced visibility.