Free website check
llms.txt checker
Check whether your website publishes a readable llms.txt file, then review crawlability, robots.txt, sitemaps, and structured data in a free scan.
What to check
An llms.txt file is a Markdown guide to your website for language models. Check its availability and useful content alongside the signals that help crawlers access your pages.
llms.txt availability and content
Check that /llms.txt is accessible as text or Markdown, with more than 200 characters, headings, and at least one absolute URL.
Crawlability and robots.txt
Review whether the page can be fetched and whether crawler rules block access.
Sitemap discovery
Check for a readable XML sitemap that helps crawlers find your content.
Structured data and readable HTML
Review structured data and semantic HTML so the guide points to pages with useful context.
Beyond a robots.txt check
Robots.txt expresses crawler access rules. It does not tell you whether a page has readable content, useful structured data, a discoverable sitemap, or a clear llms.txt guide. LLM Scan checks these signals together and suggests fixes you can review and apply. A good technical score does not guarantee inclusion or citations in AI answers.