ahrefs.comscanned May 24, 2026 · 08:321.91s
Public AI visibility report

ahrefs.comAI visibilityNeeds Work

This site has a useful foundation, but important gaps still limit AI readability.

Key strengths include sitemap and structured data, while AI guidance file and plain-text page access need attention.

Recommended next step

publish an AI guidance file as text or markdown with more than 200 characters, markdown headings, and at least one absolute URL.

Why monitor after one scan?

AI visibility changes when teams ship new pages, edit pricing or docs, update sitemaps, or change crawler rules. Weekly monitoring catches those silent regressions before answer engines and agents start reading stale or broken signals.

Monitor weekly

Overall score

46/100
Needs Work
Go to fixesOverall position285 out of 491Leaderboard

// score breakdown

Points by check

8 checks

Crawlability10/20
Robots.txt7.5/15
llms.txt0/15
Sitemap10/10
Markdown support0/15
Semantic HTML8.6/10
Structured data10/10
Content signals0/5
2pass3warn3fail

Public link

llmscan.dev/scan/7JrnBT9RT9sO0Aft9DgwR

Signals checked

8 AI visibility signals

Fix bundle

4 copy-ready files

Share badge

Needs Work · 46/100

Add a polished proof badge

A compact badge for footer, press, or trust sections that links visitors to this public report.

Embed codellmscan.dev/scan/7JrnBT9RT9sO0Aft9DgwR
<a href="https://www.llmscan.dev/scan/7JrnBT9RT9sO0Aft9DgwR"
  target="_blank"
  rel="noopener"
>
  <img
    src="https://www.llmscan.dev/scan/7JrnBT9RT9sO0Aft9DgwR/badge.png"
    alt="LLM Scan AI visibility score badge"
    width="460"
    height="120"
    style="width: 260px; max-width: 100%; height: auto;"
  />
</a>
Open badge
L
LLM Scan
Needs Work
Score
46/100

Share your score

Post the public report with: “We scored 46/100 for AI-readability.”

Download fixes

Grab generated files and implementation notes for the highest-impact gaps.

Rescan weekly

Save this domain to catch regressions after content, sitemap, or robots changes.

Monitor weekly

// signal breakdown

8 signals AI systems depend on

The homepage is reachable, but robots.txt contains AI crawler restrictions for GPTBot, ChatGPT-User, ClaudeBot, Claude-Web, PerplexityBot, and Google-Extended.

Signal weight

10/20
Warn

Evidence

url
https://ahrefs.com/
finalUrl
https://ahrefs.com/
status
200

Recommendation

Next step: Review AI crawler Disallow rules and keep only the paths that should be excluded from AI crawler access; serve a non-empty HTML homepage with a canonical link tag.

robots.txt contains AI-crawler path blocks for GPTBot, ChatGPT-User, ClaudeBot, Claude-Web, PerplexityBot, and Google-Extended.

Signal weight

8/15
Warn

Evidence

robotsTxtUrl
https://ahrefs.com/robots.txt
exists
true
rawRobotsTxt
User-agent: * Disallow: /article Disallow: /site-explorer/ajax/ Allow: /site-explorer/$ Disallow: /site-explorer/* Allow: /link-intersect/$ Disallow: /link-intersect/* Disallow: /v4* Disallow: /blog/*?s=* Disallow: /blog/*?archive* Disallow: /seo/for/*?*draft Disallow: /academy/*?*draft Disallow: /seo-toolbar/welcome Disallow: /seo-toolbar/uninstall Disallow: /*/seo-toolbar/welcome Disallow: /*/seo-toolbar/uninstall Disallow: /*?input Disallow: /draft/* Disallow: /academy/draft/* Allow: /agencies/*?services[]=* Allow: /agencies/*&services[]=* Disallow: /agencies/*?*languages[]=* Disallow: /agencies/*&*languages[]=* Disallow: /agencies/*?*industries[]=* Disallow: /agencies/*&*industries[]=* Disallow: /agencies/*?*budget=* Disallow: /agencies/*&*budget=* Disallow: /agencies/*?*businessSize=* Disallow: /agencies/*&*businessSize=* Disallow: /cdn-cgi/ Disallow: /writing-tools/experimental-tools.json

Recommendation

Next step: Review AI crawler Disallow rules and keep only the paths that should be excluded from AI crawler access.

No llms.txt file was found for this site.

Signal weight

0/15
Fail

Evidence

llmsTxtUrl
https://ahrefs.com/llms.txt
present
false
accessible
false

Recommendation

Next step: Publish /llms.txt as text or markdown with more than 200 characters, markdown headings, and at least one absolute URL.

The sitemap index is valid and the checked child sitemap contains URL entries.

Signal weight

10/10
Pass

Evidence

sitemapUrl
https://ahrefs.com/sitemap.xml
sitemapUrls
[https://ahrefs.com/sitemap.xml]
robotsSitemapUrls
[]

The homepage returned HTML when requested with Accept: text/markdown, so the server appears to ignore markdown content negotiation.

Signal weight

0/15
Fail

Evidence

url
https://ahrefs.com/
acceptHeader
text/markdown
status
200

Recommendation

Next step: Add content negotiation for Accept: text/markdown on the homepage and return a markdown representation with Content-Type: text/markdown. Keep the HTML response for regular browser requests.

The homepage has some semantic HTML signals, but one or more title, metadata, heading, landmark, content, or link text checks need improvement.

Signal weight

9/10
Warn

Evidence

url
https://ahrefs.com/
quality
partial
score
86

Recommendation

Next step: Add missing semantic elements: main, article.

Valid JSON-LD structured data was found with core Organization or WebSite schema.org types.

Signal weight

10/10
Pass

Evidence

url
https://ahrefs.com/
quality
good
hasStructuredData
true

Content-Signal directive not detected in headers, HTML metadata, or robots.txt.

Signal weight

0/5
Fail

Evidence

url
https://ahrefs.com/
hasContentSignals
false
hasContentSignalHeader
false

Recommendation

Next step: Add the standard directive 'Content-Signal: ai-train=no, search=yes, ai-input=yes' to robots.txt, HTML metadata, or HTTP headers so AI systems can discover content usage preferences.

// generated fixes

Downloadable fix files

Preview the generated files below. Enter your email to reveal the full fixes, download the bundle, or copy the agent-ready implementation prompt.

Done-for-you

Agency package

Not sure how to ship the technical fixes? Book a call and we can help turn this report into implemented updates.

Fix planning from your scan

Implementation guidance

AI visibility monitoring

llms.txtMarkdown
# Ahrefs—AI Marketing Platform Powered by Big Data > We help marketers drive visibility across AI search, SEO, content, and social – with the largest AI and search databases online. This llms.txt file summarizes the public, canonical resources that AI assistants and crawlers should use to understand this site. ## Site Overview - Canonical URL: https://ahrefs.com/- Site type: organization
robots.txtTXT
# robots.txt additions# Copy these blocks into the existing robots.txt file. Keep current rules unless a note calls out a conflicting Disallow. # Sitemap discovery# Add this top-level directive so search and AI crawlers can discover the canonical sitemap.Sitemap: https://ahrefs.com/sitemap.xml # AI crawler access# Add explicit Allow rules for blocked AI crawlers; remove or narrow conflicting Disallow rules if your crawler target requires precedence.User-agent: GPTBot
schema.jsonJSON
{  "@context": "https://schema.org",  "@graph": [    {      "@type": "Organization",      "@id": "https://ahrefs.com/#organization",      "name": "Ahrefs—AI Marketing Platform Powered by Big Data",      "description": "We help marketers drive visibility across AI search, SEO, content, and social – with the largest AI and search databases online.",      "url": "https://ahrefs.com/",      "logo": "https://ahrefs.com/assets/esbuild/ebay-DKUVDV7P.svg",
head metaHTML
# Content-Signal recommendations Use these directives to make AI-use preferences explicit for compliant crawlers and AI systems. They are advisory signals, so keep them aligned with robots.txt, terms, and access controls. ## Recommended values - ai-train=no: AI model training, fine-tuning, and dataset creation.- search=yes: AI search indexing, snippets, and discovery.- ai-input=yes: AI answer grounding, retrieval, and generated-response context.