veedcrawl.comscanned May 26, 2026 · 13:551.02s
Public AI visibility report

veedcrawl.comAI visibilityAI-Readable

This site is mostly readable by AI tools, with a few improvements still recommended.

Key strengths include AI guidance file and plain-text page access, while structured data and homepage access need attention.

Recommended next step

add JSON-LD structured data with Organization or WebSite schema so AI systems can identify the site owner or website entity.

Why monitor after one scan?

AI visibility changes when teams ship new pages, edit pricing or docs, update sitemaps, or change crawler rules. Weekly monitoring catches those silent regressions before answer engines and agents start reading stale or broken signals.

Monitor weekly

Overall score

70/100
AI-Readable
Go to fixesOverall position68 out of 491Leaderboard

// score breakdown

Points by check

8 checks

Crawlability10/20
Robots.txt7.5/15
llms.txt15/15
Sitemap10/10
Markdown support15/15
Semantic HTML7.1/10
Structured data0/10
Content signals5/5
4pass3warn1fail

Public link

llmscan.dev/scan/OcQSdqHX2jawaHI-XjCJl

Signals checked

8 AI visibility signals

Fix bundle

4 copy-ready files

Share badge

AI-Readable · 70/100

Add a polished proof badge

A compact badge for footer, press, or trust sections that links visitors to this public report.

Embed codellmscan.dev/scan/OcQSdqHX2jawaHI-XjCJl
<a href="https://www.llmscan.dev/scan/OcQSdqHX2jawaHI-XjCJl"
  target="_blank"
  rel="noopener"
>
  <img
    src="https://www.llmscan.dev/scan/OcQSdqHX2jawaHI-XjCJl/badge.png"
    alt="LLM Scan AI visibility score badge"
    width="460"
    height="120"
    style="width: 260px; max-width: 100%; height: auto;"
  />
</a>
Open badge
L
LLM Scan
AI-Readable
Score
70/100

Share your score

Post the public report with: “We scored 70/100 for AI-readability.”

Download fixes

Grab generated files and implementation notes for the highest-impact gaps.

Rescan weekly

Save this domain to catch regressions after content, sitemap, or robots changes.

Monitor weekly

// signal breakdown

8 signals AI systems depend on

The homepage is reachable, but no canonical link tag was found and robots.txt contains AI crawler restrictions for GPTBot, ChatGPT-User, ClaudeBot, Claude-Web, PerplexityBot, and Google-Extended.

Signal weight

10/20
Warn

Evidence

url
https://veedcrawl.com/
finalUrl
https://veedcrawl.com/
status
200

Recommendation

Next step: Review AI crawler Disallow rules and keep only the paths that should be excluded from AI crawler access; serve a non-empty HTML homepage with a canonical link tag.

The robots.txt file was found, but it contains formatting issues.

Signal weight

8/15
Warn

Evidence

robotsTxtUrl
https://veedcrawl.com/robots.txt
exists
true
rawRobotsTxt
User-agent: * Allow: / Disallow: /dashboard/ Disallow: /api/ User-agent: GPTBot Allow: / Disallow: /dashboard/ Disallow: /api/ User-agent: OAI-SearchBot Allow: / Disallow: /dashboard/ Disallow: /api/ User-agent: ChatGPT-User Allow: / Disallow: /dashboard/ Disallow: /api/ User-agent: ClaudeBot Allow: / Disallow: /dashboard/ Disallow: /api/ User-agent: PerplexityBot Allow: / Disallow: /dashboard/ Disallow: /api/ User-agent: Applebot Allow: / Disallow: /dashboard/ Disallow: /api/ User-agent: CCBot Disallow: / Content-Signal: ai-train=no, search=yes, ai-input=yes Sitemap: https://veedcrawl.com/sitemap.xml

Recommendation

Next step: Fix robots.txt syntax issues so each rule uses Field: value format, directives appear under a User-agent, and Sitemap entries use absolute URLs.

The llms.txt file was found and includes the expected text, length, heading, and URL signals.

Signal weight

15/15
Pass

Evidence

llmsTxtUrl
https://veedcrawl.com/llms.txt
present
true
accessible
true

The sitemap.xml file is valid and contains URL entries.

Signal weight

10/10
Pass

Evidence

sitemapUrl
https://veedcrawl.com/sitemap.xml
sitemapUrls
[https://veedcrawl.com/sitemap.xml]
robotsSitemapUrls
[]

The homepage returns markdown content when requested with Accept: text/markdown, giving AI systems a cleaner text representation with less navigation chrome to parse.

Signal weight

15/15
Pass

Evidence

url
https://veedcrawl.com/
acceptHeader
text/markdown
status
200

The homepage has some semantic HTML signals, but one or more title, metadata, heading, landmark, content, or link text checks need improvement.

Signal weight

7/10
Warn

Evidence

url
https://veedcrawl.com/
quality
partial
score
71

Recommendation

Next step: Shorten the meta description to 160 characters or fewer. Avoid skipped heading levels so sections progress from h1 to h2 to h3 without gaps.

No JSON-LD, Microdata, or RDFa structured data was found on the page.

Signal weight

0/10
Fail

Evidence

url
https://veedcrawl.com/
quality
none
hasStructuredData
false

Recommendation

Next step: Add JSON-LD structured data with Organization or WebSite schema so AI systems can identify the site owner or website entity.

AI content usage signals detected via Content-Signal HTTP headers, Content-Signal robots.txt directives.

Signal weight

5/5
Pass

Evidence

url
https://veedcrawl.com/
hasContentSignals
true
hasContentSignalHeader
true

Recommendation

Next step: Consider adding AI-specific head meta tags, robots noai/noimageai directive so AI systems can consistently discover content usage preferences across robots.txt, HTTP headers, and HTML metadata.

// generated fixes

Downloadable fix files

Preview the generated files below. Enter your email to reveal the full fixes, download the bundle, or copy the agent-ready implementation prompt.

Done-for-you

Agency package

Not sure how to ship the technical fixes? Book a call and we can help turn this report into implemented updates.

Fix planning from your scan

Implementation guidance

AI visibility monitoring

llms.txtMarkdown
# Veedcrawl - Video intelligence API for AI agents > Give agents and applications the ability to understand social videos. Search, transcripts, metadata, and structured extraction from YouTube, TikTok, Instagram, X, and Facebook. This llms.txt file summarizes the public, canonical resources that AI assistants and crawlers should use to understand this site. ## Site Overview - Canonical URL: https://veedcrawl.com/- Site type: website
robots.txtTXT
# robots.txt additions# Copy these blocks into the existing robots.txt file. Keep current rules unless a note calls out a conflicting Disallow. # AI crawler access# Add explicit Allow rules for blocked AI crawlers; remove or narrow conflicting Disallow rules if your crawler target requires precedence.User-agent: GPTBotAllow: / User-agent: ChatGPT-UserAllow: /
schema.jsonJSON
{  "@context": "https://schema.org",  "@graph": [    {      "@type": "Organization",      "@id": "https://veedcrawl.com/#organization",      "name": "Veedcrawl - Video intelligence API for AI agents",      "description": "Give agents and applications the ability to understand social videos. Search, transcripts, metadata, and structured extraction from YouTube, TikTok, Instagram, X, and Facebook.",      "url": "https://veedcrawl.com/",      "logo": "https://veedcrawl.com/_next/image?url=%2Fveedcrawl_icon.png&w=96&q=75",
head metaHTML
# Content-Signal recommendations Use these directives to make AI-use preferences explicit for compliant crawlers and AI systems. They are advisory signals, so keep them aligned with robots.txt, terms, and access controls. ## Recommended values - ai-train=no: AI model training, fine-tuning, and dataset creation.- search=yes: AI search indexing, snippets, and discovery.- ai-input=yes: AI answer grounding, retrieval, and generated-response context.