AI readiness leaderboard · SEO tools
AI readiness of spyfu.com: 75/100
75/100
We checked spyfu.com on 2026-10-18 with our free checker: six scored tests plus evidence for each finding. The score reflects the site on that date. The site may have changed after that date.
| Test | Result | Points |
|---|---|---|
| llms.txt | No | 0 of 15 |
| JSON-LD schema on the homepage | Yes | 20 of 20 |
| Meta description | No | 0 of 10 |
| Text readable without JavaScript | Yes | 20 of 20 |
| Sitemap | Yes | 10 of 10 |
| AI crawlers allowed in robots.txt | 8 of 8 | 25 of 25 |
Compared with SEO tools
spyfu.com ranks 16 of 20 seo tools sites in this scan (ties share the order by domain name). The median score in this group is 85. 6 of 20 have an llms.txt file.
Findings with evidence
FixHomepage serves a bot challenge page to automated clients
Our checker got a challenge page instead of your content: SpyFu - Competitor Keyword Research Tools for Google Ads PPC & SEO. Findings below describe that page, not your real homepage.
Fix: AI crawlers get the same challenge and cannot read your site. In your CDN or firewall (Cloudflare, Akamai, Imperva), allow verified AI search bots, or lower the bot protection level on public pages.
FixNo llms.txt
GET /llms.txt returned 404.
Fix: Create /llms.txt: a # title, a > one-line summary, then ## sections that list key pages as [name](url). Draft one free at checkaiready.com/llms-txt-generator.
FixJSON-LD: 1 block, types none
A JSON-LD block is not valid JSON, so parsers skip it.
Fix: Fix the listed properties, then retest at validator.schema.org.
ImproveTitle, 66 characters
<title>SpyFu - Competitor Keyword Research Tools for Google Ads PPC & SEO</title>
Fix: Shorten to about 50 to 60 characters so tools do not cut it off.
FixNo meta description
No <meta name="description"> tag.
Fix: Add <meta name="description" content="..."> with one or two sentences, 120 to 160 characters, that say what you offer.
ImproveNo canonical link
No <link rel="canonical"> in <head>.
Fix: Add <link rel="canonical" href="https://spyfu.com/"> so crawlers know which URL to cite.
FixServer responded in 2109 ms
Time to response headers from our checker, after 1 redirect. Final URL: https://www.spyfu.com/
Fix: Slow responses can make crawlers give up. Add page caching or a CDN in front of the homepage.
14 checks passed or noted
PassGPTBot (OpenAI, training): allowed on /
User-agent: * Disallow: /*?query=* Disallow: /*&query=* Disallow: *leads?* Disallow: *?titleSlug=* Allow: *?listId=3$ (74 more lines) Group "*" has no rule for /.
PassOAI-SearchBot (OpenAI, ChatGPT search): allowed on /
User-agent: * Disallow: /*?query=* Disallow: /*&query=* Disallow: *leads?* Disallow: *?titleSlug=* Allow: *?listId=3$ (74 more lines) Group "*" has no rule for /.
PassChatGPT-User (OpenAI, live fetch for users): allowed on /
User-agent: ChatGPT-User Allow: /*?query=* Allow: /*&query=* Disallow: *leads?* Disallow: *?titleSlug=* Allow: *?listId=3$ (74 more lines) Group "chatgpt-user" has no rule for /.
PassClaudeBot (Anthropic, training): allowed on /
User-agent: * Disallow: /*?query=* Disallow: /*&query=* Disallow: *leads?* Disallow: *?titleSlug=* Allow: *?listId=3$ (74 more lines) Group "*" has no rule for /.
PassClaude-SearchBot (Anthropic, Claude search): allowed on /
User-agent: * Disallow: /*?query=* Disallow: /*&query=* Disallow: *leads?* Disallow: *?titleSlug=* Allow: *?listId=3$ (74 more lines) Group "*" has no rule for /.
PassPerplexityBot (Perplexity, search index): allowed on /
User-agent: * Disallow: /*?query=* Disallow: /*&query=* Disallow: *leads?* Disallow: *?titleSlug=* Allow: *?listId=3$ (74 more lines) Group "*" has no rule for /.
PassGoogle-Extended (Google, Gemini training control): allowed on /
User-agent: * Disallow: /*?query=* Disallow: /*&query=* Disallow: *leads?* Disallow: *?titleSlug=* Allow: *?listId=3$ (74 more lines) Group "*" has no rule for /.
PassCCBot (Common Crawl, open dataset): allowed on /
User-agent: * Disallow: /*?query=* Disallow: /*&query=* Disallow: *leads?* Disallow: *?titleSlug=* Allow: *?listId=3$ (74 more lines) Group "*" has no rule for /.
PassOpen Graph tags present
og:title: SpyFu - Competitor Keyword Research Tools for Google Ads PPC & SEO og:description: Search for a competitor. See their PPC and SEO secrets, download their best keywords, get… og:image: https://cdn1.spyfu.com/dist/img/og/spyfu-og.webp
PassLanguage declared: en
<html lang="en">
Pass1 H1 heading
<h1>Win in AI & Google Search</h1>
Pass11,397 characters of text without JavaScript
Text starts: "SpyFu - Competitor Keyword Research Tools for Google Ads PPC & SEO What's New Blog API Resources Pricing Log in Sign Up Win in AI & Google Search Transform y…"
PassSitemap found, 51 URLs
robots.txt: Sitemap: https://www.spyfu.com/sitemap.xml GET https://www.spyfu.com/sitemap.xml returned 200.
PassHTML size 282 KB, 45 script tags
0 render-blocking scripts in <head>
Is this your site? Run a fresh free check. Get the $19 deep report (up to 25 pages, 18 AI agents per path), or add an AI-ready badge after your check.
Scoring: llms.txt 15, JSON-LD 20, meta description 10, readable text 20, sitemap 10, AI crawler access 25. Want this page changed or removed? Email [email protected].
Get an email when AI crawlers, robots.txt rules, or llms.txt practice change. At most twice a month.
We send a confirmation link first. See the privacy policy.