AI readiness leaderboard · Automation
AI readiness of bardeen.ai: 53/100
53/100
We checked bardeen.ai on 2026-10-18 with our free checker: six scored tests plus evidence for each finding. The score reflects the site on that date. The site may have changed after that date.
| Test | Result | Points |
|---|---|---|
| llms.txt | No | 0 of 15 |
| JSON-LD schema on the homepage | No | 0 of 20 |
| Meta description | Yes | 10 of 10 |
| Text readable without JavaScript | Yes | 20 of 20 |
| Sitemap | Yes | 10 of 10 |
| AI crawlers allowed in robots.txt | 4 of 8 | 12 of 25 |
Compared with Automation
bardeen.ai ranks 18 of 19 automation sites in this scan (ties share the order by domain name). The median score in this group is 100. 14 of 19 have an llms.txt file.
Findings with evidence
ImproveGPTBot (OpenAI, training): blocked on /
User-agent: GPTBot Disallow: / Matching rule: "disallow: /" in group "gptbot".
Fix: This bot is used for training. Blocking it is a valid choice. To allow it, add:
User-agent: GPTBot
Allow: /
ImproveClaudeBot (Anthropic, training): blocked on /
User-agent: ClaudeBot Disallow: / Matching rule: "disallow: /" in group "claudebot".
Fix: This bot is used for training. Blocking it is a valid choice. To allow it, add:
User-agent: ClaudeBot
Allow: /
ImproveGoogle-Extended (Google, Gemini training control): blocked on /
User-agent: Google-Extended Disallow: / Matching rule: "disallow: /" in group "google-extended".
Fix: This bot is used for Gemini training control. Blocking it is a valid choice. To allow it, add:
User-agent: Google-Extended
Allow: /
ImproveCCBot (Common Crawl, open dataset): blocked on /
User-agent: CCBot Disallow: / Matching rule: "disallow: /" in group "ccbot".
Fix: This bot is used for open dataset. Blocking it is a valid choice. To allow it, add:
User-agent: CCBot
Allow: /
FixNo llms.txt
GET /llms.txt returned 404.
Fix: Create /llms.txt: a # title, a > one-line summary, then ## sections that list key pages as [name](url). Draft one free at checkaiready.com/llms-txt-generator.
FixNo JSON-LD structured data on the homepage
No <script type="application/ld+json"> block in the HTML we received.
Fix: Add an Organization (or LocalBusiness) JSON-LD block to the homepage with name, url, logo, and sameAs links. The $19 report includes a ready-to-paste block for your site.
FixServer responded in 2049 ms
Time to response headers from our checker, after 1 redirect. Final URL: https://www.bardeen.ai/
Fix: Slow responses can make crawlers give up. Add page caching or a CDN in front of the homepage.
13 checks passed or noted
PassOAI-SearchBot (OpenAI, ChatGPT search): allowed on /
No group names this bot and there is no * group.
PassChatGPT-User (OpenAI, live fetch for users): allowed on /
No group names this bot and there is no * group.
PassClaude-SearchBot (Anthropic, Claude search): allowed on /
No group names this bot and there is no * group.
PassPerplexityBot (Perplexity, search index): allowed on /
No group names this bot and there is no * group.
PassTitle, 46 characters
<title>Bardeen: Find and reach leads no one else can.</title>
PassMeta description, 103 characters
content="Source leads with our agentic web scraper, qualify them with AI and reach them with contact enrichment."
PassOpen Graph tags present
og:title: Bardeen: Find and reach leads no one else can. og:description: Source leads with our agentic web scraper, qualify them with AI and reach them with conta… og:image: https://cdn.prod.website-files.com/67a4e756231fbcd6386ec06a/691114ccec0d8e60edae6ee4_Meta…
PassCanonical link set
<link rel="canonical" href="https://www.bardeen.ai">
PassLanguage declared: en
<html lang="en">
Pass1 H1 heading
<h1>Find and reach leads no one else can.</h1>
Pass9,145 characters of text without JavaScript
Text starts: "Bardeen: Find and reach leads no one else can. Home Product Web Scraper The most powerful web scraper on the internet. Web Search Stop Googling your leads manu…"
PassSitemap found, 2,391+ URLs
robots.txt: Sitemap: https://www.bardeen.ai/sitemap.xml GET https://www.bardeen.ai/sitemap.xml returned 200.
PassHTML size 172 KB, 22 script tags
2 render-blocking scripts in <head>: https://ajax.googleapis.com/ajax/libs/webfont/1.6.26/webfont.js
Fix: Add defer or async to scripts in <head> that are not needed for first paint.
Is this your site? Run a fresh free check. Get the $19 deep report (up to 25 pages, 18 AI agents per path), or add an AI-ready badge after your check.
Scoring: llms.txt 15, JSON-LD 20, meta description 10, readable text 20, sitemap 10, AI crawler access 25. Want this page changed or removed? Email [email protected].
Get an email when AI crawlers, robots.txt rules, or llms.txt practice change. At most twice a month.
We send a confirmation link first. See the privacy policy.