LIVE REPORT

Domain crawl report for thebrainwave.org

This report is based on a stored AlphaCrawler crawl snapshot and summary metrics.

Stored crawl snapshot available.

thebrainwave.org Website Score

34 checks passed out of 57
53 of 100
Crawled pages: 46 Indexed pages: 43 5xx Server Errors: 0 Broken pages: 2
96 / 100

AI readiness

Excellent

AI search crawlers are allowed and the homepage content is readable without JavaScript. Review the breakdown below to push the score higher.

AI crawler access (from robots.txt)

No robots.txt found — by default every crawler below is allowed.

Googlebot
Google · Google Search & AI Overviews
 Allowed
Google-Extended
Google · Gemini grounding & training
 Allowed
GPTBot
OpenAI · ChatGPT training & retrieval
 Allowed
OAI-SearchBot
OpenAI · ChatGPT Search index
 Allowed
ChatGPT-User
OpenAI · ChatGPT live browsing
 Allowed
ClaudeBot
Anthropic · Claude crawler
 Allowed
Claude-User
Anthropic · Claude live browsing
 Allowed
PerplexityBot
Perplexity · Perplexity index
 Allowed
Perplexity-User
Perplexity · Perplexity live fetch
 Allowed
Bingbot
Microsoft · Bing & Copilot
 Allowed
Applebot-Extended
Apple · Apple Intelligence training
 Allowed
CCBot
Common Crawl · Open dataset many LLMs use
 Allowed
Meta-ExternalAgent
Meta · Meta AI training
 Allowed
Bytespider
ByteDance · ByteDance / TikTok AI
 Allowed
Amazonbot
Amazon · Alexa & Amazon AI
 Allowed

llms.txt & on-page signals

  • ✓ llms.txt — found
    – Missing the leading "# Title" line the spec expects
    ✓ Has a "> summary" blockquote
    ✓ 14 linked resources listed
    ✓ Uses "## Section" headings
  • ✓ Content without JavaScript — readable in raw HTML (1097 words)
  • ✓ Structured data — CollectionPage, BreadcrumbList, ListItem, WebSite, SearchAction, EntryPoint
  • ✓ Title & meta — title 42 chars, meta description 136 chars
  • ✓ Headings — 3 H1, 4 H2 clear structure helps engines extract answers

How the score is calculated

AI search engines can crawl the site
No answer-engine crawlers are blocked in robots.txt.
40 / 40
Main content is in the HTML (no JS required)
Readable text is present in the raw HTML.
20 / 20
Structured data (Schema.org) present
Found: CollectionPage, BreadcrumbList, ListItem, WebSite, SearchAction, EntryPoint, PropertyValueSpecification, Organization.
15 / 15
Clear, answerable page structure
Title, meta description, H1 and H2 subheadings are all present.
15 / 15
llms.txt published (optional)
An llms.txt file was found. It is an emerging, optional convention — Google does not use it, but some AI tools do.
6 / 10
Critical Errors thebrainwave.org
18 issues
Critical errors are the issues that have the highest impact on your overall SEO performance thebrainwave.org
Warnings thebrainwave.org
3 issues
Warnings are less impactful errors to your overall SEO performance thebrainwave.org
Notices thebrainwave.org
32 issues
Notices have little or no impact on your SEO performance but are still important to be aware of and correct thebrainwave.org
thebrainwave.org Urgentpages total:
WeightStatus CodeUrlIssues
0 302 https://thebrainwave.org/product/cookie-dough-slime-toy/?add-to-cart=2 ...
Non-301 Redirects 302 Redirects Redirect
0 302 https://thebrainwave.org/product/cookie-dough-slime-toy/?add-to-cart=2 ...
Non-301 Redirects 302 Redirects Redirect
0 200 https://thebrainwave.org/cart/
Meta Noindex Pages Title too long H1 too short
0 302 https://thebrainwave.org/product/glow-in-dark-dumpling-squishy-bao-bun ...
Non-301 Redirects 302 Redirects Redirect
0 302 https://thebrainwave.org/product/needoh/?add-to-cart=2538
Non-301 Redirects 302 Redirects Redirect
0 302 https://thebrainwave.org/product/needoh/?add-to-cart=2488
Non-301 Redirects 302 Redirects Redirect
0 302 https://thebrainwave.org/product-category/sensory-toys/?add-to-cart=25 ...
Non-301 Redirects 302 Redirects Redirect
0 302 https://thebrainwave.org/product-category/sensory-toys/?add-to-cart=24 ...
Non-301 Redirects 302 Redirects Redirect
0 302 https://thebrainwave.org/cart/?add-to-cart=2824
Non-301 Redirects 302 Redirects Redirect
0 302 https://thebrainwave.org/cart/?add-to-cart=2488
Non-301 Redirects 302 Redirects Redirect
Issues thebrainwave.org
Broken page:  2
More than one H1 on page:  2
H1 is missing:  12
Description is missing:  2
404 Page:  2
Canonical ≠ URL:  1
4xx Client errors:  2
Duplicate Title:  23
Duplicate H1:  31
Duplicate Description:  34
Page has links to broken page:  2
Page has links to redirect:  10
301 Redirects:  1
Redirect:  17
Non-301 Redirects:  16
Meta Noindex Pages:  3
Long URLs:  3
Title too long:  13
H1 too long:  2
H1 too short:  1
Description too long:  1
Description too short:  7
302 Redirects:  16

Related tools

Tool

Website Crawler

Use this tool to investigate the signal category highlighted in the report.

Tool

Broken Link Checker

Use this tool to investigate the signal category highlighted in the report.

Tool

Redirect Checker

Use this tool to investigate the signal category highlighted in the report.

Tool

Meta Tag Checker

Use this tool to investigate the signal category highlighted in the report.

Free online technical SEO crawler with focused tools, learning resources, and shareable report pages.

Sections

Company

Popular crawler tools

Link exchange