LIVE REPORT

Domain crawl report for allensboots.com

This report is based on a stored AlphaCrawler crawl snapshot and summary metrics.

Stored crawl snapshot available.

allensboots.com Website Score

36 checks passed out of 57
36 of 100
Crawled pages: 449 Indexed pages: 448 5xx Server Errors: 0 Broken pages: 379
40 / 100

AI readiness

Needs work

AI search crawlers are allowed and the homepage content is readable without JavaScript. Review the breakdown below to push the score higher.

AI crawler access (from robots.txt)

No robots.txt found — by default every crawler below is allowed.

Googlebot
Google · Google Search & AI Overviews
 Allowed
Google-Extended
Google · Gemini grounding & training
 Allowed
GPTBot
OpenAI · ChatGPT training & retrieval
 Allowed
OAI-SearchBot
OpenAI · ChatGPT Search index
 Allowed
ChatGPT-User
OpenAI · ChatGPT live browsing
 Allowed
ClaudeBot
Anthropic · Claude crawler
 Allowed
Claude-User
Anthropic · Claude live browsing
 Allowed
PerplexityBot
Perplexity · Perplexity index
 Allowed
Perplexity-User
Perplexity · Perplexity live fetch
 Allowed
Bingbot
Microsoft · Bing & Copilot
 Allowed
Applebot-Extended
Apple · Apple Intelligence training
 Allowed
CCBot
Common Crawl · Open dataset many LLMs use
 Allowed
Meta-ExternalAgent
Meta · Meta AI training
 Allowed
Bytespider
ByteDance · ByteDance / TikTok AI
 Allowed
Amazonbot
Amazon · Alexa & Amazon AI
 Allowed

llms.txt & on-page signals

  • ✗ llms.txt — not found (optional)
  • ✓ Content without JavaScript — readable in raw HTML (0 words)
  • ✗ Structured data — none found
  • ✗ Title & meta — title missing, meta description missing
  • ✗ Headings — 0 H1, 0 H2 clear structure helps engines extract answers

How the score is calculated

AI search engines can crawl the site
No answer-engine crawlers are blocked in robots.txt.
40 / 40
Main content is in the HTML (no JS required)
Homepage could not be fetched for rendering analysis.
0 / 20
Structured data (Schema.org) present
No JSON-LD structured data found. Schema helps engines understand entities and answers.
0 / 15
Clear, answerable page structure
Missing or empty: title tag, meta description, H1, H2 subheadings.
0 / 15
llms.txt published (optional)
No llms.txt found. Optional: it curates which URLs matter for AI tools. Not used by Google.
0 / 10
Critical Errors allensboots.com
447 issues
Critical errors are the issues that have the highest impact on your overall SEO performance allensboots.com
Warnings allensboots.com
382 issues
Warnings are less impactful errors to your overall SEO performance allensboots.com
Notices allensboots.com
64 issues
Notices have little or no impact on your SEO performance but are still important to be aware of and correct allensboots.com
allensboots.com Urgentpages total:
WeightStatus CodeUrlIssues
27.78 200 https://www.allensboots.com/pages/faq
Description too long More than one Title tag on page Page has links to broken page
27.78 200 https://www.allensboots.com/
More than one Title tag on page Duplicate Description Page has links to broken page
100 200 https://www.allensboots.com/collections/cowboy-styles
Title too short More than one Title tag on page Description is missing Duplicate Description Page has links to broken page
27.78 200 https://www.allensboots.com/collections/mens-accessories-belts
Title too short More than one Title tag on page Description is missing Duplicate Description Page has links to broken page
27.78 200 https://www.allensboots.com/pages/allens-custom-boots
Title too short More than one Title tag on page Description is missing Duplicate Description Page has links to broken page
31.48 200 https://www.allensboots.com/products/allens-cap-allens-boot-arch-alc50 ...
Description too short More than one Title tag on page Page has links to broken page
31.48 200 https://www.allensboots.com/products/allens-cap-allens-rope-alc5043
Description too short More than one Title tag on page Page has links to broken page
31.48 200 https://www.allensboots.com/products/allens-shirt-allens-tx-orange-alt ...
Description too short More than one Title tag on page Page has links to broken page
27.78 200 https://www.allensboots.com/collections/belts-1
Title too short More than one Title tag on page Description is missing Duplicate Description Page has links to broken page
27.78 200 https://www.allensboots.com/pages/contacts
Title too short Description too short More than one Title tag on page Page has links to broken page
Issues allensboots.com
Broken page:  379
Description is empty:  1
H1 is missing:  6
More than one Title tag on page:  67
Description is missing:  34
HTTPS/HTTP mixed internal links:  3
4xx Client errors:  379
Duplicate Title:  381
Duplicate H1:  387
Duplicate Description:  418
Page has links to broken page:  68
Page has links to redirect:  1
301 Redirects:  2
Redirect:  2
Meta Noindex Pages:  1
Title too short:  43
H1 too long:  3
H1 too short:  2
Description too long:  1
Description too short:  17
Canonical is missing:  1

Related tools

Tool

Website Crawler

Use this tool to investigate the signal category highlighted in the report.

Tool

Broken Link Checker

Use this tool to investigate the signal category highlighted in the report.

Tool

Redirect Checker

Use this tool to investigate the signal category highlighted in the report.

Tool

Meta Tag Checker

Use this tool to investigate the signal category highlighted in the report.

Free online technical SEO crawler with focused tools, learning resources, and shareable report pages.

Sections

Company

Popular crawler tools

Link exchange