Website Crawler
Use this tool to investigate the signal category highlighted in the report.
This report is based on a stored AlphaCrawler crawl snapshot and summary metrics.
Stored crawl snapshot available.
13 Jul 2026 14:55:37
Crawling time:00:00:33
Pages/Seconds1.9
AI search crawlers are allowed and the homepage content is readable without JavaScript. Review the breakdown below to push the score higher.
No robots.txt found — by default every crawler below is allowed.
| Googlebot Google · Google Search & AI Overviews | Allowed |
| Google-Extended Google · Gemini grounding & training | Allowed |
| GPTBot OpenAI · ChatGPT training & retrieval | Allowed |
| OAI-SearchBot OpenAI · ChatGPT Search index | Allowed |
| ChatGPT-User OpenAI · ChatGPT live browsing | Allowed |
| ClaudeBot Anthropic · Claude crawler | Allowed |
| Claude-User Anthropic · Claude live browsing | Allowed |
| PerplexityBot Perplexity · Perplexity index | Allowed |
| Perplexity-User Perplexity · Perplexity live fetch | Allowed |
| Bingbot Microsoft · Bing & Copilot | Allowed |
| Applebot-Extended Apple · Apple Intelligence training | Allowed |
| CCBot Common Crawl · Open dataset many LLMs use | Allowed |
| Meta-ExternalAgent Meta · Meta AI training | Allowed |
| Bytespider ByteDance · ByteDance / TikTok AI | Allowed |
| Amazonbot Amazon · Alexa & Amazon AI | Allowed |
| Weight | Status Code | Url | Issues |
|---|---|---|---|
| 27.78 | 200 |
https://www.thefoundationguys.co/
Title: Lakewood Foundation Services | The Found ... Description: We offer solid solutions for shaky situa ... H1: Lakewood, CO Foundation Services |
Favicon is not found
Duplicate Title
Duplicate H1
Duplicate Description
|
| 27.78 | 200 |
https://www.thefoundationguys.co/foundation-repair/sloping-floor-repai ...
Title: Uneven Floor Repair Services in Lakewood ... Description: Sloping floors in Lakewood can point to ... H1: Sloping Floor Repair in Lakewood |
Favicon is not found
|
| 27.78 | 200 |
https://www.thefoundationguys.co/areas-we-serve/golden-co/foundation-r ...
Title: Foundation Crack Repair Company in Golde ... Description: Noticing settling, wall cracks, or bowin ... H1: Foundation Repair in Golden, CO |
Favicon is not found
|
| 27.78 | 200 |
https://www.thefoundationguys.co/contact-us/
Title: Contact Us | Lakewood Foundation Repair ... Description: Contact Us. Our team at The Foundation G ... H1: We Are Ready to Help Contact The Foundat ... |
Favicon is not found
|
| 27.78 | 200 |
https://www.thefoundationguys.co/areas-we-serve/littleton-co/foundatio ...
Title: Foundation Repair in Littleton | The Fou ... Description: Seeing cracks or uneven floors? Get reli ... H1: Littleton Foundation Repair |
Favicon is not found
|
| 27.78 | 200 |
https://www.thefoundationguys.co/site-search/
Title: Site Search | Lakewood Foundation Repair ... Description: Site Search. Our team at The Foundation ... H1: [empty] |
Meta Nofollow Pages
Meta Noindex Pages
H1 is missing
Favicon is not found
Duplicate H1
|
| 27.78 | 200 |
https://www.thefoundationguys.co/basement-waterproofing/sump-pump-inst ...
Title: Lakewood Sump Pump Installation | The Fo ... Description: Keep your Lakewood basement dry with pro ... H1: Lakewood, CO Sump Pump Installation |
Favicon is not found
|
| 27.78 | 200 |
https://www.thefoundationguys.co/areas-we-serve/littleton-co/basement- ...
Title: Basement Waterproofing in Littleton | Th ... Description: Worried about water in your basement? Ge ... H1: Littleton Basement Waterproofing |
Favicon is not found
|
| 27.78 | 200 |
https://www.thefoundationguys.co/concrete-services/foundation-installa ...
Title: Lakewood, CO Foundation Installation | T ... Description: We use durable materials and precision c ... H1: Lakewood Foundation Installation |
Favicon is not found
|
| 27.78 | 200 |
https://www.thefoundationguys.co/basement-waterproofing/trench-french- ...
Title: Lakewood Trench & French Drains | The Fo ... Description: Trench and French drain installation in ... H1: Concrete Trench Drains & French Drain So ... |
Favicon is not found
|