Website Crawler
Use this tool to investigate the signal category highlighted in the report.
This report is based on a stored AlphaCrawler crawl snapshot and summary metrics.
Stored crawl snapshot available.
25 Jun 2026 12:17:29
Crawling time:00:00:24
Pages/Seconds2.2
AI search crawlers are allowed and the homepage content is readable without JavaScript. Review the breakdown below to push the score higher.
No robots.txt found — by default every crawler below is allowed.
| Googlebot Google · Google Search & AI Overviews | Allowed |
| Google-Extended Google · Gemini grounding & training | Allowed |
| GPTBot OpenAI · ChatGPT training & retrieval | Allowed |
| OAI-SearchBot OpenAI · ChatGPT Search index | Allowed |
| ChatGPT-User OpenAI · ChatGPT live browsing | Allowed |
| ClaudeBot Anthropic · Claude crawler | Allowed |
| Claude-User Anthropic · Claude live browsing | Allowed |
| PerplexityBot Perplexity · Perplexity index | Allowed |
| Perplexity-User Perplexity · Perplexity live fetch | Allowed |
| Bingbot Microsoft · Bing & Copilot | Allowed |
| Applebot-Extended Apple · Apple Intelligence training | Allowed |
| CCBot Common Crawl · Open dataset many LLMs use | Allowed |
| Meta-ExternalAgent Meta · Meta AI training | Allowed |
| Bytespider ByteDance · ByteDance / TikTok AI | Allowed |
| Amazonbot Amazon · Alexa & Amazon AI | Allowed |
| Weight | Status Code | Url | Issues |
|---|---|---|---|
| 0 | 200 |
https://www.whenyouneedus.com/brain-injuries/mild-and-severe-brain-inj ...
Title: Mild and Severe Brain Injury Accidents - ... Description: Mild and Severe Brain Injury Accidents. ... H1: Mild and Severe Brain Injury Accidents |
Duplicate Body
|
| 0 | 200 |
https://www.whenyouneedus.com/motorcycle-accident/defects-and-recalls
Title: Motorcycle Defects and Recalls | Law Fir ... Description: Sometimes, manufacturers find it necessa ... H1: Motorcycle Defects and Recalls |
Duplicate Body
|
| 0 | 200 |
https://www.whenyouneedus.com/motorcycle-accident/helmet-laws
Title: Motorcycle Helmet Laws | Law Firm of Kau ... Description: Motorcycle helmet laws are important to ... H1: Motorcycle Helmet Laws: What You Need To ... |
Duplicate Body
|
| 0 | 200 |
https://www.whenyouneedus.com/motorcycle-accident/florida-motorcycle-i ...
Title: Florida Motorcycle Insurance Requirement ... Description: What are Florida's motorcycle insurance ... H1: Florida Motorcycle Insurance Requirement ... |
Duplicate Body
Description too short
|
| 0 | 200 |
https://www.whenyouneedus.com/slip-and-fall/indoor-slip-and-falls
Title: Indoor Slip and Fall Accident Conditions ... Description: Indoor Slip and Fall Accidents happen ev ... H1: Indoor Slip and Fall Accident Conditions ... |
Duplicate Body
|
| 0 | 200 |
https://www.whenyouneedus.com/slip-and-fall/proving-fault-in-slip-and- ...
Title: Proving Fault in Slip and Fall | Law Fir ... Description: Slips and falls are exceedingly common, ... H1: Slip and Fall Accidents: Proving Liabili ... |
Duplicate Body
|
| 0 | 200 |
https://www.whenyouneedus.com/slip-and-fall/outdoor-slip-and-falls
Title: Slip and Fall Accidents | Law Firm of Ka ... Description: What conditions can lead to an outdoor s ... H1: Outdoor Slip and Fall Accident Condition ... |
Duplicate Body
|
| 0 | 200 |
https://www.whenyouneedus.com/bus-accident/what-is-a-bus-accident-sett ...
Title: What is a Bus Accident Settlement? - Kau ... Description: What is a Bus Accident Settlement? Call ... H1: What is a Bus Accident Settlement? |
Duplicate Body
|
| 0 | 200 |
https://www.whenyouneedus.com/pedestrian-accident/pedestrian-accidents ...
Title: Pedestrian Accidents FAQ - Kaufman and L ... Description: Liability for Pedestrian Accidents. Call ... H1: Pedestrian Accidents FAQ |
Duplicate Body
|
| 0 | 301 |
https://whenyouneedus.com/car-accident/car-accident-injuries
|
301 Redirects
Redirect
|