Website Crawler
Use this tool to investigate the signal category highlighted in the report.
This report is based on a stored AlphaCrawler crawl snapshot and summary metrics.
Stored crawl snapshot available.
27 Sep 2026 23:50:4
Crawling time:00:03:21
Pages/Seconds2.1
AI search crawlers are allowed and the homepage content is readable without JavaScript. Review the breakdown below to push the score higher.
No robots.txt found — by default every crawler below is allowed.
| Googlebot Google · Google Search & AI Overviews | Allowed |
| Google-Extended Google · Gemini grounding & training | Allowed |
| GPTBot OpenAI · ChatGPT training & retrieval | Allowed |
| OAI-SearchBot OpenAI · ChatGPT Search index | Allowed |
| ChatGPT-User OpenAI · ChatGPT live browsing | Allowed |
| ClaudeBot Anthropic · Claude crawler | Allowed |
| Claude-User Anthropic · Claude live browsing | Allowed |
| PerplexityBot Perplexity · Perplexity index | Allowed |
| Perplexity-User Perplexity · Perplexity live fetch | Allowed |
| Bingbot Microsoft · Bing & Copilot | Allowed |
| Applebot-Extended Apple · Apple Intelligence training | Allowed |
| CCBot Common Crawl · Open dataset many LLMs use | Allowed |
| Meta-ExternalAgent Meta · Meta AI training | Allowed |
| Bytespider ByteDance · ByteDance / TikTok AI | Allowed |
| Amazonbot Amazon · Alexa & Amazon AI | Allowed |
| Weight | Status Code | Url | Issues |
|---|---|---|---|
| 27.78 | 200 |
https://www.angelitosinsurance.com/
Title: Angelitos Insurance | Auto, Home & Busin ... Description: Angelitos Insurance offers auto, home, b ... H1: How Can We Help You? |
More than one H1 on page
|
| 27.78 | 200 |
https://www.angelitosinsurance.com/coverage/mexico/
Title: Mexico - Oakland, CA Description: [empty] H1: Mexico |
More than one H1 on page
Title too short
Description is missing
Duplicate Description
|
| 27.78 | 200 |
https://www.angelitosinsurance.com/coverage/commercial-auto/
Title: Commercial Auto Insurance - Oakland, CA Description: Businesses that rely on vehicles for the ... H1: Commercial Auto Insurance |
More than one H1 on page
Description too long
|
| 27.78 | 200 |
https://www.angelitosinsurance.com/coverage/construction/
Title: Construction Insurance - Oakland, CA Description: Professionals in the construction indust ... H1: Construction Insurance |
More than one H1 on page
Description too long
|
| 27.78 | 200 |
https://www.angelitosinsurance.com/coverage/health-insurance/
Title: Health Insurance in Oakland, CA - AR Ins ... Description: Health insurance is the cornerstone of m ... H1: Health Insurance in Oakland, CA |
More than one H1 on page
|
| 27.78 | 200 |
https://www.angelitosinsurance.com/coverage/homeowners/
Title: Homeowners Insurance in Oakland, CA - AR ... Description: A homeowners insurance provides comprehe ... H1: Homeowners Insurance in Oakland, CA |
More than one H1 on page
|
| 27.78 | 200 |
https://www.angelitosinsurance.com/blog/
Title: Blog – AR Insurance Solutions Description: [empty] H1: Blog |
More than one H1 on page
Title too short
H1 too short
Description is missing
Duplicate Title
Duplicate H1
Duplicate Description
Page has links to redirect
|
| 27.78 | 200 |
https://www.angelitosinsurance.com/about-us/
Title: About Us | Angelitos Insurance Services Description: Founded in 2020, Angelitos Insurance pro ... H1: About Us |
More than one H1 on page
|
| 27.78 | 200 |
https://www.angelitosinsurance.com/coverage/life/
Title: Life Insurance in Oakland, CA Description: Life insurance provides financial securi ... H1: Life Insurance in Oakland, CA |
More than one H1 on page
Title too short
|
| 27.78 | 200 |
https://www.angelitosinsurance.com/coverage/restaurant/
Title: Restaurant - Oakland, CA Description: [empty] H1: Restaurant |
More than one H1 on page
Title too short
Description is missing
Duplicate Description
|