Website Crawler
Use this tool to investigate the signal category highlighted in the report.
This report is based on a stored AlphaCrawler crawl snapshot and summary metrics.
Stored crawl snapshot available.
10 Aug 2026 17:5:35
Crawling time:00:00:03
Pages/Seconds2.6
AI search crawlers are allowed and the homepage content is readable without JavaScript. Review the breakdown below to push the score higher.
No robots.txt found — by default every crawler below is allowed.
| Googlebot Google · Google Search & AI Overviews | Allowed |
| Google-Extended Google · Gemini grounding & training | Allowed |
| GPTBot OpenAI · ChatGPT training & retrieval | Allowed |
| OAI-SearchBot OpenAI · ChatGPT Search index | Allowed |
| ChatGPT-User OpenAI · ChatGPT live browsing | Allowed |
| ClaudeBot Anthropic · Claude crawler | Allowed |
| Claude-User Anthropic · Claude live browsing | Allowed |
| PerplexityBot Perplexity · Perplexity index | Allowed |
| Perplexity-User Perplexity · Perplexity live fetch | Allowed |
| Bingbot Microsoft · Bing & Copilot | Allowed |
| Applebot-Extended Apple · Apple Intelligence training | Allowed |
| CCBot Common Crawl · Open dataset many LLMs use | Allowed |
| Meta-ExternalAgent Meta · Meta AI training | Allowed |
| Bytespider ByteDance · ByteDance / TikTok AI | Allowed |
| Amazonbot Amazon · Alexa & Amazon AI | Allowed |
| Weight | Status Code | Url | Issues |
|---|---|---|---|
| 100 | 200 |
https://azschwartzgroup.com/
Title: Child, Adolescent, Adult Psychiatry, Sco ... Description: At The Arizona Schwartz Group in Scottsd ... H1: Child, Adolescent, & Adult Psychiatry & ... |
Canonical is missing
Duplicate Title
Duplicate H1
Duplicate Description
Page has links to broken page
|
| 64 | 200 |
https://azschwartzgroup.com/providers
Title: PROVIDERS Description: [empty] H1: About the independent practitioners |
Title too short
Canonical is missing
Description is missing
Duplicate Description
Page has links to broken page
|
| 60 | 200 |
https://azschwartzgroup.com/home
Title: Child, Adolescent, Adult Psychiatry, Sco ... Description: At The Arizona Schwartz Group in Scottsd ... H1: Child, Adolescent, & Adult Psychiatry & ... |
Canonical is missing
Duplicate Title
Duplicate H1
Duplicate Description
Page has links to broken page
|
| 64 | 200 |
https://azschwartzgroup.com/services
Title: SERVICES Description: [empty] H1: Services Provided |
Title too short
Canonical is missing
Description is missing
Duplicate Description
Page has links to broken page
|
| 64 | 200 |
https://azschwartzgroup.com/forms-and-notices
Title: Psychiatric Forms and Notices, Scottsdal ... Description: If you’re looking for professional menta ... H1: Forms and Notices |
Canonical is missing
Page has links to broken page
|
| 64 | 200 |
https://azschwartzgroup.com/web-resources
Title: WEB RESOURCES Description: Turn to The Arizona Schwartz Group in Sc ... H1: Crisis Information & Hotlines |
Title too short
Canonical is missing
Page has links to broken page
|
| 64 | 404 |
https://azschwartzgroup.com/contact/address/faq
|
4xx Client errors
404 Page
Broken page
Duplicate Description
|
| 84 | 200 |
https://azschwartzgroup.com/dr-schwartz
Title: Dr. Schwartz Description: Based in Scottsdale, AZ, The Arizona Sch ... H1: Dr. Schwartz |
Title too short
Canonical is missing
Page has links to broken page
|