Website Crawler
Use this tool to investigate the signal category highlighted in the report.
This report is based on a stored AlphaCrawler crawl snapshot and summary metrics.
Stored crawl snapshot available.
13 Jul 2026 13:37:24
Crawling time:00:00:09
Pages/Seconds2.6
AI search crawlers are allowed and the homepage content is readable without JavaScript. Review the breakdown below to push the score higher.
No robots.txt found — by default every crawler below is allowed.
| Googlebot Google · Google Search & AI Overviews | Allowed |
| Google-Extended Google · Gemini grounding & training | Allowed |
| GPTBot OpenAI · ChatGPT training & retrieval | Allowed |
| OAI-SearchBot OpenAI · ChatGPT Search index | Allowed |
| ChatGPT-User OpenAI · ChatGPT live browsing | Allowed |
| ClaudeBot Anthropic · Claude crawler | Allowed |
| Claude-User Anthropic · Claude live browsing | Allowed |
| PerplexityBot Perplexity · Perplexity index | Allowed |
| Perplexity-User Perplexity · Perplexity live fetch | Allowed |
| Bingbot Microsoft · Bing & Copilot | Allowed |
| Applebot-Extended Apple · Apple Intelligence training | Allowed |
| CCBot Common Crawl · Open dataset many LLMs use | Allowed |
| Meta-ExternalAgent Meta · Meta AI training | Allowed |
| Bytespider ByteDance · ByteDance / TikTok AI | Allowed |
| Amazonbot Amazon · Alexa & Amazon AI | Allowed |
| Weight | Status Code | Url | Issues |
|---|---|---|---|
| 27.78 | 200 |
https://www.lawproforu.com/
Title: The Woodlands, TX Law Firm | Free Initia ... Description: Trusted legal help in The Woodlands, TX ... H1: Protect Your Rights with a Trusted Law F ... |
H1 too long
|
| 29.63 | 200 |
https://www.lawproforu.com/privacy-policy/
Title: Privacy Policy - Law Office Of Lawrence ... Description: [empty] H1: Privacy Policy |
Meta Nofollow Pages
Meta Noindex Pages
Canonical is missing
Description is missing
Duplicate Description
|
| 29.63 | 200 |
https://www.lawproforu.com/conroe-tx/
Title: Law Firm in Conroe, TX | Free Initial Co ... Description: Dependable legal help in Conroe, TX for ... H1: Get Dependable Legal Support from a Trus ... |
H1 too long
|
| 27.78 | 200 |
https://www.lawproforu.com/areas-we-serve/
Title: Service Areas | The Woodlands, Conroe & ... Description: Serving The Woodlands, Conroe, Spring & ... H1: [empty] |
H1 is missing
Duplicate H1
|
| 29.63 | 200 |
https://www.lawproforu.com/services/bankruptcy-lawyer/
Title: Bankruptcy Lawyer The Woodlands, TX | Ch ... Description: Get a fresh start with an experienced Ch ... H1: Find Financial Freedom with a Dedicated ... |
H1 too long
|
| 29.63 | 200 |
https://www.lawproforu.com/services/probate-lawyer/
Title: Probate Lawyer The Woodlands, TX | Wills ... Description: Settle estates with a reliable probate l ... H1: Settle Estates Smoothly with a Reliable ... |
H1 too long
|
| 27.78 | 200 |
https://www.lawproforu.com/contact/
Title: Contact Us | The Woodlands, TX Law Firm Description: Contact the Law Office of Lawrence D Tac ... H1: [empty] |
H1 is missing
Duplicate H1
|
| 29.63 | 200 |
https://www.lawproforu.com/services/criminal-defense-lawyer/
Title: Criminal Defense Lawyer The Woodlands, T ... Description: Facing charges? A skilled criminal defen ... H1: Protect Your Rights with a Skilled Crimi ... |
H1 too long
|
| 29.63 | 200 |
https://www.lawproforu.com/faqs/
Title: Legal FAQs | The Woodlands, TX Law Firm Description: Answers to common questions about bankru ... H1: [empty] |
H1 is missing
Duplicate H1
|
| 29.63 | 200 |
https://www.lawproforu.com/reviews/
Title: Client Reviews | The Woodlands, TX Law F ... Description: Read client reviews for the Law Office o ... H1: [empty] |
H1 is missing
Duplicate H1
|