Website Crawler
Use this tool to investigate the signal category highlighted in the report.
This report is based on a stored AlphaCrawler crawl snapshot and summary metrics.
Stored crawl snapshot available.
19 Aug 2026 20:36:54
Crawling time:00:00:12
Pages/Seconds2.8
AI search crawlers are allowed and the homepage content is readable without JavaScript. Review the breakdown below to push the score higher.
No robots.txt found — by default every crawler below is allowed.
| Googlebot Google · Google Search & AI Overviews | Allowed |
| Google-Extended Google · Gemini grounding & training | Allowed |
| GPTBot OpenAI · ChatGPT training & retrieval | Allowed |
| OAI-SearchBot OpenAI · ChatGPT Search index | Allowed |
| ChatGPT-User OpenAI · ChatGPT live browsing | Allowed |
| ClaudeBot Anthropic · Claude crawler | Allowed |
| Claude-User Anthropic · Claude live browsing | Allowed |
| PerplexityBot Perplexity · Perplexity index | Allowed |
| Perplexity-User Perplexity · Perplexity live fetch | Allowed |
| Bingbot Microsoft · Bing & Copilot | Allowed |
| Applebot-Extended Apple · Apple Intelligence training | Allowed |
| CCBot Common Crawl · Open dataset many LLMs use | Allowed |
| Meta-ExternalAgent Meta · Meta AI training | Allowed |
| Bytespider ByteDance · ByteDance / TikTok AI | Allowed |
| Amazonbot Amazon · Alexa & Amazon AI | Allowed |
| Weight | Status Code | Url | Issues |
|---|---|---|---|
| 27.78 | 200 |
https://www.aandbservices.com/
Title: Pest Control Service | Farmington, New M ... Description: Get reliable pest control, weed control, ... H1: Pest & Home Services in Northwestern NM |
More than one Title tag on page
|
| 27.78 | 200 |
https://www.aandbservices.com/rodent-control
Title: Rodent Control | Farmington, New Mexico ... Description: Ensure a pest-free environment in Farmin ... H1: Rodent Control in Farmington, New Mexico ... |
More than one Title tag on page
|
| 27.78 | 200 |
https://www.aandbservices.com/areas-we-serve
Title: Areas We Serve | Farmington, New Mexico ... Description: Get expert pest control and management s ... H1: SERVICE AREA |
More than one Title tag on page
Page has links to redirect
|
| 48.15 | 200 |
https://www.aandbservices.com/pest-control-service-cuba-nm
Title: Pest Control Service | Cuba, NM | A and ... Description: Get eco-friendly pest control solutions ... H1: Pest Control Service in Cuba, NM |
More than one Title tag on page
|
| 27.78 | 200 |
https://www.aandbservices.com/general-contracting
Title: General Contracting | Farmington, New Me ... Description: Get expert general contracting and pest ... H1: General Contracting Services in Farmingt ... |
More than one Title tag on page
|
| 48.15 | 200 |
https://www.aandbservices.com/pest-control-service-dolores-co
Title: Pest Control Service | Dolores, CO | A a ... Description: A and B Services LLC provides expert pes ... H1: Pest Control Service in Dolores, CO |
More than one Title tag on page
|
| 48.15 | 200 |
https://www.aandbservices.com/pest-control-service-aztec-nm
Title: Pest Control Service | Aztec, New Mexico ... Description: Ensure your home is pest-free with A and ... H1: Pest Control Service in Aztec, NM |
More than one Title tag on page
|
| 48.15 | 200 |
https://www.aandbservices.com/pest-control-service-bloomfield-nm
Title: Pest Control Service | Bloomfield, NM | ... Description: Get expert pest control for your home or ... H1: Pest Control Service in Bloomfield, NM |
More than one Title tag on page
|
| 27.78 | 200 |
https://www.aandbservices.com/weed-control
Title: Weed Control | Farmington, New Mexico | ... Description: Get effective weed control with eco-frie ... H1: Weed Control Services in Farmington, New ... |
More than one Title tag on page
|
| 27.78 | 200 |
https://www.aandbservices.com/home-remodeling
Title: Home Remodeling | Farmington, New Mexico ... Description: Enhance your home in Farmington, New Mex ... H1: Home Remodeling Services in Farmington, ... |
More than one Title tag on page
|