Website Crawler
Use this tool to investigate the signal category highlighted in the report.
This report is based on a stored AlphaCrawler crawl snapshot and summary metrics.
Stored crawl snapshot available.
17 Aug 2026 16:12:0
Crawling time:00:00:15
Pages/Seconds2.2
AI search crawlers are allowed and the homepage content is readable without JavaScript. Review the breakdown below to push the score higher.
No robots.txt found — by default every crawler below is allowed.
| Googlebot Google · Google Search & AI Overviews | Allowed |
| Google-Extended Google · Gemini grounding & training | Allowed |
| GPTBot OpenAI · ChatGPT training & retrieval | Allowed |
| OAI-SearchBot OpenAI · ChatGPT Search index | Allowed |
| ChatGPT-User OpenAI · ChatGPT live browsing | Allowed |
| ClaudeBot Anthropic · Claude crawler | Allowed |
| Claude-User Anthropic · Claude live browsing | Allowed |
| PerplexityBot Perplexity · Perplexity index | Allowed |
| Perplexity-User Perplexity · Perplexity live fetch | Allowed |
| Bingbot Microsoft · Bing & Copilot | Allowed |
| Applebot-Extended Apple · Apple Intelligence training | Allowed |
| CCBot Common Crawl · Open dataset many LLMs use | Allowed |
| Meta-ExternalAgent Meta · Meta AI training | Allowed |
| Bytespider ByteDance · ByteDance / TikTok AI | Allowed |
| Amazonbot Amazon · Alexa & Amazon AI | Allowed |
| Weight | Status Code | Url | Issues |
|---|---|---|---|
| 57.69 | 200 |
https://shipleytreeservicebgky.com/
Title: Shipley Tree Service | Tree Removal in B ... Description: Shipley Tree Service: tree removal, trim ... H1: Expert Tree Service in Bowling Green, KY ... |
Canonical ≠ URL
Page has links to broken page
|
| 57.69 | 200 |
https://shipleytreeservicebgky.com/services/debris-removal-service/fal ...
Title: Fallen Tree Removal in Bowling Green, KY ... Description: Shipley Tree Service removes fallen tree ... H1: Fallen Tree Removal in Bowling Green, KY ... |
Canonical ≠ URL
|
| 57.69 | 200 |
https://shipleytreeservicebgky.com/services/tree-service/tree-trimming ...
Title: Tree Trimming in Bowling Green, KY | Shi ... Description: Shipley Tree Service provides profession ... H1: Tree Trimming in Bowling Green, KY |
Canonical ≠ URL
|
| 57.69 | 200 |
https://shipleytreeservicebgky.com/services/land-clearing-service/site ...
Title: Site Preparation in Bowling Green, KY | ... Description: Shipley Tree Service handles site prepar ... H1: Site Preparation in Bowling Green, KY |
Canonical ≠ URL
|
| 61.54 | 200 |
https://shipleytreeservicebgky.com/review
Title: Leave a Review | Shipley Tree Service Description: Share your experience with Shipley Tree ... H1: How was your experience? |
Canonical ≠ URL
Meta Nofollow Pages
Meta Noindex Pages
|
| 57.69 | 200 |
https://shipleytreeservicebgky.com/about
Title: About Shipley Tree Service | Tree Servic ... Description: Meet the team behind Shipley Tree Servic ... H1: Tree Service backed by 37+ years of loca ... |
Canonical ≠ URL
Page has links to broken page
|
| 57.69 | 200 |
https://shipleytreeservicebgky.com/services/tree-service
Title: Tree Service in Bowling Green, KY | Ship ... Description: Expert tree service in Bowling Green, KY ... H1: Tree Service in Bowling Green, KY |
Canonical ≠ URL
Duplicate Title
Duplicate H1
|
| 57.69 | 200 |
https://shipleytreeservicebgky.com/areas/warren-county-ky
Title: Tree Service in Warren County, KY | Ship ... Description: Expert tree service services in Warren C ... H1: Tree Service in Warren County, KY |
Canonical ≠ URL
Description too long
|
| 57.69 | 200 |
https://shipleytreeservicebgky.com/areas/simpson-county-ky
Title: Tree Service in Simpson County, KY | Shi ... Description: Expert tree service services in Simpson ... H1: Tree Service in Simpson County, KY |
Canonical ≠ URL
Description too long
|
| 57.69 | 200 |
https://shipleytreeservicebgky.com/contact
Title: Contact Shipley Tree Service | Free Esti ... Description: Get in touch with Shipley Tree Service f ... H1: Get a Free Estimate |
Canonical ≠ URL
|