Website Crawler
Use this tool to investigate the signal category highlighted in the report.
This report is based on a stored AlphaCrawler crawl snapshot and summary metrics.
Stored crawl snapshot available.
17 Aug 2026 11:38:23
Crawling time:00:01:21
Pages/Seconds2.5
AI search crawlers are allowed and the homepage content is readable without JavaScript. Review the breakdown below to push the score higher.
No robots.txt found — by default every crawler below is allowed.
| Googlebot Google · Google Search & AI Overviews | Allowed |
| Google-Extended Google · Gemini grounding & training | Allowed |
| GPTBot OpenAI · ChatGPT training & retrieval | Allowed |
| OAI-SearchBot OpenAI · ChatGPT Search index | Allowed |
| ChatGPT-User OpenAI · ChatGPT live browsing | Allowed |
| ClaudeBot Anthropic · Claude crawler | Allowed |
| Claude-User Anthropic · Claude live browsing | Allowed |
| PerplexityBot Perplexity · Perplexity index | Allowed |
| Perplexity-User Perplexity · Perplexity live fetch | Allowed |
| Bingbot Microsoft · Bing & Copilot | Allowed |
| Applebot-Extended Apple · Apple Intelligence training | Allowed |
| CCBot Common Crawl · Open dataset many LLMs use | Allowed |
| Meta-ExternalAgent Meta · Meta AI training | Allowed |
| Bytespider ByteDance · ByteDance / TikTok AI | Allowed |
| Amazonbot Amazon · Alexa & Amazon AI | Allowed |
| Weight | Status Code | Url | Issues |
|---|---|---|---|
| 0 | 301 |
https://nikiautotransport.com/car-shipping-texas/
|
301 Redirects
Redirect
|
| 0 | 404 |
https://nikiautotransport.com/car-shipping-california/
|
4xx Client errors
404 Page
Broken page
|
| 0 | 404 |
https://nikiautotransport.com/car-shipping-florida/
|
4xx Client errors
404 Page
Broken page
|
| 0 | 404 |
https://nikiautotransport.com/car-shipping-new-york/
|
4xx Client errors
404 Page
Broken page
|
| 0 | 200 |
https://nikiautotransport.com/auto-transport-how-car-shipping-works-fr ...
Title: How Car Shipping Works: From Quote to Fi ... Description: A practical NIKI guide to how car shippi ... H1: How Car Shipping Works: From Quote to Fi ... |
More than one Description tag on page
|
| 0 | 200 |
https://nikiautotransport.com/tag/shipping-process/
Title: Shipping Process Archives - NIKI AUTO TR ... Description: [empty] H1: Tag: Shipping Process |
Description is missing
|
| 0 | 200 |
https://nikiautotransport.com/tag/high-clearance-truck-auto-transport/ ...
Title: high clearance truck auto transport Arch ... Description: [empty] H1: Tag: high clearance truck auto transport ... |
Description is missing
|
| 0 | 200 |
https://nikiautotransport.com/tag/weekend-car-shipping-pickup/
Title: weekend car shipping pickup Archives - N ... Description: [empty] H1: Tag: weekend car shipping pickup |
Description is missing
|
| 0 | 200 |
https://nikiautotransport.com/shipping-a-car-from-hawaii-to-california ...
Title: Shipping A Car From Hawaii to California ... Description: Shipping A Car From Hawaii to California ... H1: Shipping A Car From Hawaii To California ... |
Description too short
|
| 0 | 301 |
https://nikiautotransport.com/shipping-a-car-from-washington-to-hawaii ...
|
301 Redirects
Redirect
|