Website Crawler
Use this tool to investigate the signal category highlighted in the report.
This report is based on a stored AlphaCrawler crawl snapshot and summary metrics.
Stored crawl snapshot available.
20 Aug 2026 9:45:18
Crawling time:00:00:21
Pages/Seconds2.0
AI search crawlers are allowed and the homepage content is readable without JavaScript. Review the breakdown below to push the score higher.
No robots.txt found — by default every crawler below is allowed.
| Googlebot Google · Google Search & AI Overviews | Allowed |
| Google-Extended Google · Gemini grounding & training | Allowed |
| GPTBot OpenAI · ChatGPT training & retrieval | Allowed |
| OAI-SearchBot OpenAI · ChatGPT Search index | Allowed |
| ChatGPT-User OpenAI · ChatGPT live browsing | Allowed |
| ClaudeBot Anthropic · Claude crawler | Allowed |
| Claude-User Anthropic · Claude live browsing | Allowed |
| PerplexityBot Perplexity · Perplexity index | Allowed |
| Perplexity-User Perplexity · Perplexity live fetch | Allowed |
| Bingbot Microsoft · Bing & Copilot | Allowed |
| Applebot-Extended Apple · Apple Intelligence training | Allowed |
| CCBot Common Crawl · Open dataset many LLMs use | Allowed |
| Meta-ExternalAgent Meta · Meta AI training | Allowed |
| Bytespider ByteDance · ByteDance / TikTok AI | Allowed |
| Amazonbot Amazon · Alexa & Amazon AI | Allowed |
| Weight | Status Code | Url | Issues |
|---|---|---|---|
| 0 | 200 |
https://www.sunberry.farm/products/mangonectar64oz
Title: Mango Nectar 64 Fl oz Description: Golden, Juicy & Unforgettable - Savor th ... H1: Mango Nectar |
Title too short
More than one Title tag on page
|
| 0 | 200 |
https://www.sunberry.farm/products/lycheenectar
Title: Lychee Nectar Description: Exotic Elegance in Every Drop - Treat yo ... H1: Lychee Nectar |
Title too short
More than one Title tag on page
|
| 0 | 200 |
https://www.sunberry.farm/products/organic-grape-juice
Title: Organic Fruit Punch Description: Sunberry Farms Fruit Punch Juice Boxes d ... H1: Organic Fruit Punch |
Title too short
More than one Title tag on page
|
| 0 | 200 |
https://www.sunberry.farm/products/passionfruitnectar
Title: Passion Fruit Nectar Description: Pure Passion in Every Sip - Sunberry Far ... H1: Passion Fruit Nectar |
Title too short
More than one Title tag on page
|
| 0 | 200 |
https://www.sunberry.farm/products/organic-apple-juice-200ml
Title: Organic Apple Juice Description: Enjoy the crisp, refreshing taste of Sun ... H1: Organic Apple Juice |
Title too short
More than one Title tag on page
|
| 0 | 200 |
https://www.sunberry.farm/products/guava-nectar32oz
Title: Guava Nectar 32 Fl oz Description: Sip into the tropics with the bold, exot ... H1: Guava Nectar |
Title too short
More than one Title tag on page
|
| 0 | 200 |
https://www.sunberry.farm/products/mangonectar
Title: Mango Nectar Description: Golden, Juicy & Unforgettable - Savor th ... H1: Mango Nectar |
Title too short
More than one Title tag on page
|
| 0 | 200 |
https://www.sunberry.farm/products/sunberry-sparkling-energy-mango
Title: Sunberry Sparkling Energy — Mango Description: Real fruit. Real energy. Nothing fake. 1 ... H1: Sunberry Sparkling Energy — Mango |
More than one Title tag on page
|
| 0 | 200 |
https://www.sunberry.farm/products/passion-orange-guava-nectar32oz
Title: Passion Orange Guava Nectar 32 Fl oz Description: Transport yourself to the islands with t ... H1: Passion Orange Guava Nectar |
More than one Title tag on page
|
| 0 | 200 |
https://www.sunberry.farm/products/sunberry-sparkling-energy-guava
Title: Sunberry Sparkling Energy — Guava Description: Real fruit. Real energy. Nothing fake. 1 ... H1: Sunberry Sparkling Energy — Guava |
More than one Title tag on page
|