Website Crawler
Use this tool to investigate the signal category highlighted in the report.
This report is based on a stored AlphaCrawler crawl snapshot and summary metrics.
Stored crawl snapshot available.
23 Sep 2026 11:11:48
Crawling time:00:01:30
Pages/Seconds2.2
AI search crawlers are allowed and the homepage content is readable without JavaScript. Review the breakdown below to push the score higher.
No robots.txt found — by default every crawler below is allowed.
| Googlebot Google · Google Search & AI Overviews | Allowed |
| Google-Extended Google · Gemini grounding & training | Allowed |
| GPTBot OpenAI · ChatGPT training & retrieval | Allowed |
| OAI-SearchBot OpenAI · ChatGPT Search index | Allowed |
| ChatGPT-User OpenAI · ChatGPT live browsing | Allowed |
| ClaudeBot Anthropic · Claude crawler | Allowed |
| Claude-User Anthropic · Claude live browsing | Allowed |
| PerplexityBot Perplexity · Perplexity index | Allowed |
| Perplexity-User Perplexity · Perplexity live fetch | Allowed |
| Bingbot Microsoft · Bing & Copilot | Allowed |
| Applebot-Extended Apple · Apple Intelligence training | Allowed |
| CCBot Common Crawl · Open dataset many LLMs use | Allowed |
| Meta-ExternalAgent Meta · Meta AI training | Allowed |
| Bytespider ByteDance · ByteDance / TikTok AI | Allowed |
| Amazonbot Amazon · Alexa & Amazon AI | Allowed |
| Weight | Status Code | Url | Issues |
|---|---|---|---|
| 0 | 200 |
https://www.sweetyhigh.com/read/justin-bieber-and-harry-styles-2027-su ...
Title: Justin Bieber & Harry Styles Are Super B ... Description: Justin Bieber and Harry Styles reportedl ... H1: Justin Bieber and Harry Styles Are Repor ... |
H1 too long
Favicon is not found
|
| 0 | 200 |
https://www.sweetyhigh.com/read/netflix-pride-and-prejudice-series-det ...
Title: Netflix''s ''Pride and Prejudice'' Serie ... Description: Emma Corrin and Jack Lowden lead Netflix ... H1: Everything We Know About Netflix’s Pride ... |
Favicon is not found
|
| 0 | 200 |
https://www.sweetyhigh.com/read/taylor-swift-and-tom-cruise-chiefs-gam ...
Title: Taylor Swift Sits With Tom Cruise at Chi ... Description: Taylor Swift and Tom Cruise were caught ... H1: Taylor Swift and Tom Cruise Sat Together ... |
H1 too long
Favicon is not found
|
| 0 | 200 |
https://www.sweetyhigh.com/page/7
Title: Sweety High: Entertainment, Community, L ... Description: Sweety High: A tech-enabled media networ ... H1: [empty] |
Meta Nofollow Pages
Meta Noindex Pages
H1 is missing
Favicon is not found
|
| 0 | 200 |
https://www.sweetyhigh.com/read/birthday-cake-zodiac-020818
Title: The Birthday Cake You Should Get Based o ... Description: What's a birthday party without a birthd ... H1: Here’s the Perfect Birthday Cake for You ... |
Favicon is not found
|
| 0 | 200 |
https://www.sweetyhigh.com/read/spices-every-new-cook-should-have-kitc ...
Title: Spices Every New Cook Should Have in The ... Description: Are you a chef in the making? We rounded ... H1: 10 Spices Every New Cook Should Have in ... |
Favicon is not found
|
| 0 | 200 |
https://www.sweetyhigh.com/category/food/page/3
Title: Sweety High: Food Trends, Snacks, Restau ... Description: Get the latest food news and food trends ... H1: [empty] |
H1 is missing
Canonical is missing
Favicon is not found
|
| 0 | 200 |
https://www.sweetyhigh.com/read/travel-tips-for-non-meat-eaters-010523 ...
Title: 7 Essential Travel Tips for Non-Meat Eat ... Description: Traveling is both fun and fulfilling, an ... H1: 7 Essential Travel Tips for Non-Meat Eat ... |
Favicon is not found
|
| 0 | 200 |
https://www.sweetyhigh.com/read/ice-cream-instagram-captions-011718
Title: 20 Clever Instagram Captions for Ice Cre ... Description: Not sure how to perfectly caption your i ... H1: These 20 Sweet Instagram Captions Are Pe ... |
Favicon is not found
|
| 0 | 200 |
https://www.sweetyhigh.com/category/food/page/5
Title: Sweety High: Food Trends, Snacks, Restau ... Description: Get the latest food news and food trends ... H1: [empty] |
H1 is missing
Canonical is missing
Favicon is not found
|