Website Crawler
Use this tool to investigate the signal category highlighted in the report.
This report is based on a stored AlphaCrawler crawl snapshot and summary metrics.
Stored crawl snapshot available.
24 Sep 2026 22:46:10
Crawling time:00:01:27
Pages/Seconds2.6
AI search crawlers are allowed and the homepage content is readable without JavaScript. Review the breakdown below to push the score higher.
No robots.txt found — by default every crawler below is allowed.
| Googlebot Google · Google Search & AI Overviews | Allowed |
| Google-Extended Google · Gemini grounding & training | Allowed |
| GPTBot OpenAI · ChatGPT training & retrieval | Allowed |
| OAI-SearchBot OpenAI · ChatGPT Search index | Allowed |
| ChatGPT-User OpenAI · ChatGPT live browsing | Allowed |
| ClaudeBot Anthropic · Claude crawler | Allowed |
| Claude-User Anthropic · Claude live browsing | Allowed |
| PerplexityBot Perplexity · Perplexity index | Allowed |
| Perplexity-User Perplexity · Perplexity live fetch | Allowed |
| Bingbot Microsoft · Bing & Copilot | Allowed |
| Applebot-Extended Apple · Apple Intelligence training | Allowed |
| CCBot Common Crawl · Open dataset many LLMs use | Allowed |
| Meta-ExternalAgent Meta · Meta AI training | Allowed |
| Bytespider ByteDance · ByteDance / TikTok AI | Allowed |
| Amazonbot Amazon · Alexa & Amazon AI | Allowed |
| Weight | Status Code | Url | Issues |
|---|---|---|---|
| 27.78 | 200 |
https://theayurvedaexperience.com/
Title: The Ayurveda Experience Description: The Most Trusted and Recognized Ayurveda ... H1: Saffron-Enriched. Ayurveda-Inspired. Awa ... |
More than one H1 on page
Title too short
More than one Title tag on page
More than one Description tag on page
Page has links to broken page
|
| 38.89 | 200 |
https://theayurvedaexperience.com/collections/uneven-skin-tone
Title: Uneven Skin Tone Description: [empty] H1: Uneven Skin Tone |
Title too short
More than one Title tag on page
Description is missing
Duplicate Description
Page has links to broken page
|
| 100 | 200 |
https://theayurvedaexperience.com/products/iyura-balaayah-black-gram-b ...
Title: Balaayah Black Gram Bright Body Booster ... Description: A Rich Body Massage Oil for Robust, Velv ... H1: Balaayah Black Gram Bright Body Booster ... |
Canonical ≠ URL
H1 too long
More than one Title tag on page
More than one Description tag on page
Page has links to broken page
|
| 29.63 | 200 |
https://theayurvedaexperience.com/collections/toners-and-mists
Title: Toners and Mists Description: Check out The Ayurveda Experience's rang ... H1: Toners and Mists |
Title too short
More than one Title tag on page
More than one Description tag on page
Page has links to broken page
|
| 27.78 | 429 |
https://theayurvedaexperience.com/pages/balaayah-black-gram-body-boost ...
|
4xx Client errors
Broken page
Duplicate Title
Duplicate H1
Duplicate Description
|
| 29.63 | 429 |
https://theayurvedaexperience.com/collections/dietary-supplements
|
4xx Client errors
Broken page
Duplicate Title
Duplicate H1
Duplicate Description
|
| 29.63 | 200 |
https://theayurvedaexperience.com/collections/face-care-dullness
Title: Face Care - Dullness Description: Shop the best Ayurvedic skincare product ... H1: Face Care - Dullness |
Title too short
More than one Title tag on page
More than one Description tag on page
Page has links to broken page
|
| 29.63 | 200 |
https://theayurvedaexperience.com/collections/face-care-dry
Title: Ayurvedic Products for Dry Skin | The Ay ... Description: Shop for the best Ayurvedic Products for ... H1: Ayurvedic Products for Dry Skin |
More than one Title tag on page
More than one Description tag on page
Page has links to broken page
|
| 29.63 | 200 |
https://theayurvedaexperience.com/pages/privacy-policy
Title: Privacy Policy Description: Here's our commitment to you Brief of ... H1: Privacy Policy |
Title too short
More than one Title tag on page
More than one Description tag on page
Page has links to broken page
|
| 27.78 | 200 |
https://theayurvedaexperience.com/collections/hair-care-thinning-hair
Title: Ayurvedic Products for Thinning Hair | T ... Description: Get shinier and voluminous hair with our ... H1: Ayurvedic Products for Thinning Hair |
More than one Title tag on page
More than one Description tag on page
Page has links to broken page
|