Website Crawler
Use this tool to investigate the signal category highlighted in the report.
This report is based on a stored AlphaCrawler crawl snapshot and summary metrics.
Stored crawl snapshot available.
19 Jun 2026 15:45:31
Crawling time:00:01:27
Pages/Seconds2.3
AI search crawlers are allowed and the homepage content is readable without JavaScript. Review the breakdown below to push the score higher.
No robots.txt found — by default every crawler below is allowed.
| Googlebot Google · Google Search & AI Overviews | Allowed |
| Google-Extended Google · Gemini grounding & training | Allowed |
| GPTBot OpenAI · ChatGPT training & retrieval | Allowed |
| OAI-SearchBot OpenAI · ChatGPT Search index | Allowed |
| ChatGPT-User OpenAI · ChatGPT live browsing | Allowed |
| ClaudeBot Anthropic · Claude crawler | Allowed |
| Claude-User Anthropic · Claude live browsing | Allowed |
| PerplexityBot Perplexity · Perplexity index | Allowed |
| Perplexity-User Perplexity · Perplexity live fetch | Allowed |
| Bingbot Microsoft · Bing & Copilot | Allowed |
| Applebot-Extended Apple · Apple Intelligence training | Allowed |
| CCBot Common Crawl · Open dataset many LLMs use | Allowed |
| Meta-ExternalAgent Meta · Meta AI training | Allowed |
| Bytespider ByteDance · ByteDance / TikTok AI | Allowed |
| Amazonbot Amazon · Alexa & Amazon AI | Allowed |
| Weight | Status Code | Url | Issues |
|---|---|---|---|
| 27.78 | 200 |
https://www.rwskill.edu.in/
Title: RW Skill Education: Computer Classes & S ... Description: Get basic to advance computer course in ... H1: Learn like top IITians & achieve Profess ... |
Title too long
|
| 27.78 | 200 |
https://www.rwskill.edu.in/careerx-ai-surat/
Title: CareerX AI In Surat - rnw Description: [empty] H1: Think Beyond AI – CareerX–AI Prepares Yo ... |
Meta Noindex Pages
Title too short
Canonical is missing
Description is missing
Duplicate Description
|
| 27.78 | 200 |
https://www.rwskill.edu.in/rnw-news/
Title: RW Skill Education News | Updates & Pres ... Description: Stay updated with RW Skill Education new ... H1: News |
Meta Nofollow Pages
Meta Noindex Pages
H1 too short
Canonical is missing
Duplicate Title
Duplicate H1
Duplicate Description
|
| 27.78 | 200 |
https://www.rwskill.edu.in/graphic-design-course/
Title: Graphic Design Course - rnw Description: [empty] H1: Learn Graphic Design with AI & Earn upto ... |
Meta Nofollow Pages
Meta Noindex Pages
Title too short
Canonical is missing
More than one Title tag on page
Description is missing
Duplicate Description
|
| 27.78 | 200 |
https://www.rwskill.edu.in/ui-ux-graphic-design-courses-surat/
Title: UI / UX & Graphic Design Course in Surat ... Description: Learn Advanced UI / UX & Graphic Design ... H1: UI/UX & Graphic Design Courses |
Meta Noindex Pages
Canonical is missing
Duplicate H1
|
| 27.78 | 200 |
https://www.rwskill.edu.in/video-editing-training/
Title: Video Editing Course in Surat: Best Vide ... Description: Professional video editing training insi ... H1: 5 Months Video Editing Course in Surat |
Title too long
|
| 27.78 | 200 |
https://www.rwskill.edu.in/cyber-security-course-surat/
Title: Cyber Security - Ethical hacking trainin ... Description: Gujarat No#1 Ethical hacking institute i ... H1: Cyber Security Course In Surat |
Title too long
|
| 27.78 | 200 |
https://www.rwskill.edu.in/events/
Title: Events - rnw Description: [empty] H1: Events |
Title too short
Description is missing
Duplicate Description
|
| 27.78 | 200 |
https://www.rwskill.edu.in/graphic-design-course-surat/
Title: Graphic design courses in Surat | No1 Gr ... Description: Are You looking for Best Graphic design ... H1: Graphic Design Courses in surat |
Title too long
|
| 27.78 | 200 |
https://www.rwskill.edu.in/data-science-artificial-intelligence-course ...
Title: Data Science, Artificial Intelligence an ... Description: Gujarat's No 1 institute to learn Python ... H1: AI/ML & Data Science Course In Surat |
Title too long
|