Website Crawler
Use this tool to investigate the signal category highlighted in the report.
This report is based on a stored AlphaCrawler crawl snapshot and summary metrics.
Stored crawl snapshot available.
20 Jul 2026 13:53:48
Crawling time:00:00:30
Pages/Seconds2.7
AI search crawlers are allowed and the homepage content is readable without JavaScript. Review the breakdown below to push the score higher.
No robots.txt found — by default every crawler below is allowed.
| Googlebot Google · Google Search & AI Overviews | Allowed |
| Google-Extended Google · Gemini grounding & training | Allowed |
| GPTBot OpenAI · ChatGPT training & retrieval | Allowed |
| OAI-SearchBot OpenAI · ChatGPT Search index | Allowed |
| ChatGPT-User OpenAI · ChatGPT live browsing | Allowed |
| ClaudeBot Anthropic · Claude crawler | Allowed |
| Claude-User Anthropic · Claude live browsing | Allowed |
| PerplexityBot Perplexity · Perplexity index | Allowed |
| Perplexity-User Perplexity · Perplexity live fetch | Allowed |
| Bingbot Microsoft · Bing & Copilot | Allowed |
| Applebot-Extended Apple · Apple Intelligence training | Allowed |
| CCBot Common Crawl · Open dataset many LLMs use | Allowed |
| Meta-ExternalAgent Meta · Meta AI training | Allowed |
| Bytespider ByteDance · ByteDance / TikTok AI | Allowed |
| Amazonbot Amazon · Alexa & Amazon AI | Allowed |
| Weight | Status Code | Url | Issues |
|---|---|---|---|
| 0 | 404 |
https://www.appclonex.com/prediction-market-clone-script
|
4xx Client errors
404 Page
Broken page
|
| 0 | 200 |
https://www.appclonex.com/nba-top-shot-clone-script
Title: NBA Top Shot Clone Script to Launch a Sp ... Description: NBA Top Shot Clone Script is a ready-mad ... H1: NBA Top Shot Clone Script |
Duplicate Body
|
| 0 | 200 |
https://www.appclonex.com/token-generator-platform-development
Title: Token Generator Platform Development Com ... Description: A Token Generator Platform Development h ... H1: [empty] |
Duplicate Body
H1 is missing
|
| 0 | 200 |
https://www.appclonex.com/smithii-clone-script
Title: Smithii Clone Script: Build Your Multi-C ... Description: Launch a multi-chain token generator pla ... H1: What is a Smithii Clone Script? |
Duplicate Body
|
| 0 | 200 |
https://www.appclonex.com/delta-exchange-clone-script
Title: Delta Exchange Clone Script Description: A Delta Exchange Clone Script is a ready ... H1: What is a Delta Exchange Clone Script? |
Duplicate Body
Title too short
|
| 0 | 200 |
https://www.appclonex.com/ai-reduces-crypto-exchange-launch-time
Title: How AI Integration Reduces Crypto Exchan ... Description: Learn how AI integration speeds up crypt ... H1: How is AppcloneX AI-Enabled White-Label ... |
Duplicate Body
H1 too long
|
| 0 | 200 |
https://www.appclonex.com/ico-script
Title: ICO Script To Launch ICO Platform Description: AppcloneX provides a pre-built and ready ... H1: What is an ICO Script? |
Duplicate Body
|
| 0 | 200 |
https://www.appclonex.com/security-features-of-crypto-exchange
Title: 10 Important Security Features In Crypto ... Description: Discover the essential crypto exchange s ... H1: 10 Security Features Every Crypto Exchan ... |
Duplicate Body
|
| 0 | 404 |
https://www.appclonex.com/white-label-tokenization-platform-developmen ...
|
4xx Client errors
404 Page
Broken page
|
| 0 | 200 |
https://www.appclonex.com/create-crypto-exchange-app
Title: How to Launch a Crypto Exchange App in 3 ... Description: Learn how to develop a crypto exchange a ... H1: Crypto Exchange App Development Process, ... |
Duplicate Body
|