Website Crawler
Use this tool to investigate the signal category highlighted in the report.
This report is based on a stored AlphaCrawler crawl snapshot and summary metrics.
Stored crawl snapshot available.
17 Sep 2026 11:53:6
Crawling time:00:01:42
Pages/Seconds2.0
AI search crawlers are allowed and the homepage content is readable without JavaScript. Review the breakdown below to push the score higher.
No robots.txt found — by default every crawler below is allowed.
| Googlebot Google · Google Search & AI Overviews | Allowed |
| Google-Extended Google · Gemini grounding & training | Allowed |
| GPTBot OpenAI · ChatGPT training & retrieval | Allowed |
| OAI-SearchBot OpenAI · ChatGPT Search index | Allowed |
| ChatGPT-User OpenAI · ChatGPT live browsing | Allowed |
| ClaudeBot Anthropic · Claude crawler | Allowed |
| Claude-User Anthropic · Claude live browsing | Allowed |
| PerplexityBot Perplexity · Perplexity index | Allowed |
| Perplexity-User Perplexity · Perplexity live fetch | Allowed |
| Bingbot Microsoft · Bing & Copilot | Allowed |
| Applebot-Extended Apple · Apple Intelligence training | Allowed |
| CCBot Common Crawl · Open dataset many LLMs use | Allowed |
| Meta-ExternalAgent Meta · Meta AI training | Allowed |
| Bytespider ByteDance · ByteDance / TikTok AI | Allowed |
| Amazonbot Amazon · Alexa & Amazon AI | Allowed |
| Weight | Status Code | Url | Issues |
|---|---|---|---|
| 0 | 200 |
https://coremarkets.co/insights/global-environmental-markets-report-ma ...
Title: Global Environmental Markets Report - Ma ... Description: This report is produced monthly and prov ... H1: Global Environmental Markets Report - Ma ... |
Title too long
|
| 0 | 200 |
https://coremarkets.co/resources/insights?7aaf7815_page=11
Title: Insights | CORE Markets Description: Explore the latest news, articles and ma ... H1: Our latest news and insights |
Title too short
|
| 0 | 200 |
https://coremarkets.co/insights/australian-energy-environmental-market ...
Title: Australian Energy & Environmental Market ... Description: The latest summary edition of our monthl ... H1: Australian Energy & Environmental Market ... |
Title too long
|
| 0 | 200 |
https://coremarkets.co/insights/global-environmental-markets-report-ju ...
Title: Global Environmental Markets Report - Ju ... Description: This report is produced monthly and prov ... H1: Global Environmental Markets Report - Ju ... |
Title too long
Slow loading
|
| 0 | 200 |
https://coremarkets.co/insights/accu-price-dynamics-a-guide-for-anyone ...
Title: The many facets of ACCU price dynamics – ... Description: Updated in October, 2024 with insights f ... H1: The many facets of ACCU price dynamics – ... |
Title too long
H1 too long
|
| 0 | 200 |
https://coremarkets.co/insights/reconfiguring-business-operations-to-t ...
Title: Climate governance: Reconfiguring busine ... Description: Decisive climate action that’s aligned t ... H1: Climate governance: Reconfiguring busine ... |
Title too long
H1 too long
|
| 0 | 200 |
https://coremarkets.co/insights/australias-proposed-new-targets-pathwa ...
Title: Australia’s proposed new climate targets ... Description: Parties to the Paris Agreement are taske ... H1: Australia’s proposed new climate targets ... |
Title too long
H1 too long
Description too long
|
| 0 | 200 |
https://coremarkets.co/insights/global-environmental-markets-report-ap ...
Title: Global Environmental Markets Report - Ap ... Description: This report is produced monthly and prov ... H1: Global Environmental Markets Report - Ap ... |
Title too long
|
| 0 | 200 |
https://coremarkets.co/insights/australian-energy-environmental-market ...
Title: Australian Energy & Environmental Market ... Description: The latest summary edition of our monthl ... H1: Australian Energy & Environmental Market ... |
Title too long
|
| 0 | 200 |
https://coremarkets.co/insights/global-environmental-markets-snapshot- ...
Title: Global Environmental Markets Report - Fe ... Description: This report is produced monthly and prov ... H1: Global Environmental Markets Report - Fe ... |
Title too long
|