Website Crawler
Use this tool to investigate the signal category highlighted in the report.
This report is based on a stored AlphaCrawler crawl snapshot and summary metrics.
Stored crawl snapshot available.
21 Jul 2026 12:43:41
Crawling time:00:01:21
Pages/Seconds2.5
AI search crawlers are allowed and the homepage content is readable without JavaScript. Review the breakdown below to push the score higher.
No robots.txt found — by default every crawler below is allowed.
| Googlebot Google · Google Search & AI Overviews | Allowed |
| Google-Extended Google · Gemini grounding & training | Allowed |
| GPTBot OpenAI · ChatGPT training & retrieval | Allowed |
| OAI-SearchBot OpenAI · ChatGPT Search index | Allowed |
| ChatGPT-User OpenAI · ChatGPT live browsing | Allowed |
| ClaudeBot Anthropic · Claude crawler | Allowed |
| Claude-User Anthropic · Claude live browsing | Allowed |
| PerplexityBot Perplexity · Perplexity index | Allowed |
| Perplexity-User Perplexity · Perplexity live fetch | Allowed |
| Bingbot Microsoft · Bing & Copilot | Allowed |
| Applebot-Extended Apple · Apple Intelligence training | Allowed |
| CCBot Common Crawl · Open dataset many LLMs use | Allowed |
| Meta-ExternalAgent Meta · Meta AI training | Allowed |
| Bytespider ByteDance · ByteDance / TikTok AI | Allowed |
| Amazonbot Amazon · Alexa & Amazon AI | Allowed |
| Weight | Status Code | Url | Issues |
|---|---|---|---|
| 0 | 200 |
https://www.truefoundry.com/skills-registry/skill/alinaqi-maggy-ui-web ...
Title: UI Web — Skills Registry Description: Web UI - glassmorphism, Tailwind, dark m ... H1: ui-web |
Title too short
Description too short
Canonical is missing
|
| 0 | 200 |
https://www.truefoundry.com/skills-registry/skill/mattpocock-skills-wr ...
Title: Writing Shape — Skills Registry Description: Take a markdown file of raw material and ... H1: writing-shape |
Description too long
Canonical is missing
|
| 0 | 200 |
https://www.truefoundry.com/skills-registry/skill/K-Dense-AI-claude-sc ...
Title: Liteparse Document Parser — Skills Regis ... Description: Local document and PDF parsing with spat ... H1: liteparse |
Description too long
Canonical is missing
|
| 0 | 200 |
https://www.truefoundry.com/skills-registry/skill/vercel-labs-agent-sk ...
Title: Deploy to Vercel — Skills Registry Description: Deploy applications and websites to Verc ... H1: deploy-to-vercel |
Canonical is missing
|
| 0 | 200 |
https://www.truefoundry.com/skills-registry/skill/coreyhaines31-market ...
Title: Competitor Comparison Pages — Skills Reg ... Description: When the user wants to create competitor ... H1: competitors |
Description too long
Canonical is missing
|
| 0 | 200 |
https://www.truefoundry.com/skills-registry/skill/indranilbanerjee-dig ...
Title: Search Knowledge — Skills Registry Description: Search stored brand knowledge. Use when: ... H1: search-knowledge |
Canonical is missing
|
| 0 | 200 |
https://www.truefoundry.com/skills-registry/skill/czlonkowski-n8n-skil ...
Title: N8N JavaScript Code Nodes — Skills Regis ... Description: Write JavaScript code in n8n Code nodes. ... H1: n8n-code-javascript |
Description too long
Canonical is missing
|
| 0 | 200 |
https://www.truefoundry.com/skills-registry/skill/tech-leads-club-agen ...
Title: AI Pricing Strategy — Skills Registry Description: When the user wants to price an AI produ ... H1: ai-pricing |
Description too long
Canonical is missing
|
| 0 | 200 |
https://www.truefoundry.com/skills-registry/skill/mattpocock-skills-ed ...
Title: Edit Article — Skills Registry Description: Edit and improve articles by restructuri ... H1: edit-article |
Canonical is missing
|
| 0 | 200 |
https://www.truefoundry.com/skills-registry/skill/dembrandt-dembrandt- ...
Title: Data Display and Selection — Skills Regi ... Description: Complex data deserves multiple view mode ... H1: data-display-and-selection |
Description too long
Canonical is missing
|