Website Crawler
Use this tool to investigate the signal category highlighted in the report.
This report is based on a stored AlphaCrawler crawl snapshot and summary metrics.
Stored crawl snapshot available.
28 Aug 2026 1:3:31
Crawling time:00:00:57
Pages/Seconds2.1
AI search crawlers are allowed and the homepage content is readable without JavaScript. Review the breakdown below to push the score higher.
No robots.txt found — by default every crawler below is allowed.
| Googlebot Google · Google Search & AI Overviews | Allowed |
| Google-Extended Google · Gemini grounding & training | Allowed |
| GPTBot OpenAI · ChatGPT training & retrieval | Allowed |
| OAI-SearchBot OpenAI · ChatGPT Search index | Allowed |
| ChatGPT-User OpenAI · ChatGPT live browsing | Allowed |
| ClaudeBot Anthropic · Claude crawler | Allowed |
| Claude-User Anthropic · Claude live browsing | Allowed |
| PerplexityBot Perplexity · Perplexity index | Allowed |
| Perplexity-User Perplexity · Perplexity live fetch | Allowed |
| Bingbot Microsoft · Bing & Copilot | Allowed |
| Applebot-Extended Apple · Apple Intelligence training | Allowed |
| CCBot Common Crawl · Open dataset many LLMs use | Allowed |
| Meta-ExternalAgent Meta · Meta AI training | Allowed |
| Bytespider ByteDance · ByteDance / TikTok AI | Allowed |
| Amazonbot Amazon · Alexa & Amazon AI | Allowed |
| Weight | Status Code | Url | Issues |
|---|---|---|---|
| 71.43 | 200 |
https://www.cfderm.com/
Title: Board Certified Dermatologists in Lawren ... Description: Discover expert dermatology in Lawrencev ... H1: Center for Dermatology |
Title too long
|
| 71.43 | 200 |
https://www.cfderm.com/medical-dermatology/hair-loss/
Title: Hair Loss in Lawrenceville, Suwanee, & D ... Description: Find expert hair loss treatment in Lawre ... H1: Hair Loss in Lawrenceville, GA |
Title too long
|
| 71.43 | 200 |
https://www.cfderm.com/medical-dermatology/molluscum-contagiosum-treat ...
Title: Molluscum Contagiosum Treatment in Lawre ... Description: Get expert molluscum treatment in Lawren ... H1: Molluscum Lawrenceville, GA |
Title too long
|
| 71.43 | 200 |
https://www.cfderm.com/cosmetic-dermatology/fine-lines-wrinkles-treatm ...
Title: Fine Lines & Wrinkles Treatment in Lawre ... Description: Smooth fine lines and wrinkles in Lawren ... H1: Fine Lines & Wrinkles Lawrenceville, GA |
Title too long
|
| 71.43 | 200 |
https://www.cfderm.com/medical-dermatology/skin-cancer/
Title: Skin Cancer Screening in Lawrenceville, ... Description: Protect your health with expert skin can ... H1: Skin Cancer Lawrenceville, GA |
Title too long
|
| 71.43 | 200 |
https://www.cfderm.com/medical-dermatology/scars-keloids-treatment/
Title: Scar Removal in Lawrenceville, Suwanee, ... Description: Improve the look of scars and keloids in ... H1: Scars & Keloids Lawrenceville, GA |
Title too long
|
| 71.43 | 200 |
https://www.cfderm.com/medical-dermatology/acne-treatment/
Title: Acne Treatment in Lawrenceville, Suwanee ... Description: Get expert acne treatment in Lawrencevil ... H1: Acne TreatmentLawrenceville, GA |
Title too long
|
| 71.43 | 200 |
https://www.cfderm.com/cosmetic-dermatology/multifrax/
Title: Multifrax in Lawrenceville, Suwanee, & D ... Description: Multifrax laser treatments offer a non-s ... H1: Multifrax Lawrenceville, GA |
Title too long
|
| 71.43 | 200 |
https://www.cfderm.com/medical-dermatology/rash-treatment/
Title: Rash Treatment in Lawrenceville, Suwanee ... Description: Get expert rash care in Lawrenceville, G ... H1: Rashes Lawrenceville, GA |
Title too long
|
| 71.43 | 200 |
https://www.cfderm.com/cosmetic-dermatology/skin-resurfacing/
Title: Skin Resurfacing in Lawrenceville, Suwan ... Description: Renew your complexion with skin resurfac ... H1: Skin Resurfacing Lawrenceville, GA |
Title too long
|