# Kennesaw Primary Care — robots.txt # https://kennesawpcp.com # Search / retrieval agents (enable AI citations) — ALLOW User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: Claude-SearchBot Allow: / User-agent: Claude-User Allow: / User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / # Standard engines User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / # Training crawlers (allowed; uncomment Disallow to opt out later) User-agent: GPTBot Allow: / # Disallow: / User-agent: ClaudeBot Allow: / # Disallow: / User-agent: Google-Extended Allow: / # Disallow: / User-agent: CCBot Allow: / # Disallow: / # Aggressive SEO scrapers (also blocked in middleware) User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: DotBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: PetalBot Disallow: / User-agent: Bytespider Disallow: / User-agent: BLEXBot Disallow: / User-agent: MegaIndex Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: AspiegelBot Disallow: / User-agent: Applebot Allow: / User-agent: Applebot-Extended Allow: / # Default — allow public content; block API and staff dashboard User-agent: * Allow: / Disallow: /api/ Disallow: /dashboard/ Disallow: /auth/ Disallow: /print/ # Discovery Sitemap: https://kennesawpcp.com/sitemap.xml # LLMs: https://kennesawpcp.com/llms.txt # LLMs-Full: https://kennesawpcp.com/llms-full.txt