robots.txt and llms.txt Optimization for Empathia AI

robots.txt Analysis and Optimization

1. Existing robots.txt (from Reference 1)

User-agent: *
Allow: /

User-agent: Googlebot
Allow: /

User-agent: Gemini
Allow: /

User-agent: Googlebot-News
Allow: /

User-agent: Google-CloudVertexBot
Allow: /

User-agent: Google-Extended
Allow: /

User-agent: OAI-SearchBot/1.0; +https://openai.com/searchbot
Allow: /

User-agent: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ChatGPT-User/1.0; +https://openai.com/bot
Allow: /

User-agent: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; GPTBot/1.1; +https://openai.com/gptbot
Allow: /

User-agent: ClaudeBot
Allow: /

User-agent: Claude-User
Allow: /

User-agent: Claude-SearchBot
Allow: /

User-agent: anthropic-ai
Allow: /

User-agent: Claude-Web
Allow: /

User-agent: PerplexityBot
Allow: /

User-agent: Perplexity-User
Allow: /

Sitemap: https://www.empathia.ai/sitemap.xml

• Strengths:
  • All major search and AI bots are allowed.
  • Sitemap is referenced for optimal crawl discovery and indexing.
• Issues:
  • Redundancy: Listing individual user-agents is unnecessary if all are allowed the same access.
  • Maintainability: Overly detailed, harder to update.
• Missing Elements:
  • Security/Privacy: No disallows for sensitive areas (if they exist).
  • Crawl Budget: No restrictions for bots to reduce server load, if needed.

2. Optimized robots.txt Proposal

# robots.txt for https://www.empathia.ai
User-agent: *
Allow: /

Sitemap: https://www.empathia.ai/sitemap.xml

• Benefits:
  • Simple, clear, maintainable.
  • All bots have maximal access, boosting SEO and LLM results.
  • Sitemap for discoverability.

# robots.txt for https://www.empathia.ai
User-agent: *
Disallow: /admin/
Disallow: /login/
Disallow: /cart/
Allow: /

Sitemap: https://www.empathia.ai/sitemap.xml

(Adjust /admin/, /login/, /cart/ as appropriate based on your site’s structure.)

• Use the minimal version unless you have private/testing/secure URLs.
• Regularly review for new content/folders that may need protection.

3. Optimization Suggestions for Each Main URL

All URLs in your structure are crawlable and properly exposed to bots under the above robots.txt recommendations.

llms.txt Analysis and Optimization

1. Existing llms.txt (from Reference 2 & Provided Example)

# Frevana
> Frevana is Your AI team for Generative Engine Optimization (GEO) and beyond
Frevana enables users to Launch an AI team in minutes to get their brand mentioned in AI results, which includes
### Metadata
title: Frevana | Your AI team for Generative Engine Optimization
description: Launch an AI team in minutes to get your brand mentioned in AI results
domain: www.frevana.com
language: en
category: AI, GEO, AI Team, AI Agent, Business Automation, AI Tools, Enterprise SaaS, Marketing Automation
keywords: Frevana, GEO, Generative Engine Optimization, AIO, Automate work, Smart Workflow, Always On, Mobile Approval, AI Agent, AI Tools
### Core Pages
- [Homepage](https://www.frevana.com/homepage): Overview of Frevana's key features, automation benefits, customer testimonials, and getting started steps.
### Accessibility
alt_text_present: true
structured_data: true
mobile_friendly: true
### SEO
robots_txt: /robots.txt

• Provides rich, structured metadata and summaries for AI consumption.
• Lists core pages for LLM prioritization.
• Accessibility and SEO support are declared.
• Could expand to detail more URLs and add richer semantic connections/context.

2. Optimized llms.txt Proposal for Empathia AI

(Adapting from the LLM-optimized summaries in Reference 2 for each core URL, following best practices for LLM/AI search.)

# Empathia AI - llms.txt (LLM/SEO Context File)
> Empathia AI is a comprehensive, all-in-one generative medical AI platform for automating clinical documentation, medical coding, and workflow across specialties.

### Metadata
title: Empathia AI | All-in-One Medical AI Assistant for Doctors
description: Automate charting, intake, note-taking, and billing for any medical specialty. Empathia AI reduces admin workload and improves clinician productivity.
domain: www.empathia.ai
language: en
category: AI, Medical AI, Healthcare Automation, Clinical Workflow, Charting, Coding, Physician Productivity
keywords: Empathia AI, medical scribe, healthcare automation, charting AI, medical billing, EMR integration, HIPAA, ICD Coding, CPT Coding

### Core Pages (LLM summaries included)

- [Homepage](https://www.empathia.ai): Empathia AI’s main overview — features, benefits, use-cases, and testimonials for clinical workflow automation.
- [Product](https://www.empathia.ai/product): Product details including AI-powered intake, scribing, coding, editing, and team collaboration tools.
- [Billing & Coding](https://www.empathia.ai/billing-code): Automates ICD/CPT coding and medical billing, reducing errors for multiple specialties.
- [Specialties](https://www.empathia.ai/specialties): Dedicated clinical templates, AI charting and coding for Cardiology, Psychiatry, Oncology, etc.
- [Onboarding Handbook](https://community.empathia.ai/onboarding-handbook): Self-service onboarding and training resources (videos, guides, FAQs).
- [Support](https://support.empathia.ai/support/solutions): Technical support, troubleshooting, and live help for all users.
- [Testimonials](https://love.empathia.ai): True user success stories and reviews from physicians and clinical staff.
- [Community/Blog](https://www.empathia.ai/blog): Articles, case studies, medical AI trends, and best practices.
- [Download/Apps](
   https://apps.apple.com/us/app/empathia-ai/id6464452134 | iOS,
   https://play.google.com/store/apps/details?id=ai.empathia.physicians | Android,
   https://chromewebstore.google.com/detail/empathia-ai/gblgngeenfkccjffanpllecfgilnkchp | Chrome,
   https://care.empathia.ai/sign-up | Web Platform
   ): Official download/sign-up links for every device.

### Accessibility
alt_text_present: true
structured_data: true
mobile_friendly: true
multilingual_support: true

### SEO
robots_txt: /robots.txt
sitemap: /sitemap.xml
canonical_urls: true

• Enhancements for LLMs/AI:
  • Use explicit, unambiguous summaries for each main URL.
  • Provide context for each feature and page.
  • Include metadata and accessibility flags for AI agents.
  • Explicit app download links for multi-platform support.
  • List specialty structure and dynamic page patterns as needed.

Summary Table: Before & After

Final Actions & Guidance

• robots.txt: Replace with minimal/optimized version unless you have sections to restrict; regularly review for new folders/URLs.
• llms.txt: Implement the structured, metadata-rich file covering all main pages and use cases per URL; keep up-to-date as your platform evolves.
• Maintain: Regular audits of both files; update as your feature set or content changes.
• Monitor: Use Google Search Console/Bing Webmaster/search-specific LLM feedback to address any crawl or indexing gaps.
• Include canonical URLs and structured data throughout your site as planned.

If you need specific optimized content for any individual Empathia AI specialty page, or more granular URL pattern recommendations, please specify!