AI Crawler & Access Policy
Last Updated: January 2025 | Effective: January 28, 2025
Our AI Philosophy
We believe in the power of AI to make legal services more accessible. We welcome responsible AI crawlers that help users discover our content through AI-powered search and assistance tools, while protecting user privacy and confidential legal information.
1. Purpose of This Policy
This policy explains how LawEasy.ai manages access from AI crawlers, Large Language Models (LLMs), and automated systems. We distinguish between:
- AI Search Crawlers: Help users discover our content through AI-powered search engines (e.g., ChatGPT Search, Perplexity)
- AI Training Crawlers: Collect public content to train and improve AI models
- Traditional Search Engines: Index our content for Google, Bing, and other search platforms
2. What We Allow
AI Search & Discovery (Fully Allowed)
We welcome AI search engines that help users find relevant legal information:
- • OAI-SearchBot - ChatGPT Search indexing
- • ChatGPT-User - User-triggered ChatGPT browsing
- • PerplexityBot - Perplexity AI search
- • Googlebot - Google Search
- • Bingbot - Microsoft Bing
AI Model Training (Public Content Only)
We allow AI training on our public content only (blog posts, templates, pricing, help pages):
- • GPTBot - OpenAI GPT model training
- • ClaudeBot - Anthropic Claude training
- • Google-Extended - Google Gemini/Bard training (does NOT affect Search rankings)
- • CCBot - Common Crawl dataset (used by many AI models)
- • Meta-ExternalAgent - Meta AI training
- • Applebot-Extended - Apple Intelligence training
- • Amazonbot - Amazon AI applications
3. What We Block
Protected Content
All AI crawlers are blocked from accessing:
- • User-generated documents and legal content
- • Private user accounts, dashboards, and settings
- • Attorney portal and client information
- • Chat conversations and legal consultations
- • API endpoints and administrative areas
- • Billing information and payment data
Blocked Crawlers:
- • Bytespider - TikTok crawler (known to ignore robots.txt)
- • DotBot - Aggressive crawler
- • MJ12bot - Excessive crawling patterns
4. Allowed Content for AI Training
We permit AI training crawlers to access the following public content types:
- Blog Posts: Educational content about legal topics, document guides, and legal information
- Template Descriptions: Public descriptions of legal document templates (not user-generated documents)
- Help & Support Pages: Public guides and tutorials
- Pricing Information: Our service tiers and pricing details
- Attorney Directory: Public attorney profiles (with attorney consent)
- Terms & Policies: Terms of service, privacy policy, and this AI policy
5. Rate Limiting & Crawl Delays
To protect our infrastructure and ensure quality service for users, we implement crawl delays:
| Crawler Type | Crawl Delay |
|---|---|
| Search Engines (Google, Bing) | 1 second |
| AI Search Bots (ChatGPT, Perplexity) | 1-2 seconds |
| AI Training Bots (GPTBot, ClaudeBot) | 2-3 seconds |
| SEO Tools (Ahrefs, Semrush) | 1-2 seconds |
6. Terms of Use for AI Systems
By accessing our content, AI systems and their operators agree to:
- Respect robots.txt: Honor our robots.txt directives and crawl delays
- Attribution: When appropriate, cite LawEasy.ai as the source when referencing our content
- Accuracy: Ensure any legal information sourced from our site is presented accurately and in context
- No Liability: Understand that AI-generated legal information must be verified by qualified attorneys
- Privacy: Never attempt to access or train on private user content, documents, or personal information
- Compliance: Comply with all applicable data protection laws (GDPR, CCPA, etc.)
7. Why We Allow AI Crawlers
We believe in the democratization of legal knowledge. Allowing AI crawlers to access our public content helps:
- Make legal information more accessible to people who need it
- Help users discover our platform through AI-powered search
- Improve AI models' understanding of legal concepts and terminology
- Increase visibility for our educational content and services
- Support the broader AI ecosystem in providing accurate legal information
8. User Rights & Privacy
Important: Your private legal documents, chat conversations, and personal information are NEVER accessible to AI crawlers or used for AI training.
- All user-generated content is protected behind authentication
- We do not sell or share user data with AI companies
- Legal consultations remain confidential
- Attorney-client communications are protected
For more information about how we protect your data, see our Privacy Policy.
9. Monitoring & Enforcement
We actively monitor crawler activity to ensure compliance with this policy:
- Track crawler behavior and bandwidth usage
- Block crawlers that violate our robots.txt directives
- Implement rate limiting for excessive requests
- Review and update allowed/blocked crawler lists quarterly
10. Updates to This Policy
We may update this policy as new AI crawlers emerge and technologies evolve. We will:
- Update the "Last Updated" date at the top of this page
- Review and update our robots.txt file to reflect current best practices
- Announce significant changes through our blog or service notifications
11. Technical Implementation
Our AI crawler policy is implemented through:
- robots.txt: Available at
https://laweasy.ai/robots.txt - Server-side blocking: Firewall rules for aggressive or non-compliant crawlers
- Rate limiting: Automatic throttling for excessive request patterns
- Meta tags: Page-level directives for specific content
12. Contact & Questions
If you represent an AI company, search engine, or crawler service and have questions about our policy:
Birdierun Technologies and Media GmbH
Rheinweg 1b
8200 Schaffhausen, Switzerland
Email: crawler-policy@laweasy.ai
13. Related Policies
- Privacy Policy - How we collect and protect user data
- Terms of Service - Our general terms and conditions
- Cookie Policy - How we use cookies and tracking
This AI Crawler & Access Policy is effective as of January 28, 2025. Last updated: January 2025.