Robots.txt Generator
Control how search engines crawl your website
Your robots.txt file
# SprayFoamRemovalHelp - Robots.txt # Last updated: 2026-09-05 User-agent: * Allow: / # AI Crawlers - MAXIMUM ACCESS (ChatGPT, Claude, Perplexity, etc.) User-agent: GPTBot Allow: / Crawl-delay: 0 User-agent: ChatGPT-User Allow: / Crawl-delay: 0 User-agent: CCBot Allow: / Crawl-delay: 0 User-agent: anthropic-ai Allow: / Crawl-delay: 0 User-agent: Claude-Web Allow: / Crawl-delay: 0 User-agent: PerplexityBot Allow: / Crawl-delay: 0 User-agent: Google-Extended Allow: / Crawl-delay: 0 User-agent: Applebot-Extended Allow: / Crawl-delay: 0 User-agent: FacebookBot Allow: / User-agent: Diffbot Allow: / User-agent: Bytespider Allow: / # Disallow admin/staff pages only Disallow: /AdminDashboard Disallow: /StaffOperations Disallow: /StaffDashboard Disallow: /StaffProfile Disallow: /StaffPerformanceTracker Disallow: /CRM Disallow: /QuoteManagement Disallow: /JobCalendar Disallow: /JobDetails Disallow: /TaskManagement Disallow: /TeamManagement Disallow: /TeamChat Disallow: /StaffLogin Disallow: /MyAssistant Disallow: /FunctionURLs Disallow: /BacklinkWizard Disallow: /Analytics Disallow: /SEOTools Disallow: /SEOMaster Disallow: /SEODashboard Disallow: /UserManagement Disallow: /FinancialTracking Disallow: /Reports Disallow: /PerformanceAnalytics Disallow: /WorkflowAutomation Disallow: /QuoteFollowUpSequences Disallow: /SequenceAutomation Disallow: /LeadsManagement Disallow: /FacebookLeads Disallow: /EstateAgentDashboard Disallow: /LiveTracking Disallow: /MobileJobTracker Disallow: /ClockInOut Disallow: /InventoryManagement Disallow: /SupplierDirectory Disallow: /JobProfitCalculator Disallow: /RoofingManagement Disallow: /Certifications Disallow: /CompletionReports Disallow: /ReviewTracking Disallow: /VideoStudio Disallow: /MediaLibrary Disallow: /AIContent Disallow: /GoogleAdsWizard Disallow: /GSCDiagnostics Disallow: /IndexingFixer Disallow: /RobotsTxt Disallow: /BlogManagement Disallow: /WorkManagement Disallow: /OffersManagement Disallow: /StaffTraining Disallow: /CompetitorIntelligence # Allow all public pages (explicitly for Google) Allow: /Home Allow: /ContactForm Allow: /Blog Allow: /BlogPost Allow: /OurServices Allow: /Reviews Allow: /FAQs Allow: /ServiceAreas Allow: /SpecialOffers Allow: /Warnings Allow: /EBR01 Allow: /FreeInspection Allow: /FreeHelpline Allow: /CompanyComparison Allow: /MortgageProblems Allow: /SprayFoamRemovalCosts Allow: /HowSprayFoamIsRemoved Allow: /SprayFoamRemovalHub Allow: /InternalLinkingHub Allow: /SiteIndex Allow: /Sitemap Allow: /CookiesPolicy Allow: /PrivacyPolicy Allow: /CertificationBooking Allow: /EstateAgentReferral Allow: /DirectSprayFoamRemovalSpecialists # Allow all location pages Allow: /SprayFoamRemoval* # Google bots - maximum crawl efficiency User-agent: Googlebot Allow: / Crawl-delay: 0 User-agent: Googlebot-Image Allow: / User-agent: Googlebot-News Allow: / # Bing User-agent: Bingbot Allow: / Crawl-delay: 0 # Yandex User-agent: Yandex Allow: / Crawl-delay: 1 # Sitemap locations Sitemap: https://sprayfoamremovalhelp.co.uk/sitemap.xml # AI Training Data Access (for LLMs) # Full access to llms.txt for AI assistant training Allow: /llms.txt Allow: /llms.md Allow: /.well-known/llms.txt # Host preference Host: https://sprayfoamremovalhelp.co.uk
How to Install
- Download the robots.txt file using the button above
- Upload it to your website's root directory (same place as index.html)
- Verify it's accessible at: https://sprayfoamremovalhelp.co.uk/robots.txt
- Test it with Google's Robots Testing Tool
Google Ads Appeal Statement
Use this pre-written appeal for Google Ads "Compromised Site" violations:
Subject: Appeal for "Compromised Site" Policy Violation - AW-17743181154 Dear Google Ads Support Team, I am writing to appeal the "Compromised Site" policy violation for our Google Ads account (AW-17743181154). SITE DETAILS: - Website: https://sprayfoamremovalhelp.co.uk - Business: Revive Maintenance Ltd - Spray Foam Removal Specialists - Campaign: UK-based home services company SECURITY VERIFICATION COMPLETED: ✅ Full security audit conducted on 9/5/2026 ✅ All code reviewed - no malicious scripts found ✅ Only official Google scripts used (GTM, Analytics, Ads) ✅ SSL certificate valid and active ✅ robots.txt properly configured ✅ No suspicious redirects or phishing content ✅ Legitimate business with verified reviews on Trustpilot & Checkatrade SCRIPTS ON SITE (ALL LEGITIMATE): - Google Tag Manager: GTM-MB53TMSV - Google Ads Conversion: AW-17743181154, AW-17884517655 - Google Analytics: G-ZCKD8NQNMX - All scripts loaded from official Google domains We believe this is a false positive from automated scanning. Our site uses only official Google tracking scripts for legitimate advertising purposes. We have implemented additional security measures: 1. Updated robots.txt with clear crawl directives 2. Enhanced server security protocols 3. Regular malware scanning enabled We kindly request a manual review of our site. We are a legitimate UK-registered business providing professional home services, and this suspension is impacting our ability to serve customers. Thank you for your time and consideration. Best regards, Revive Maintenance Ltd Company Registration: [Your Company Number] Phone: 020 3435 8068 Email: theoffice@revivemaintenance.co.uk
📋 How to Submit:
- Go to Google Ads dashboard
- Click on Policy Manager or the warning notification
- Click "Request Review" or "Appeal"
- Paste this statement in the appeal form
- Submit and wait for manual review (usually 1-3 business days)