Files
CompanySite/public/robots.txt
T
Clintchiz d402256547
Deploy to Production / Build & Verify (push) Failing after 5m56s
Ping Search Engines / Notify Search Engines (push) Successful in 2s
Deploy to Production / Pre-Deploy Tests (push) Has been skipped
Deploy to Production / Deploy to Railway (push) Has been skipped
Deploy to Production / Deploy to Render (push) Has been skipped
Deploy to Production / Deploy to VPS (PM2) (push) Has been skipped
Deploy to Production / Deploy to Fly.io (push) Has been skipped
Deploy to Production / Post-Deploy Verification (push) Has been skipped
Deploy to Production / Notify on Failure (push) Successful in 2s
E2E Test Suite / Critical User Journeys (push) Has been skipped
E2E Test Suite / API Integration Tests (push) Has been skipped
E2E Test Suite / Smoke Tests (P0) (push) Failing after 11m26s
E2E Test Suite / Form Interaction Tests (push) Failing after 11m42s
E2E Test Suite / Destructive & Chaos Tests (push) Failing after 12m2s
E2E Test Suite / Cross-Browser Regression (chromium) (push) Failing after 16m14s
E2E Test Suite / Cross-Browser Regression (webkit) (push) Failing after 17m45s
E2E Test Suite / Cross-Browser Regression (firefox) (push) Failing after 25m23s
E2E Test Suite / Security Header Tests (push) Failing after 7m55s
E2E Test Suite / Test Report Summary (push) Failing after 20s
E2E Test Suite / Mobile Device Tests (push) Failing after 2h49m9s
Uptime Monitor / Health & Response Time (push) Failing after 2s
Uptime Monitor / SSL Certificate (push) Successful in 2s
Uptime Monitor / Send Alerts (push) Failing after 3s
Uptime Monitor / Record Uptime Success (push) Has been skipped
First Init
2026-03-21 16:46:46 +05:30

83 lines
1.2 KiB
Plaintext

# Robots.txt for WorkRoot IT Solutions
# https://workroot.in
# Default rules for all bots
User-agent: *
Allow: /
# Disallow admin and build directories
Disallow: /admin/
Disallow: /private/
Disallow: /_astro/
# Allow access to CSS and JS files for proper rendering
Allow: /*.css$
Allow: /*.js$
Allow: /*.webp$
Allow: /*.jpg$
Allow: /*.png$
Allow: /*.svg$
# Crawl-delay for polite crawling
Crawl-delay: 1
# Sitemap location
Sitemap: https://workroot.in/sitemap.xml
# Traditional Search Engines
User-agent: Googlebot
Allow: /
User-agent: Googlebot-Image
Allow: /
User-agent: Bingbot
Allow: /
User-agent: Slurp
Allow: /
User-agent: DuckDuckBot
Allow: /
User-agent: Baiduspider
Allow: /
User-agent: YandexBot
Allow: /
# Google AdSense Bot
User-agent: Mediapartners-Google
Allow: /
# AI Search Engines & LLM Crawlers (GEO Optimization)
# OpenAI/ChatGPT
User-agent: ChatGPT-User
Allow: /
User-agent: GPTBot
Allow: /
# Anthropic/Claude
User-agent: anthropic-ai
Allow: /
User-agent: Claude-Web
Allow: /
# Perplexity AI
User-agent: PerplexityBot
Allow: /
# Google Gemini/Bard
User-agent: Google-Extended
Allow: /
# Common Crawl (used by many AI models)
User-agent: CCBot
Allow: /
# Meta AI
User-agent: FacebookBot
Allow: /