From c7e130ce4d96f673d6c5529e500c515201d0f6b4 Mon Sep 17 00:00:00 2001
From: platform-mcp <platform-mcp@service.local>
Date: Fri, 19 Jun 2026 09:34:50 +0530
Subject: [PATCH] pre-agent: Verify robots.txt keeps AI crawlers open