# All User Agents Treated the Same User-agent: * # Disallow Everything - but especially /p/dashboard & /blog - yes that isn't needed but we put it here to remind us in case things change in the future Disallow: / Disallow: /p/dashboard Disallow: /blog # Allow the Root - since we Disallow everything above, we have to explicitly allow the root or else big problems arise Allow: /$ # Allow Other Public Parts of the Site Allow: /p/ Allow: /_home/ # Allow Robots.txt itself and sitemap.xml Allow: /robots.txt Allow: /sitemap.xml Allow: /llms.txt