# robots.txt for CXTMS # https://cxtms.com # Allow all crawlers (including AI) User-agent: * Allow: / # Sitemap location Sitemap: https://cxtms.com/sitemap.xml # RSS/Atom feeds for faster content discovery # https://cxtms.com/blog/rss.xml # https://cxtms.com/blog/atom.xml # Disallow internal paths Disallow: /search Disallow: /search/ # Crawl-delay (be respectful to servers) Crawl-delay: 1