# Allow crawlers to fetch the public site and its required resources User-agent: * Allow: / # Sitemap location Sitemap: https://www.sammx.com/sitemap.xml Agentmap: https://www.sammx.com/.well-known/ard.json # Disallow admin and media directories Disallow: /admin/ Disallow: /media/ # Allow specific media types Allow: /media/images/ Allow: /media/videos/ Allow: /media/logo.png Allow: /media/web_preview.png