User-agent: * Sitemap: https://ithesk.com/sitemap.xml ############## # custom # ############## # SEO: Allow images, assets, content Allow: /web/image/ Allow: /web/assets/ Allow: /web/content/ Allow: /shop/ # Block admin and sensitive routes Disallow: /web/login Disallow: /odoo Disallow: /web/session/ Disallow: /web/database/ Disallow: /web/action/ Disallow: /web/webclient/ Disallow: /admin/ Disallow: /shop/checkout/ Disallow: /shop/cart/ Disallow: /shop/payment/ Disallow: /shop/address Disallow: /website/info Disallow: /my/ Disallow: /payment/ Disallow: /credit_request/ Disallow: /financing/ Disallow: /cotizar/ Disallow: /livechat/ # AI Bots: explicitly allow for discoverability User-agent: GPTBot Allow: / Disallow: /my/ Disallow: /web/login Disallow: /odoo User-agent: ChatGPT-User Allow: / User-agent: Google-Extended Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Bingbot Allow: /