# robots.txt automatically generated by PrestaShop e-commerce open-source solution # http://www.prestashop.com - http://www.prestashop.com/forums # This file is to prevent the crawling and indexing of certain parts # of your site by web crawlers and spiders run by sites like Yahoo! # and Google. By telling these "robots" where not to go on your site, # you save bandwidth and server resources. # For more information about the robots.txt standard, see: # http://www.robotstxt.org/robotstxt.html # PJ/AF/LSK 240313 blocage des robots bytespider et bytedance User-agent: Bytedance Disallow: / User-agent: Bytespider Disallow: / User-agent: * # Allow Directives Allow: */modules/*.css Allow: */modules/*.js Allow: */modules/*.png Allow: */modules/*.jpg Allow: /js/jquery/* # Private pages Disallow: /*?order= Disallow: /*?tag= Disallow: /*?id_currency= Disallow: /*?search_query= Disallow: /*?back= Disallow: /*?n= Disallow: /*&order= Disallow: /*&tag= Disallow: /*&id_currency= Disallow: /*&search_query= Disallow: /*&back= Disallow: /*&n= Disallow: /*controller=addresses Disallow: /*controller=address Disallow: /*controller=authentication Disallow: /*controller=cart Disallow: /*controller=discount Disallow: /*controller=footer Disallow: /*controller=get-file Disallow: /*controller=header Disallow: /*controller=history Disallow: /*controller=identity Disallow: /*controller=images.inc Disallow: /*controller=init Disallow: /*controller=my-account Disallow: /*controller=order Disallow: /*controller=order-slip Disallow: /*controller=order-detail Disallow: /*controller=order-follow Disallow: /*controller=order-return Disallow: /*controller=order-confirmation Disallow: /*controller=pagination Disallow: /*controller=password Disallow: /*controller=pdf-invoice Disallow: /*controller=pdf-order-return Disallow: /*controller=pdf-order-slip Disallow: /*controller=product-sort Disallow: /*controller=search Disallow: /*controller=statistics Disallow: /*controller=attachment Disallow: /*controller=guest-tracking # Directories for toysngo.com Disallow: /app/ Disallow: /cache/ Disallow: /classes/ Disallow: /config/ Disallow: /controllers/ Disallow: /download/ Disallow: /js/ Disallow: /localization/ Disallow: /log/ Disallow: /mails/ Disallow: /modules/ Disallow: /override/ Disallow: /pdf/ Disallow: /src/ Disallow: /tools/ Disallow: /translations/ Disallow: /upload/ Disallow: /var/ Disallow: /vendor/ Disallow: /webservice/ Disallow: /fr/app/ Disallow: /fr/cache/ Disallow: /fr/classes/ Disallow: /fr/config/ Disallow: /fr/controllers/ Disallow: /fr/download/ Disallow: /fr/js/ Disallow: /fr/localization/ Disallow: /fr/log/ Disallow: /fr/mails/ Disallow: /fr/modules/ Disallow: /fr/override/ Disallow: /fr/pdf/ Disallow: /fr/src/ Disallow: /fr/tools/ Disallow: /fr/translations/ Disallow: /fr/upload/ Disallow: /fr/var/ Disallow: /fr/vendor/ Disallow: /fr/webservice/ # Files Disallow: /*fr/password-recovery Disallow: /*fr/address Disallow: /*fr/addresses Disallow: /*fr/login Disallow: /*fr/cart #Disallow: /*fr/discount Disallow: /*fr/order-history Disallow: /*fr/identity Disallow: /*fr/my-account Disallow: /*fr/order-follow Disallow: /*fr/credit-slip Disallow: /*fr/order Disallow: /*fr/search Disallow: /*fr/guest-tracking Disallow: /*fr/order-confirmation #AJOUT PJ Disallow: /brand/1-cobi # AF/Claude 2026-05-13 — Reduction crawl budget URLs parametrees (~103k URLs) # Cohérent avec Vapengo (2026-05-06) — même thème IQIT + ps_facetedsearch # Note : pl_infinity:true côté thème, donc bloquer ?p= ne casse rien (infinite scroll AJAX) # Faceted/layered navigation (ps_facetedsearch) — explosion combinatoire Disallow: /*?q= Disallow: /*&q= # Tri produits Disallow: /*?orderby= Disallow: /*?orderway= Disallow: /*&orderby= Disallow: /*&orderway= # Filtres explicites (rare mais existe) Disallow: /*?selected_filters= Disallow: /*&selected_filters= # Pagination AJAX (infinite scroll côté thème, canonical déjà présent) Disallow: /*?p= Disallow: /*&p= Sitemap: https://www.toysngo.com/1_fr_0_sitemap.xml