User-agent: * Allow: / Disallow: /store/adm #Crawlers do not need access to your console, so this rule disallows all console pages for crawlers Disallow: /store/shopCa #Crawlers cannot add items to a shopping cart, so prevent them from viewing this page Disallow: /store/WriteR #Crawlers cannot submit product reviews, so there is no need for them to view this page. The content of product reviews is on a separate page that is allowed Disallow: /store/addtoc #is used in embedded commerce and allows items to be added to the cart. There is no content on this page and therefore crawlers do not need to see it. Disallow: /store/OnePageCh # generally contains no inherent SEO value, and crawlers cannot add items to their cart to be able to access this page, therefore it is disallowed Disallow: /store/checko #This page contains no content Disallow: /*Attrib= #If you use attributes, these rules allow you to avoid duplicate content warnings when customers filter by specific attributes. Disallow: /*?Attrib= #If you use attributes, these rules allow you to avoid duplicate content warnings when customers filter by specific attributes. Disallow: *attribs= #If you use attributes, these rules allow you to avoid duplicate content warnings when customers filter by specific attributes. Disallow: *Attribs= #If you use attributes, these rules allow you to avoid duplicate content warnings when customers filter by specific attributes. User-agent: googlebot Disallow: Disallow: /store/adm #Crawlers do not need access to your console, so this rule disallows all console pages for crawlers Disallow: /store/shopCa #Crawlers cannot add items to a shopping cart, so prevent them from viewing the cart page Disallow: /store/WriteR #Crawlers cannot submit product reviews, so there is no need for them to view this page. The content of product reviews is on a separate page that is allowed Disallow: /store/addtoc #is used in embedded commerce and allows items to be added to the cart. There is no content on this page and therefore crawlers do not need to see it. Disallow: /store/OnePageCh # generally contains no inherent SEO value, and crawlers cannot add items to their cart to be able to access this page, therefore it is disallowed Disallow: /store/checko #This page contains no content Disallow: /*Attrib= #If you use attributes, these rules allow you to avoid duplicate content warnings when customers filter by specific attributes. Disallow: /*?Attrib= #If you use attributes, these rules allow you to avoid duplicate content warnings when customers filter by specific attributes. Disallow: *attribs= #If you use attributes, these rules allow you to avoid duplicate content warnings when customers filter by specific attributes. Disallow: *Attribs= #If you use attributes, these rules allow you to avoid duplicate content warnings when customers filter by specific attributes. Disallow: /store/a/ #Attribute Filter This page contains no SEO value and duplicates pages Disallow: /store/a/* #Attribute Filter This page contains no SEO value and duplicates pages Disallow: /store/m/ #Manufacturer Filter This page contains no SEO value and duplicates pages Disallow: /store/m/* #Manufacturer Filter This page contains no SEO value and duplicates pages Allow: /store/admin/inc/scripts/ac.productgroups.js User-agent: msnbot Crawl-delay: 45 User-agent: ShopWiki Disallow: / User-agent: CCBot/1.0 Disallow: / User-agent: MJ12bot Disallow: / User-agent: * Disallow: /i/ Disallow: /i/* Disallow: /store/i/ Disallow: /store/i/* Disallow: /store/picturepopup.aspx* Disallow: /*showall*