User-agent: * # following entries tell spiders to ignore folders Disallow: /Admin/ Disallow: /App_Browsers/ Disallow: /bin/ # Disallow: /Category/ - Commented out as this causes issues when URL rewriting is enabled Disallow: /Common/ Disallow: /controls/ Disallow: /fonts/ Disallow: /GiftRegistryTemplate/ Disallow: /images/ Disallow: /javascript/ Disallow: /Product_Compare/ # Disallow: /Products/ - Commented out as this causes issues when URL rewriting is enabled Disallow: /SQLJob/ Disallow: /Styles/ # Disallow: /supplyimages/ Disallow: /Templates/ Disallow: /uploadfiles/ Disallow: /UserAccount/ Disallow: /vendorproductuploadfiles/ Disallow: /WebService/ Disallow: /XSLT/ # - Recent additions Disallow: /ScriptResource.axd Disallow: /WebResource.axd Disallow: /TemplatesCart/ Disallow: /TemplatesDocuments/ Disallow: /TemplatesItems/ Disallow: /TemplatesWebcontrols/ Disallow: /TemplatesDocuments/ Disallow: /LeftCategoryHandler.ashx