User-agent: * Disallow: /cgi-bin Disallow: /Img Disallow: /wgl Disallow: /ymix Disallow: /Roverbot Disallow: /Robozilla Disallow: /ord/ Disallow: /dnf/ Disallow: /store/catalog/ Disallow: /scan/ Disallow: /research.html Disallow: /process.aspx* Disallow: /checkout.html Disallow: /cart.html User-agent: TMCrawler Disallow: / # End robots.txt file