#MSN Shopping robots.txt file #All pages in the root directory of this site may be crawled User-agent: * Crawl-delay: 2 # For ja-JP locale Disallow: /JP/css/ Disallow: /JP/img/EDT/css/ # For en-Au locale Disallow: /au/CSS/ Disallow: /au/IMG/EDT/css/