User-agent: msnbot Crawl-delay: 1 User-agent: Mediapartners-Google Disallow: