# Robots.txt file for http://www.tvnz.co.nz # User-agent: Slurp Disallow: /cda/ Disallow: /view-preempt/ Crawl-delay: 300 User-agent: Googlebot Disallow: /cda/ Disallow: /view-preempt/ Crawl-delay: 120 User-agent: msnbot Disallow: /cda/ Disallow: /view-preempt/ Crawl-delay: 120 User-agent: * Disallow: /cda/ Disallow: /view-preempt/ Crawl-delay: 90 User-Agent: MJ12bot Disallow: /cda/ Disallow: /view-preempt/