# Robots.txt file for http://tvnz.co.nz # User-agent: Mediapartners-Google Disallow: User-agent: Slurp Disallow: /cda/ Disallow: /view-preempt/ Crawl-delay: 1 User-agent: Googlebot Disallow: /cda/ Disallow: /view-preempt/ Crawl-delay: 1 User-agent: msnbot Disallow: /cda/ Disallow: /view-preempt/ Crawl-delay: 1 User-agent: * Disallow: /cda/ Disallow: /view-preempt/ Crawl-delay: 1 User-Agent: MJ12bot Disallow: /cda/ Disallow: /view-preempt/