User-agent: * Disallow: /data User-agent: * Disallow: /data User-agent: NinjaBot Disallow: /data User-agent: Googlebot Disallow: /data User-agent: Googlebot-Mobile Disallow: /data User-agent: Googlebot-Image Disallow: /data User-agent: Mediapartners-Google Disallow: /data User-agent: Adsbot-Google Disallow: /data User-agent: Bingbot Disallow: /data User-agent: Slurp Disallow: /data User-agent: msnbot Disallow: /data User-agent: msnbot-media Disallow: /data User-agent: Teoma Disallow: /data User-agent: twiceler Disallow: /data User-agent: Gigabot Disallow: /data User-agent: Scrubby Disallow: /data User-agent: Robozilla Disallow: /data User-agent: ia_archiver Disallow: /data User-agent: baiduspider Disallow: /data User-agent: naverbot Disallow: /data User-agent: yeti Disallow: /data User-agent: yahoo-mmcrawler Disallow: /data User-agent: psbot Disallow: /data User-agent: asterias Disallow: /data User-agent: yahoo-blogs Disallow: /data User-agent: Yandex Disallow: /data User-agent: Specify Disallow: /data User-agent: Googlebot-Image Disallow: /data User-agent: AdsBot-Google-Mobile-Apps Disallow: /data