User-agent: Googlebot Disallow: /2008/ Disallow: /2009/ User-agent: Fast-Webcrawler Disallow: /2008/ Disallow: /2009/ Disallow: /main/ User-agent: MSNBot Disallow: /2008/ Disallow: /2009/ Disallow: /main/ User-agent: Slurp Disallow: /2008/ Disallow: /2009/ User-agent: Netcraft Disallow: /2008/ Disallow: /2009/ Disallow: /main/ User-agent: ia_archiver Disallow: /2008/ Disallow: /2009/ Disallow: /main/ User-agent: Twiceler Disallow: /2008/ Disallow: /2009/ Disallow: /main/ User-agent: Exabot Disallow: /2008/ Disallow: /2009/ Disallow: /main/ User-agent: SheenBot Disallow: /2008/ Disallow: /2009/ Disallow: /main/ User-agent: aiHitBot-DM Disallow: /2008/ Disallow: /2009/ Disallow: /main/ User-agent: Baiduspider Disallow: /2008/ Disallow: /2009/ Disallow: /main/ User-agent: panscient.com Disallow: /2008/ Disallow: /2009/ Disallow: /main/ User-agent: Yandex Disallow: /2008/ Disallow: /2009/ Disallow: /main/ User-agent: 008 Disallow: /2008/ Disallow: /2009/ Disallow: /main/ User-agent: DotBot Disallow: /2008/ Disallow: /2009/ Disallow: /main/ User-agent: MLBot Disallow: /2008/ Disallow: /2009/ Disallow: /main/ User-agent: Wget Disallow: /2008/ Disallow: /2009/ Disallow: /main/ User-agent: spbot Disallow: /2008/ Disallow: /2009/ Disallow: /main/ User-agent: yacybot Disallow: /2008/ Disallow: /2009/ Disallow: /main/ User-agent: ScoutJet Disallow: /2008/ Disallow: /2009/ Disallow: /main/ User-agent: MJ12bot Disallow: /2008/ Disallow: /2009/ Disallow: /main/