User-agent: Googlebot Disallow: /2008/ Disallow: /2009/ User-agent: Fast-Webcrawler Disallow: /2008/ Disallow: /2009/ Disallow: /main/ User-agent: MSNBot Disallow: /2008/ Disallow: /2009/ Disallow: /main/ User-agent: Slurp Disallow: /2008/ Disallow: /2009/ User-agent: Netcraft Disallow: /2008/ Disallow: /2009/ Disallow: /main/ User-agent: ia_archiver Disallow: /2008/ Disallow: /2009/ Disallow: /main/ User-agent: Twiceler Disallow: /2008/ Disallow: /2009/ Disallow: /main/ User-agent: Exabot Disallow: /2008/ Disallow: /2009/ Disallow: /main/ User-agent: SheenBot Disallow: /2008/ Disallow: /2009/ Disallow: /main/ User-agent: aiHitBot-DM Disallow: /2008/ Disallow: /2009/ Disallow: /main/ User-agent: Baiduspider Disallow: /2008/ Disallow: /2009/ Disallow: /main/ User-agent: panscient.com Disallow: /2008/ Disallow: /2009/ Disallow: /main/ User-agent: Yandex Disallow: /2008/ Disallow: /2009/ Disallow: /main/ User-agent: 008 Disallow: /2008/ Disallow: /2009/ Disallow: /main/