User-agent: APIs-Google
User-agent: AdsBot-Google-Mobile
User-agent: AdsBot-Google
User-agent: Googlebot-Image
User-agent: Googlebot-News
User-agent: Googlebot-Video
User-agent: Googlebot
User-agent: Mediapartners-Google
Disallow: /

User-agent: rogerbot
User-agent: Alexabot
User-agent: AhrefsBot
User-agent: MJ12bot
User-agent: Teleport
User-agent: TeleportPro
User-agent: EmailCollector
User-agent: EmailSiphon
User-agent: WebBandit
User-agent: WebZIP
User-agent: WebReaper
User-agent: WebStripper
User-agent: Web Downloader
User-agent: WebCopier
User-agent: Offline Explorer Pro
User-agent: Offline Explorer
User-agent: HTTrack Website Copier
User-agent: Offline Commander
User-agent: Leech
User-agent: WebSnake
User-agent: BlackWidow
User-agent: HTTP Weazel
User-agent: trendkite-akashic-crawler
User-agent: PetalBot
Disallow: /