# Ganze Site für alle Robots freigeben # Wenn man den Slash (/) hinter Disallow wegläßt # gibt man Seine Site ganz für die Indexierung frei # Robots die durchdrehen fliegen raus User-agent: GagaRobot Disallow: / # email Sammler draussenbleiben User-agent: EmailCollector Disallow: / #Despictable and evil robots to keep out :) User-agent: Microsoft URL Control Disallow: / User-agent: Microsoft URL Control - 6.00.8169 Disallow: / User-agent: Microsoft URL Control - 5.01.4511 Disallow: User-agent: URL Control Disallow: / User-agent: GetRight/4.2 Disallow: / User-agent: toCrawl/UrlDispatcher Disallow: / User-agent: Web Image Collector Disallow: / User-agent: LinkWalker Disallow: / User-agent: WWW-Collector-E Disallow: / User-agent: WebZip/4.0 Disallow: / User-agent: WebStripper Disallow: / User-agent: WebSauger Disallow: / User-agent: WebCopier Disallow: / User-agent: Teleport Disallow: / User-agent: TeleportPro Disallow: / User-agent: Telesoft Disallow: / User-agent: Python-urllib Disallow: / User-agent: NetMechanic Disallow: / User-agent: URL_Spider_Pro Disallow: / User-agent: CherryPicker Disallow: / User-agent: EmailCollector Disallow: / User-agent: EmailSiphon Disallow: / User-agent: WebBandit Disallow: / User-agent: EmailWolf Disallow: / User-agent: ExtractorPro Disallow: / User-agent: CopyRightCheck Disallow: / User-agent: Crescent Disallow: / User-agent: SiteSnagger Disallow: / User-agent: ProWebWalker Disallow: / User-agent: CheeseBot Disallow: / User-agent: grub-client Disallow: / User-agent: grub Disallow: / User-agent: looksmart Disallow: / User-agent: WebZip Disallow: / User-agent: larbin Disallow: / User-agent: b2w/0.1 Disallow: / User-agent: psbot Disallow: / User-agent: * Disallow: /cgi-bin/ Disallow: /logs/ Disallow: /img/