# Ganze Site für alle Robots freigeben # Wenn man den Slash (/) hinter Disallow wegläßt # gibt man Seine Site ganz für die Indexierung frei # Robots die durchdrehen fliegen raus User-agent: GagaRobot User-agent: EmailCollector User-agent: Microsoft URL Control User-agent: Microsoft URL Control - 6.00.8169 User-agent: Microsoft URL Control - 5.01.4511 User-agent: URL Control User-agent: GetRight/4.2 User-agent: toCrawl/UrlDispatcher User-agent: Web Image Collector User-agent: LinkWalker User-agent: WWW-Collector-E User-agent: WebZip/4.0 User-agent: WebStripper User-agent: WebSauger User-agent: WebCopier User-agent: Teleport User-agent: TeleportPro User-agent: Telesoft User-agent: Python-urllib User-agent: NetMechanic User-agent: URL_Spider_Pro User-agent: CherryPicker User-agent: EmailSiphon User-agent: WebBandit User-agent: EmailWolf User-agent: ExtractorPro User-agent: CopyRightCheck User-agent: Crescent User-agent: SiteSnagger User-agent: ProWebWalker User-agent: CheeseBot User-agent: grub-client User-agent: grub User-agent: looksmart User-agent: WebZip User-agent: larbin User-agent: b2w/0.1 User-agent: psbot User-agent: 123People User-agent: findestars User-agent: MyOnID User-agent: peekyou User-agent: Pipl User-agent: rapleaf User-agent: snitch User-agent: spock User-agent: tweepz User-agent: wink User-agent: Yasni User-agent: yoname User-agent: yourtraces User-agent: zoominfo Disallow: / User-agent: * Disallow: /cgi-bin/ Disallow: /logs/ Disallow: /img/