# Stand: 18.06.2019 User-agent: * Disallow: /cgi-bin/ Disallow: /cgi-local/ Disallow: /cgi-mod/ User-agent: 007ac9 Crawler Disallow: / User-agent: 1001FirmsBot Disallow: / User-agent: 360Spider Disallow: / User-agent: 7Siters Disallow: / User-agent: A6-Indexer Disallow: / User-agent: AdAuth Disallow: / User-agent: AdBot Disallow: / User-agent: AdCentriaIM Disallow: / User-agent: admantx-euaspb Disallow: / User-agent: adscanner Disallow: / User-agent: AdsTxtCrawler Disallow: / User-agent: adstxtlab.com Crawler Disallow: / User-agent: AguseScan Disallow: / User-agent: AHC Disallow: / User-agent: AhrefsBot Disallow: / User-agent: aiHitBot Disallow: / User-agent: AlohaBrowser Disallow: / User-agent: AlphaBot Disallow: / User-agent: amp-cloud.de Disallow: / User-agent: AngleSharp Disallow: / User-agent: Anonymous Coward Disallow: / User-agent: Ant.com Disallow: / User-agent: AnyConnect Disallow: / User-agent: ArgClrInt Disallow: / User-agent: Arquivo-web-crawler Disallow: / User-agent: auskunftbot Disallow: / User-agent: axios Disallow: / User-agent: Babya Discoverer Disallow: / User-agent: BacklinkCrawler Disallow: / User-agent: Barkrowler Disallow: / User-agent: bidswitchbot Disallow: / User-agent: BLEXBot Disallow: / User-agent: BoardReader Disallow: / User-agent: BPImageWalker Disallow: / User-agent: BrandONbot Disallow: / User-agent: BUbiNG Disallow: / User-agent: CakePHP Disallow: / User-agent: CamScanner Disallow: / User-agent: CCBot Disallow: / User-agent: CeraCon Disallow: / User-agent: CheckMarkNetwork Disallow: / User-agent: CipaCrawler Disallow: / User-agent: Claritybot Disallow: / User-agent: ClarityDailyBot Disallow: / User-agent: Cliqzbot Disallow: / User-agent: CloudFlare-AlwaysOnline Disallow: / User-agent: Cloudflare-AMP Disallow: / User-agent: coccocbot-image Disallow: / User-agent: coccocbot-web Disallow: / User-agent: CommuniGatePro Disallow: / User-agent: COMODO SSL Checker Disallow: / User-agent: Companybook-Crawler Disallow: / User-agent: Contacts-Crawler Disallow: / User-agent: contxbot Disallow: / User-agent: CORS bot Disallow: / User-agent: crawler4j Disallow: / User-agent: CRAZYWEBCRAWLER Disallow: / User-agent: curb Disallow: / User-agent: Curious George Disallow: / User-agent: Datanyze Disallow: / User-agent: Daum Disallow: / User-agent: DaveCrawler Disallow: / User-agent: dcrawl Disallow: / User-agent: deadlinkchecker Disallow: / User-agent: DF Bot Disallow: / User-agent: Dillo Disallow: / User-agent: Discordbot Disallow: / User-agent: Dispatch Disallow: / User-agent: DnyzBot Disallow: / User-agent: DomainCrawler Disallow: / User-agent: DomainStatsBot Disallow: / User-agent: DotBot Disallow: / User-agent: Dragonbot Disallow: / User-agent: Embedly Disallow: / User-agent: Enolyst Crawler Disallow: / User-agent: eright Disallow: / User-agent: evc-batch Disallow: / User-agent: Evolution Disallow: / User-agent: ExpMag Disallow: / User-agent: ExtLinksBot Disallow: / User-agent: Faraday Disallow: / User-agent: FavOrg Disallow: / User-agent: FemtosearchBot Disallow: / User-agent: Fetchbot Disallow: / User-agent: FiddleSticks Disallow: / User-agent: finbot Disallow: / User-agent: Findxbot Disallow: / User-agent: FlipboardProxy Disallow: / User-agent: focuseekbot Disallow: / User-agent: ForcePointCrawler Disallow: / User-agent: Galaxy Disallow: / User-agent: GarlikCrawler Disallow: / User-agent: GDPR Bot Disallow: / User-agent: Genieo Disallow: / User-agent: GetIntent Crawler Disallow: / User-agent: GigablastOpenSource Disallow: / User-agent: G-i-g-a-b-o-t Disallow: / User-agent: Gigabot Disallow: / User-agent: Gluten Free Crawler Disallow: / User-agent: GmsCore Disallow: / User-agent: Godzilla Disallow: / User-agent: GrapeshotCrawler Disallow: / User-agent: Grobbot Disallow: / User-agent: GroupHigh Disallow: / User-agent: hackney Disallow: / User-agent: heritrix Disallow: / User-agent: Honeybee Disallow: / User-agent: HubSpot Webcrawler Disallow: / User-agent: HyScore Disallow: / User-agent: ia_archiver Disallow: / User-agent: IABTechLab Ads.txt Crawler Disallow: / User-agent: IAS crawler Disallow: / User-agent: IDBot Disallow: / User-agent: idmarch Automatic Disallow: / User-agent: Iframely Disallow: / User-agent: ImplisenseBot Disallow: / User-agent: IndeedBot Disallow: / User-agent: Indy Library Disallow: / User-agent: InetURL Disallow: / User-agent: inoreader Disallow: / User-agent: ips-agent Disallow: / User-agent: istellabot Disallow: / User-agent: James BOT Disallow: / User-agent: Jersey Disallow: / User-agent: JobboerseBot Disallow: / User-agent: Jooblebot Disallow: / User-agent: jpg-newsbot Disallow: / User-agent: K-Meleon Disallow: / User-agent: KOCMOHABT Disallow: / User-agent: KomodiaBot Disallow: / User-agent: Laserlikebot Disallow: / User-agent: lbWappalyzer Disallow: / User-agent: LightspeedSystemsCrawler Disallow: / User-agent: linkdexbot Disallow: / User-agent: ltx71 Disallow: / User-agent: Magic Browser Disallow: / User-agent: magpie-crawler Disallow: / User-agent: MANETurlcheck Disallow: / User-agent: Mappy Disallow: / User-agent: MATLAB Disallow: / User-agent: MauiBot Disallow: / User-agent: MBCrawler Disallow: / User-agent: Mechanize Disallow: / User-agent: mediawords bot Disallow: / User-agent: MegaIndex.ru Disallow: / User-agent: Meta_Bot Disallow: / User-agent: MetaJobBot Disallow: / User-agent: mindUpBot Disallow: / User-agent: Mixnode Disallow: / User-agent: MixrankBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: MojeekBot Disallow: / User-agent: Mojolicious Disallow: / User-agent: Mr.4x3 Disallow: / User-agent: MSIECrawler Disallow: / User-agent: NativeHost Disallow: / User-agent: neofonie search:robot Disallow: / User-agent: Netcraft Disallow: / User-agent: netEstate NE Crawler Disallow: / User-agent: NetNewsWire Disallow: / User-agent: NetObjects Fusion Disallow: / User-agent: NetpeakCheckerBot Disallow: / User-agent: NetpeakSpiderBot Disallow: / User-agent: NetSeer Disallow: / User-agent: NetTrack Disallow: / User-agent: Netvibes Disallow: / User-agent: NewsGatorOnline Disallow: / User-agent: Nimbostratus-Bot Disallow: / User-agent: NinjaBot Disallow: / User-agent: Nmap Scripting Engine Disallow: / User-agent: Node/simplecrawler Disallow: / User-agent: novomind iSHOP LinkBot Disallow: / User-agent: nsrbot Disallow: / User-agent: Nutch Disallow: / User-agent: oBot Disallow: / User-agent: okhttp Disallow: / User-agent: omgili Disallow: / User-agent: OnalyticaBot Disallow: / User-agent: ONBbot Disallow: / User-agent: online-webceo-bot Disallow: / User-agent: OnPageBot Disallow: / User-agent: OnPageLeadsBot Disallow: / User-agent: Openvas Disallow: / User-agent: Optimizer Disallow: / User-agent: OutclicksBot Disallow: / User-agent: panscient.com Disallow: / User-agent: PaperLiBot Disallow: / User-agent: PDFDriveCrawler Disallow: / User-agent: PhantomJS Disallow: / User-agent: Photon Disallow: / User-agent: PHPCrawl Disallow: / User-agent: Pierre Smith Disallow: / User-agent: PingdomPageSpeed Disallow: / User-agent: Pinner-iOS Disallow: / User-agent: PiplBot Disallow: / User-agent: PK bot Disallow: / User-agent: Plukkie Disallow: / User-agent: PocketParser Disallow: / User-agent: proximic Disallow: / User-agent: psscanapp Disallow: / User-agent: PycURL Disallow: / User-agent: Pywikibot Disallow: / User-agent: queuedriver Disallow: / User-agent: Quick-Crawler Disallow: / User-agent: snapADDY.com Disallow: / User-agent: SOcrawl Disallow: / User-agent: Sogou wap spider Disallow: / User-agent: spbot Disallow: / User-agent: SpuhexBot Disallow: / User-agent: ssearch_bot Disallow: / User-agent: StundentWebSurveyProjectBot Disallow: / User-agent: SurdotlyBot Disallow: / User-agent: SurveyBot Disallow: / User-agent: SycamoreBot Disallow: / User-agent: Sysomos Disallow: / User-agent: Taringa UGC Disallow: / User-agent: Thumbor Disallow: / User-agent: ThumbShotsBot Disallow: / User-agent: ThumbSniper Disallow: / User-agent: TinEye-bot Disallow: / User-agent: TMM Crawler Disallow: / User-agent: Toplistbot Disallow: / User-agent: ToutiaoSpider Disallow: / User-agent: trendictionbot Disallow: / User-agent: TrendsmapResolver Disallow: / User-agent: TurnitinBot Disallow: / User-agent: TweetmemeBot Disallow: / User-agent: Twingly Recon Disallow: / User-agent: uCrawler Disallow: / User-agent: Ultrawall Disallow: / User-agent: unfurlist Disallow: / User-agent: Uptimebot Disallow: / User-agent: Utopia WebWasher Disallow: / User-agent: Vagabondo Disallow: / User-agent: VB Project Disallow: / User-agent: VB-Tec:INET Disallow: / User-agent: vebidoobot Disallow: / User-agent: VelenPublicWebCrawler Disallow: / User-agent: Virusdie crawler Disallow: / User-agent: Wappalyzer Disallow: / User-agent: Watambaa Disallow: / User-agent: Web Downloader Disallow: / User-agent: WebCapture Disallow: / User-agent: Webfan.de Maintenance Bot Disallow: / User-agent: Website Security Scanner Disallow: / User-agent: WebSpider Disallow: / User-agent: WeCrawlForThePeace Disallow: / User-agent: WeTestBot Disallow: / User-agent: Wfuzz Disallow: / User-agent: WhatWeb Disallow: / User-agent: win7ie80 Disallow: / User-agent: wonderbot Disallow: / User-agent: woobot Disallow: / User-agent: WordupinfoSearch Disallow: / User-agent: Wotbox Disallow: / User-agent: WWW-Mechanize Disallow: / User-agent: WXplr Disallow: / User-agent: XenForo Disallow: / User-agent: Xenu Link Sleuth Disallow: / User-agent: XoviBot Disallow: / User-agent: XoviOnpageCrawler Disallow: / User-agent: YaK Disallow: / User-agent: Yeti Disallow: / User-agent: YisouSpider Disallow: / User-agent: Yooo! Search Engine Bot Disallow: / User-agent: yoozBot Disallow: / User-agent: your-search-bot Disallow: / User-agent: Your-Website-Sucks Disallow: / User-agent: zgrab Disallow: / User-agent: Zombiebot Disallow: / User-agent: ZoominfoBot Disallow: / User-agent: RankingBot2 Disallow: / User-agent: Rapture Spider Disallow: / User-agent: Raven Link Checker Disallow: / User-agent: raynette_httprequest Disallow: / User-agent: redback Disallow: / User-agent: ResearchBot Disallow: / User-agent: Researchscan Disallow: / User-agent: Riddler Disallow: / User-agent: RobotsTxtParser-VIPnytt Disallow: / User-agent: rogerbot Disallow: / User-agent: RukiCrawler Disallow: / User-agent: RyteBot Disallow: / User-agent: SafeDNSBot Disallow: / User-agent: SafeSearch microdata crawler Disallow: / User-agent: scanner Disallow: / User-agent: sciter Disallow: / User-agent: Scopia Crawler Disallow: / User-agent: ScoutJet Disallow: / User-agent: Scrapy Disallow: / User-agent: Screaming Frog SEO Spider Disallow: / User-agent: Scrutiny Disallow: / User-agent: SearchmetricsBot Disallow: / User-agent: searchVIU.com Linkbot Disallow: / User-agent: Seekport Crawler Disallow: / User-agent: Semanticbot Disallow: / User-agent: SemrushBot Disallow: / User-agent: SentiBot Disallow: / User-agent: Seobility Disallow: / User-agent: SEOdiver Disallow: / User-agent: SEOkicks Disallow: / User-agent: seoscanners.net Disallow: / User-agent: Serf Disallow: / User-agent: SeznamBot Disallow: / User-agent: ShortLinkTranslate Disallow: / User-agent: SHWCrawler Disallow: / User-agent: SiSch-BA-Bot Disallow: / User-agent: Sistrix Disallow: / User-agent: Sitebulb Disallow: / User-agent: SiteExplorer Disallow: / User-agent: SiteGuru Crawler Disallow: / User-agent: Siteimprove.com Disallow: / User-agent: SiteSucker Disallow: / User-agent: SiteTruth.com Disallow: / User-agent: Slackbot Disallow: / User-agent: Slackbot-LinkExpanding Disallow: / User-agent: SMTBot Disallow: /