# generated 2024-03-29 08:20:27 for www.weltfussball.de User-Agent: AhrefsBot User-Agent: AiHitBot User-Agent: BLEXBot User-Agent: CareerBot User-Agent: Cliqzbot User-Agent: dotbot User-Agent: grapeshot User-Agent: iCjobs User-Agent: linkdexbot User-Agent: magpie-crawler User-Agent: MegaIndex User-Agent: MJ12bot User-Agent: proximic User-Agent: QuerySeekerSpider User-Agent: scrapybot User-Agent: scrapy User-Agent: SemrushBot User-Agent: SEOkicks-Robot User-Agent: sentibot User-Agent: TkBot User-Agent: trendkite-akashic-crawler User-Agent: Vagabondo User-Agent: WBSearchBot Disallow: / User-Agent: Baiduspider User-Agent: bingbot User-Agent: YandexBot User-Agent: Yahoo! Slurp Crawl-delay: 10 Disallow: /xml/ Disallow: /*? User-agent: * Disallow: /xml/ Disallow: /*?