User-agent: Mediatoolkitbot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: adsbot Disallow: / User-agent: PetalBot Disallow: / User-agent: bingbot Crawl-delay: 10 User-agent: grapeshot Disallow: / User-agent: proximic Disallow: / User-agent: MJ12bot Disallow: / User-agent: CriteoBot/0.1 Disallow: / User-agent: barkrowler Disallow: / User-agent: dotbot Disallow: / User-Agent: ZoomBot Disallow: / User-agent: BLEXBot Disallow: / User-agent: serpstatbot Disallow: / User-agent: Baiduspider Disallow: / User-agent: 360Spider Disallow: / User-agent: Yisouspider Disallow: / User-agent: Bytespider Disallow: / User-agent: Sogou web spider Disallow: / User-agent: Sogou inst spider Disallow: / User-agent: TurnitinBot Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: IonCrawl Disallow: / User-Agent: Neevabot Disallow: / User-agent: Seekport Crawler Disallow: / User-agent: SeekportBot Disallow: / # 26.02.2024 # User-agent: GPTBot # Disallow: /php/ User-agent: ias_crawler Disallow: /