User-agent: AhrefsBot Disallow: / User-agent: DotBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: SemrushBot-SA Disallow: / User-agent: Uptimebot Disallow: / User-agent: MJ12bot Disallow: / User-agent: MegaIndex.ru Disallow: / User-agent: ZoominfoBot Disallow: / User-agent: Mail.Ru Disallow: / User-agent: SeznamBot Disallow: / User-agent: BLEXBot Disallow: / User-agent: ExtLinksBot Disallow: / User-agent: aiHitBot Disallow: / User-agent: Researchscan Disallow: / User-agent: DnyzBot Disallow: / User-agent: spbot Disallow: / User-agent: YandexBot Disallow: / User-agent: SEOkicks Disallow: / User-agent: serpstatbot Disallow: / User-agent: Gecko Disallow: / User-agent: MauiBot Disallow: / User-agent: Baiduspider Disallow: / User-agent: Sogou Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: test-bot Disallow: / User-agent: Go-http-client Disallow: / User-agent: * Allow: /assets/ Allow: /Pic/ Allow: /*.js$ Allow: /*.css$ Allow: /ads.txt$ Allow: /search?q=* Disallow: /chse-rotary/ Disallow: /font/ Disallow: /mgss/ Disallow: /StockList.files/ Disallow: /iptv/ Disallow: /*.htm$ Disallow: /*.html$ Disallow: /*.php$ Disallow: /*.asp$ Disallow: /dispbbs Disallow: /dv_rss Disallow: /friendlist Disallow: /dispuser Disallow: /query Disallow: /ShowHot Disallow: /Show_ Disallow: /ShowClass Disallow: /ShowKW Disallow: /ShowJi Disallow: /ShowJi_find Disallow: /Showtest Disallow: /MemberSSL Disallow: /dayb* Disallow: /date* Disallow: /DIY* Disallow: /*?* Disallow: /M_* Disallow: /*_new$ Disallow: /summert$ Disallow: /contact$ Disallow: /c$ Disallow: /cgPage$ Disallow: /FBservice$ Disallow: /p$ Disallow: /P$ Disallow: /Hot$ Disallow: /*/Hot$ Disallow: /Show-$ Disallow: /k=$ Disallow: /j=$ # Crawlers of certain social media sites are allowed to access page markup when btko.net/images/* links are shared. User-agent: Twitterbot Allow: /images/ Allow: /Pic/ User-agent: facebookexternalhit Allow: /images/ Allow: /Pic/ Sitemap: https://www.btko.net/sitemap.xml