# Throttle YandexBot User-Agent: YandexBot Crawl-Delay: 10 # Throttle BingBot User-agent: bingbot Crawl-delay: 1 # Throttle SeekportBot User-agent: SeekportBot Crawl-delay: 2 # Block SemrushBot User-Agent: SemrushBot Disallow: / # Block dotbot User-Agent: dotbot Disallow: / # Block MJ12Bot User-agent: MJ12bot Disallow: / User-agent: * Allow: /api.php?action=mobileview& Allow: /load.php? Disallow: /api.php Disallow: /edit Disallow: /watch Disallow: /unwatch Disallow: /submit Disallow: /history Disallow: /purge Disallow: /info Disallow: /Special: Disallow: /index.php?title=Special: Disallow: /index.php?mobileaction= Disallow: *veaction=edit*