User-agent: * Disallow: /cgi-bin Disallow: /wp-login.php Disallow: /wp-admin/admin-ajax.php Disallow: /wp-admin/ Disallow: /wp-includes Disallow: *action=logout* User-agent: SemrushBot User-agent: AwarioSmartBot User-agent: DotBot User-agent: MJ12bot User-agent: AhrefsBot User-agent: PetalBot User-agent: BUbiNG User-agent: GuzzleHttp User-agent: Yandex* Disallow: /