User-agent: * Disallow: /wp-includes/ Disallow: /wp-admin/ Disallow: /wp-wp-content/plugins/ Disallow: /html-emails/ Disallow: /mail-shots/ Disallow: /wp-login.php User-agent: SemrushBot Disallow: / User-agent: * Disallow: /jobs-feed Disallow: /jobs-feed/file.json