User-Agent: * Disallow: /cgi-bin Disallow: /wp-admin/ Disallow: /?s= Disallow: *&s= Disallow: /search Disallow: /author/ Disallow: *?attachment_id= Disallow: */feed Disallow: */rss Disallow: */embed Disallow: /?post_type= Allow: /wp-admin/admin-ajax.php Sitemap: https://www.nginx.com/sitemap_index.xml Sitemap: https://www.nginx.com/nginxconf/2019/sitemap_index.xml # START YOAST BLOCK # --------------------------- User-agent: * Disallow: Sitemap: http://www.nginx.com/sitemap_index.xml # --------------------------- # END YOAST BLOCK