User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-includes/ Disallow: /tag/ Disallow: /wp-trackback/ Disallow: /wp-feed/ Disallow: /wp-comments/ Disallow: */trackback/ Disallow: */feed/ Disallow: */comments/ Disallow: /?feed= Disallow: /?search= Disallow: /search/ Disallow: /page/ # Keep these commented out if you need them for your Python scripts # Disallow: /wp-json/ # Disallow: /xmlrpc.php # Allow specific files/directories Allow: /wp-content/uploads/ # Sitemap location Sitemap: https://pestkill.org/sitemap_index.xml