With this description in robots.txt, in pritspe allowed indexing of the main page of the site?

User-agent: * Allow: /wp-content/uploads Allow: /wp-includes/*.js Allow: /wp-includes/*.css Allow: /wp-content/*.js Allow: /wp-content/*.css Disallow: /coupon-categories/* Disallow: /wp-admin/* Disallow: /coupons/* Disallow: /coupon-tags/* Disallow: /cgi-bin/ Disallow: /wp-login.php Disallow: /wp-register.php Disallow: /wp-includes/ Disallow: /xmlrpc.php Disallow: /wp-admin Disallow: /author/ Disallow: /wp-content/ Disallow: /page/ Disallow: /tag/
  • allow: /$ to allow and disallow: /$ to disable. - jfs

1 answer 1

In the prohibiting and allowing directories written by you, it is not described about the directories which are located above the section, in this case it is the main page of the site. It turns out that it is indexed if it is in the root of the directory.

In general, robots.txt is designed to disable indexing, and sitemap.xml is intended to allow indexing.