skip to Main Content

I create a web application and host this site using wordpress.When i search name in goole it is showing

A description for this result is not available because of this site’s robots.txt

Why this is happening.Is there problem in metatag?

2

Answers


  1. Your site’s robots.txt file is disallowing crawling of the page you found in Google Search. This means Google’s bot won’t visit this page to read its content.

    The robots.txt file exists at the URL /robots.txt, e.g., http://example.com/robots.txt.

    You’ll want to look for and check any lines starting with Disallow::

    • Disallow: allows everything
    • Disallow: / blocks everything
    • Disallow: /a blocks every URL whose path starts with /a,
      e.g. http://example.com/a, http://example.com/abc, http://example.com/a/b.html etc.
    Login or Signup to reply.
  2. If you have the Yoast SEO plugin installed, you can find and edit the robots.txt file at
    SEO > Tools > File Editor

    If you use Google Search Console (highly recommended) then you can test your robots.txt file
    Go to Crawl > robots.txt tester

    GSC – https://www.google.com/webmasters/tools/home?hl=en

    Login or Signup to reply.
Please signup or login to give your own answer.
Back To Top
Search