skip to Main Content

what is the differences the lists below:

<meta name="robots" content="index, follow">

<meta name="robots" content="follow">

<meta name="robots" content="noindex, follow">

<meta name="robots" content="index, nofollow">

<meta name="robots" content="noindex, nofollow">

3

Answers


  1. The main difference between these tags is, in very simple words:

    noindex
    The page is supposed to not be shown in the result list of pages like google, yahoo and so on.
    index means the opposite and allows it.

    nofollow
    Disallows crawlers/robots to call (follow) links that are embedded in / found on pages that carry this flag in their meta data.
    follow means the opposite and allows it.

    Now you can figure out yourself what each combination of both results in. 😉

    Login or Signup to reply.
  2. The spider will index your whole website.
    The spider will not only index the first web-page of your website but also all your other web-pages as it crawls through links from this page.

    Tells the search engines that it may follow links on the page, to discover other pages. (both of these are default behaviour)

    <meta name="robots" content="index, follow">
    
    <meta name="robots" content="follow">
    

    The spider will now index your whole website. The spider will not index the web-page but it may follow links on the page, to discover other pages.

    <meta name="robots" content="noindex, follow">
    

    The spider will index this page but it won’t follow links on this page to new pages.

    <meta name="robots" content="index, nofollow">
    

    The spider won’t index this page at all and won’t follow links on this page to any other pages.

    <meta name="robots" content="noindex, nofollow">
    

    Sources:

    https://www.metatags.org/meta_name_robots

    https://yoast.com/robots-meta-tags/

    https://developer.mozilla.org/en-US/docs/Web/HTML/Element/meta#attr-name

    Login or Signup to reply.
  3. First of all, do you know about Meta Robots Tags?
    Meta Robots Tags is to tell the spider or crawler which page to crawl or index or not.

    Follow means : page will be crawled.
    No Follow means : page will not be crawled.
    Index means : your page show in search Results.
    No Index means : your page does not show in search Results.


    <meta name="robots" content="index, follow">
    

    This tag tells the web crawler all pages will be indexed and to crawl them.


    <meta name="robots" content="follow">
    

    This tag is used to tell the web crawler all pages will be crawled and indexed.


    <meta name="robots" content="noindex, follow">
    

    This tag is used to tell the crawler to follow but not index the page in your database.


    <meta name="robots" content="index, nofollow">
    

    To tell the web crawler page not crawl but index them.


    <meta name="robots" content="noindex, nofollow">
    

    To tells the web crawler to neither index nor crawl.

    Login or Signup to reply.
Please signup or login to give your own answer.
Back To Top
Search