seo Question posted in
Some basic information to get you started with this can be found here.

Can we stop googlebot crawling old pdf url – SEO

In my site their is a button linking to PDF. Let say current pdf url on button is http://www.abc.come/wp-content/uploads/2016/09/xyz.pdf and this url google bot has crawled. Now later after month from admin, administrator uploads new pdf let say http://www.abc.come/wp-content/uploads/2016/09/xyz-latest.pdf and updates url on button.

Issue is that googlebot is still crawling old url with xyz.pdf and giving 404 in webmaster tools.

How can we make googlebot to stop crawling old url and crawl new ones.

Thanks.

Tags:

2

Answers


  1. 0

    Yup you can.

    Under webmaster go to Google Index -> Remove URLS. Remove you url from here and then from your app. Works for me.

    Login or Signup to reply.
  2. 0

    I had the same issue, my solution was an entry in the .htaccess with an 410 (‘gone’) statuscode. After some time google stops crawling.
    But I also read that Google will stop crawling when 404. But on my site it keeps crawling 404-sites.

    Login or Signup to reply.
Please signup or login to give your own answer.

Back To Top
Search