Got a notification from google webmaster tools that the number of 404 errors have gone up considerably, on inspecting the crawl errors I see a lot of errors to something that shouldn’t there:
I checked the source code but didnt find a mention of said URL so dont know where google is getting is from. This plugin directory doesn’t even exist. Its a WordPress installation so theres a wp-content/plugins folder but no plugins/ folder.
What could be going on.. why is google trynna index a non existent URL and getting a 404.
Site URL is http://ladiesnightandbrunchesdubai.com
Any help would be appreciated.
2
Answers
I’m seeing the same thing on my wordpress site. First occurrence was 11/23. There are now around 500 urls and growing.
I’ve grepped the wordpress codebase and can’t find where that path is being constructed and discovered by google.
To fix the 404 report in Webmaster Tools I’ve added a 301 redirect on ‘^/plugins/feedback.php’ to the homepage. And then marked all as ‘Fixed’ in Webmaster Tools.
This URL comes from Facebook Comments plugin. As it is not absolute URL, Google crawler thinks it is pointing to your website.
This probably didn’t happen before either because:
1) Google crawler recently started execute more and more javascript – http://googlewebmastercentral.blogspot.be/2015/10/deprecating-our-ajax-crawling-scheme.html If this is the case, we could encounter more problems like this with 3rd party scripts on our website.
2) maybe Facebook comments plugin didn’t have relative URLs
Solution:
Tell Google not to crawl these URLs by adding them to robots.txt