seo Question posted in
Some basic information to get you started with this can be found here.

NextJS Dynamic Pages cannot be crawled – SEO

I’m using NextJS and ExpressJS as Server.

I already implemented the custom routes like the example in the documentation of nextjs (https://nextjs.org/docs#custom-routes-using-props-from-url).
I am also using getInitialProps for server-side rendering.

I also used Screaming Frog SEO Spider as crawler to test if it will be able to crawl my dynamic pages (it can’t crawl my dynamic pages, it will just crawl the static pages).
I don’t know if I’m doing something wrong but I just followed the documentation for custom routes.

I really want the crawlers to crawl my dynamic pages because it will affect the SEO of our website.

Thanks

Tags:

3

Answers


  1. 0

    There is a common SEO recommendation not to build dynamic websites.
    I am not an expert in NextJS and ExpressJS. But in general I can say that most of crawlers don’t like dynamic websites. To crawl dynamic website they need to execute JavaScript, it takes time and resources. As far as I know Google can crawl dynamic website, please follow the link. So, it is possible that Googlebot crawl your website successfully. Please, do not build SPA for SEO.
    About Screaming Frog SEO Spider. As far as I know it also can use Chromium like Googlebot. Please, read the documentation.

    Login or Signup to reply.
  2. 0

    For my project, I added a sitemap.xml.tsx as a page that allows the Google crawler to see all the available pages. In order for this to work, you have to be able to retrieve all the possible dynamic pages that you want to be crawled then create the sitemap.

    I would follow the along with the example given here: https://dev.to/timrichter/dynamic-sitemap-with-next-js-41pe on how to correctly implement the sitemap.

    Login or Signup to reply.
  3. 0

    I don’t know if you managed to solve this, but I’ve faced a similar issue and the problem with my approach, was that I was not rendering any routes on my homepage during build time. Basically, when the crawler got to the homepage, there weren’t any articles visible since javascript was needed to render them (I had a function to render or not the articles). SEO crawlers need links and routes to navigate and map your website 🙂

    Login or Signup to reply.
Please signup or login to give your own answer.

Back To Top
Search