Using Node.js, I'm scraping a few different websites. I can't retrieve all the information I need on all the pages I have little knowledge of Puppeteer, yet I tried to do it, watch lots of tutorials/forums Can you help me?…
here is the code : const puppeteer = require("puppeteer"); const getQuotes = async () => { // Start a Puppeteer session with: // - a visible browser (`headless: false` - easier to debug because you'll see the browser in action)…
I'm fairly new to programming and I'm diving into some node.js and puppeteer things. I had a question regarding the difference of use and meaning of rmDir, rmDirSync, rmSync. I was told to try to use rmSync rather than rmDir,…
I want to get the src of multiple images but their selectors don't seem to work, like the elements are fake and aren't actually in the page. https://imgflip.com/memegenerator/Drake-Hotline-Bling This is one of the pages, every page has one of my…
I am trying to automate a login process into one of my accounts and this website has some weird password table that I have to click on to type my password , but when I select a button from the…
Bug expectation I expected the 'Join Now' button to be clicked on the Google Meet page after the 'Dismiss' button has been clicked. Any help would be greatly appreciated. Here is the dom node I am trying to click: <button…
I'm scraping https://naamhinaam.com/baby-girl-names-a?page=${pageNumber} website, and after doing that so, puppeteer throwing an empty object without value. here is my code : const puppeteer = require("puppeteer"); const express = require("express"); const cors = require("cors"); const app = express(); app.use(cors()); let data…
I have a puppeteer project with node.js and i want to find all links present in a page with their status codes. In this page, jumptastic.com/duluth/, i have intentionally placed a link (/blg_redirect/) with a 301, yet my code keeps…
I installed Puppeteer and want to query a selector to work on it. But I have encountered a TypeError: selector.startsWith is not a function error. I tried to fix it by changing core code by adding toString() but it didn't…
I find that following Dockerfile builds fine (on Ubuntu 22.10), finding all the right packages: FROM node:18.15.0 ENV DEBIAN_FRONTEND noninteractive RUN apt-get update && apt-get install -y --no-install-recommends build-essential chromium chromium-sandbox && apt-get clean && rm -rf /var/lib/apt/lists/* Obviously this…