Issue with AWS CDK, TypeScript Lambda, and Lambda Layers - chromium.executablePath Not a Function I am working on an AWS Lambda function in TypeScript using AWS CDK for deployment. My Lambda function utilizes Puppeteer and a custom Chromium build to…
I'm building a web scraper for a school web page. I imported Puppeteer to scrape a client side rendered HTML file. However, I met some problems while developing. My code is: const puppeteer = require("puppeteer"); async function scrapeData(url) { console.log("Target…
Issue: I cannot select the calendar widget on hotel website (https://www.ihg.com/hotels/us/en/reservation). Error: Node is either not clickable or not an Element What I tried (below is my code): const puppeteer = require('puppeteer') const fs = require('fs/promises') async function start(){ const…
I'm new to JavaScript and to the Puppeteer Library. I know what async programming is and I've been playing around with it in JavaScript but when I try to use it with Puppeteer I get errors. This is my index.js…
Issue with Puppeteer in AWS Lambda - Missing libnss3.so Library I am trying to run Puppeteer on AWS Lambda using the chrome-aws-lambda package. However, I'm encountering an error related to a missing shared library, libnss3.so. The relevant part of the…
I'm using this Laravel package: https://github.com/spatie/browsershot to take a screenshot. It's based on Puppeteer But when I run it returns this error Error Output: Error: Could not find Chrome (ver. 119.0.6045.105). This can occur if either 1. you did not…
I have a container on the website and I want to get all the tags that are present in that particular container only. <div class="c-product-review-card"> <div class="c-product-review-card__container"> <div class="c-product-review-card__left-column"> <div class="c-product-review-user-info c-product-review-card__user-info"> <h5 class="c-product-review-user-info__username u-spacer--1pt5">USERNAME</h5> <div class="c-product-review-user-info__details-container"> <div class="c-product-review-user-info__item"> <p…
I'm encountering a "Protocol error (Page.navigate): Target closed" with Puppeteer in AWS Lambda. This issue started in our production environment after Dec 5th, 12:00pm EST, without any recent changes to the code. The error was not present initially in our…
I am trying to scrape the very first name on a table from a website that presents a basketball team and that team's player's names and statistics. When I do so the Navigation Timeout is exceeded meaning the value was…
I have converted my (scraped) JSON response into a string for use in HTML. This program simply seeks to pull the title of a book off of Amazon, remove the JSON formatting, and output that title in regular string format…