This is a work-in-progress project where I enter a postcode (which will eventually become a list) into a website and then save the results from the website to a CSV using some kind of loop to move onto the next.…
Have a couple web scraping scripts using selenium and Firefox I'm trying run inside of a docker container. I'm using Arch Linux, but I've made sure to closely follow the install directions on the official docker website specific to arch…
I have a rather strange problem that I can't explain. Context: as part of a project, I created a webscraping script (Selenium + Beautifulsoup) to retrieve job offers in France on Linkedin for Data professions (Data Analyst, Data Engineer, Data…
This is a tough one for me, I've read through all earlier posts before posting the question. HTML web table structure is as below, I'd like the date part from the span tag, below are all the code I've tried.…
My Chrome browser version is 119.0.6045.160. My chrome driver version is 119.0.6045.105. My Selenium java version is 4.8.3. I am doing web Scrapping with selenium. It runs without error in springboot. I have also set the binary path. ChromeOptions options…
I have a selenium scraper that open the site and login in to it. The site has been written by react or react native and the data of the page get from API. I want when the selenium open the…
I am trying to select an element to click it on a page (https://twitchtracker.com/riotgames/games). The element is a selectable date on a calendar pop-up. It is <div class="day unit in-range" data-time="1698822000000">1</div>. Is there any way to select the element using…
I am trying to click on a checkbox on a website using selenium webdriver. The HTML for the checkbox is this following: <input type="checkbox" name="registrationForm:certIndCB" id="registrationForm:certIndCB" value="true" onclick="continueAction();"> I tried the following codes: # first code driver_wait = WebDriverWait(driver, 10)…
I am starting a Docker container with Chrome inside, as follows: docker run --rm --cap-add=SYS_ADMIN --network=host selenoid/vnc:chrome_117.0 In my local machine, this container listens to incoming requests in the following URL: http://localhost:4444/ Nevertheless, I have a "connection refused" error when…
Im building a function to scroll on a website for a given amount of time using the executeScript function in selenium webdriver in javascript. the default timeout for a script appears to be around 15 seconds until it throws an…