Im currently trying to scrape the following Website. I need to get different sub pages but some of them are hidden behind a load more button so I thought I use selenium to click the button but I cant get…
I'm struggling with this error: (unknown error: DevToolsActivePort file doesn't exist) (The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.) while using selenium module on my Ubuntu-server 22.04. The thing…
I am trying to fetch title of the website "https://www.google.com/" in chrome browser using selenium on Docker. However whenever I execute I get the following exception Exception in thread "main" org.openqa.selenium.SessionNotCreatedException: Could not start a new session. Possible causes are…
I am new to web scraping and I wanted to use the find_element function to find a specific element after already using find_elements, but whenever I try to use it I keep getting this error: list' object has no attribute…
I have a Flask backend that uses Selenium to scrape some information, and I've created a Docker image that downloads Chrome and the Chromedriver necessary to do this. This is my Dockerfile: FROM python:3.11.4-slim-bookworm RUN apt-get update && apt-get install…
The html code shows 4 iframes present and the accept button is within a nested iframe. However, I cant seem to switch to the second iframe (I've tried indexes,locators, and names) where the button is, I get an error saying…
I want to create a catalog of courses by scraping data from a website. I want to go to each item in the url https://www.coursicle.com/harvard/courses/ and pull all the course names within each item. I am using the below code…
I am working with the R programming language and trying to learn about how to use Selenium to interact with webpages. For example, using Google Maps - I am trying to find the name, address and longitude/latitude of all Pizza…
I want to find in Selenium Webdriver an element with the XPath selector "//span[@class='v-treegrid-expander collapsed']" shown in the screenshot below which has a unique sibling with the XPath selector "//div[contains(@class, 'v-treegrid-cell-content') and contains(text(), 'QA-images')]" and while both elements separately can…
how to make selenium click a button like <a href="javascript:void(0)" id="ajax_more_button">さらに読み込む</a> literally, have no 'button' type to it? Hello, I'm trying to scrape urls from https://www.yomiuri.co.jp/editorial/, a news website. To have access to more articles, there's a button さらに読み込む(read more).…