There is a webpage with drop-down button with text inside. I want to retrieve text from that drop-down button, which is : "Description text". Here is html code part: <div data-v-e0a13c66="" data-v-5e9bf2df="" id="DetailDescription" class="detail-dropdown"> <header data-v-e0a13c66="" class="detail-dropdown__header"> <h5 data-v-e0a13c66="" class="detail-dropdown__title…
I have little experience with selenium and would like to understand why my code sometimes finds the necessary elements, and sometimes it returns an error message saying that it did not find anything. Here is a print of one of…
I use this shell in Google Colab, %%shell # Ubuntu no longer distributes chromium-browser outside of snap # # Proposed solution: https://askubuntu.com/questions/1204571/how-to-install-chromium-without-snap # Add debian buster cat > /etc/apt/sources.list.d/debian.list <<'EOF' deb [arch=amd64 signed-by=/usr/share/keyrings/debian-buster.gpg] http://deb.debian.org/debian buster main deb [arch=amd64 signed-by=/usr/share/keyrings/debian-buster-updates.gpg] http://deb.debian.org/debian…
Im currently trying to scrape the following Website. I need to get different sub pages but some of them are hidden behind a load more button so I thought I use selenium to click the button but I cant get…
I'm struggling with this error: (unknown error: DevToolsActivePort file doesn't exist) (The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.) while using selenium module on my Ubuntu-server 22.04. The thing…
I am trying to fetch title of the website "https://www.google.com/" in chrome browser using selenium on Docker. However whenever I execute I get the following exception Exception in thread "main" org.openqa.selenium.SessionNotCreatedException: Could not start a new session. Possible causes are…
I am new to web scraping and I wanted to use the find_element function to find a specific element after already using find_elements, but whenever I try to use it I keep getting this error: list' object has no attribute…
I have a Flask backend that uses Selenium to scrape some information, and I've created a Docker image that downloads Chrome and the Chromedriver necessary to do this. This is my Dockerfile: FROM python:3.11.4-slim-bookworm RUN apt-get update && apt-get install…
The html code shows 4 iframes present and the accept button is within a nested iframe. However, I cant seem to switch to the second iframe (I've tried indexes,locators, and names) where the button is, I get an error saying…
I want to create a catalog of courses by scraping data from a website. I want to go to each item in the url https://www.coursicle.com/harvard/courses/ and pull all the course names within each item. I am using the below code…