I have some VBA coding experience, but I am still an newbie in Web Scraping. I face the following problem: I am trying to scrape the article text by getting all the <p> tags that come after <h2> tags. The…
I'm trying to get DE(GERMANY) and IN(INDIA) printed in to a list using class="lnsTableCell lnsTableCell--left" from the html below so that I can create a CSV later. <div role="gridcell" tabindex="0" data-test-subj="dataGridRowCell" class="euiDataGridRowCell euiDataGridRowCell--stripe euiDataGridRowCell--firstColumn" style="position: absolute; left: 0px; top: 73px;…
I am trying to do web scraping to acquire a list of international locations using this website: https://restaurants.subway.com I am currently having this issue with my code where the href is being repeatedly added to my url through the "links"…
I'm using requests_html module in python to render web pages dynamically. However, I've been facing an issue with chromium download when render method is used (see below code snippet): response = session.get(url) response.html.render(timeout=20) The error shown is: "OSError: Chromium downloadable…
Premise There is this website I'm trying to scrape. https://pb.nalog.ru/ If you put organization ID in a search bar, and press "Искать", it redirects you to a separate page with base url of https://pb.nalog.ru/search.html and hash "#t=*&mode=search-all&queryAll=ID" where t are…
I would like to get all physical addresses in MS-excel from this url [https://www.tamoil.ch/en/store-locator]. The spreadsheet only has a header, but no output from the code. import requests from bs4 import BeautifulSoup import pandas as pd # Send a GET…
There is a website like bonbast.com and I'm trying to get values but I'm just confused about how to do it. Values should be something like the output of "US Dollar" and "Euro". My code: import requests from bs4 import…
After updating google chrome this weekend, headless mode using Selenium python API is bringing up a blank window when running in windows. The identical code I had running on a Debian VM does not work any longer. Here is a…
here's the HTML code. <div class="list-row"> <div class="list-item"> <div class="imgframe"> <div class="img-wrap"> <div class="img-item"> <a href=""> <img src="img1"> </a> <div class="in-lable"> <a href="link1"> <span class="title">title1</span> </a> </div> </div> <div class="img-item"> <a href=""> <img src="img2"> </a> <div class="in-lable"> <a href="link2"> <span…
I have a classic "it works on my machine" problem, a web scraper I ran successfully on my laptop, but with a persistent error whenever I try and run it in a container. My minimal reproducible dockerized example consists of…