I got some troubles when scraping the questions and answers from websites: https://tech12h.com/bai-hoc/trac-nghiem-lich-su-12-bai-1-su-hinh-thanh-trat-tu-gioi-moi-sau-chien-tranh-gioi-thu-hai The problem is the answer only appear when I click on a div Xem đáp án (scroll down to the end) but it's not a link, it…
The FCC has a database with details about various broadcast licenses. Many of these licenses have pages like this one Most of the data on these pages (and related ones) can be scraped very easily with a combination of the…
Some html writers use <br> in <p>, which is hard to separate when scraping them with bs4. Example: <p> part1 <br> part2 <br> part3 <br> part4 </p> How to transform it into "real" paragraphs, like: <p> <p>part1</p> <p>part2</p> <p>part3</p> <p>part4</p>…
I am attempting to write a code using beautiful soup that prints the text for the links in the left handed gray box on this webpage. In this case the code should return ** Enchantments Bouldering Aasgard Sentinel Argonaut Peak…
I am not from web scaping or website/html background and new to this field. Trying out scraping elements from this link that contains containers/cards. I have tried below code and find a little success but not sure how to do…
I would like to get all physical addresses in MS-excel from this url [https://www.tamoil.ch/en/store-locator]. The spreadsheet only has a header, but no output from the code. import requests from bs4 import BeautifulSoup import pandas as pd # Send a GET…
import requests from bs4 import BeautifulSoup url = 'https://www.somewebpage.com' response = requests.get(url) soup = BeautifulSoup(response.text, 'html.parser') print(soup.prettify()) When I run this, my terminal in codewars appears like the literal webpage associated with the url, hyperlinks and all. When I print…
I am trying to web scrape online job offering web sites for my coursera project. I keep getting a 403 error which, after I searched for its meaning online, I found out that it means that the web site has…
I am facing a rather minor problem where I am unable to use the Library 'Beautifulsoup4'. I use VSCode as IDE and use a Venv with Python Version 3.12.2. Everytime I try to run my programm it gives me the…
I am trying to get a selected value from a html select tag in python. well, it is successful while option attribute is set to selected="selected" but website i am trying to scrap has different option attribute some thing like…