I am trying to make a web crawler - scraper to get the news. I want to remove elements that are in a specific class. But, the problem is that this class is nested in another class. The code is…
I am trying to scrape the site 'stockx' to get the information at the bottom under the 12 month historical section, for some reason I can get some elements such as the last_sale price, but I can't get any of…
The code is just from bs4 import BeautifulSoup print(BeautifulSoup.__file__) and the error shows File "/path/to/wtfisgoingon.py", line 1, in <module> from bs4 import BeautifulSoup ImportError: cannot import name 'BeautifulSoup' from 'bs4' (unknown location) Downloaded BeautifulSoup4 on Linux Ubuntu 20.04 using: sudo…
I'm a web-scraping beginner and am trying to scrape this webpage: https://profiles.doe.mass.edu/statereport/ap.aspx I'd like to be able to put in some settings at the top (like District, 2020-2021, Computer Science A, Female) and then download the resulting data for those…
I have a list of text like this- and I want to count the number of lines in this. I thought of splitting it by ". ", but it will create extra lines for words like "a.m.". Please help! […
I'm trying to scrape some data from a website that detects live fotball odds drop and if there is a specific change in the HTML of the page,it will send me a notification to a Telegram bot that I've made..here…
I'm trying to create a simple webscraper in python that find, download and create a pdf of certain images found in the website. For now I only created the webscraping part of the code: import requests from bs4 import BeautifulSoup…
I am scraping an product information. But I scrape its price it doesn't give me proper output. There is no error but not the desired output. And also it produce error while finding the category of a product. Here is…
I am trying to run a Beautiful Soup demo to scrape prices from Ebay and the prices are all in USD but for some reason when I scrape the prices it automatically converts it into NT$. Not sure what is…
I'm using the following code for SERP to do some SEO, but when I try reading the href attribute I get incorrect results showing other wired URLs from the page but not the one intended. What is wrong with my…