I'm trying to capture the number of elements in a list using Beautiful Soup but I'm encountering an issue and getting a null array back. I'm pretty sure this used to work for me but not anymore. I'd appreciate any…
I have a code that grabs a price tag from this HTML section <div class="main"> <div class="cost-box"> <ins><span>$</span><price>10.00</price></ins> </div> </div> Here's the code I use to get the 10.00 price: import requests from bs4 import BeautifulSoup as bs url =…
I'm trying to get all the album names and prices from this website: https://vinilosalvaro.cl/tienda/ But with the following script I'm just getting one of them. import requests from bs4 import BeautifulSoup URL = 'https://vinilosalvaro.cl/tienda/' headers = {'User-Agent': 'Mozilla/5.0 (Windows NT…
I'm trying to write a bot that sends an email when there is a warning from the German Weather Service (Deutsche Wetterdienst DWD). This bot will be implemented in Python on my Raspberry Pi. I want to extract some information…
i have the following table <table class="suppress_all sortable stats_table now_sortable sticky_table eq1 re1 le1" id="divs_standings_W" data-cols-to-freeze=",1"> <caption> Table</caption> <colgroup><col><col><col><col><col><col><col><col></colgroup> <thead> <tr> <th aria-label="Western Conference" data-stat="team_name" scope="col" class=" poptip sort_default_asc left">Western Conference</th> <th aria-label="Wins" data-stat="wins" scope="col" class=" poptip right" data-tip="Wins">W</th> <th…
Is there a way for me to use BeautifulSoup to get the text of tags that contain more than one word? For example if I had HTML: <div> <div> <a>hello there</a> <a>hi</a> </div> <a>what's up</a> <a>stackoverflow</a> </div> ...I just want…
This is the link. I am trying to scrape the entire description texts. It is all under a div class called "station-tabs-content-inner". But some texts are under the lists tag and some are under the p tag with no specific…
I need to extract different elements from a JSON part of the page, each element under @type. I tried this post but could not figure it out. data = soup.findAll('script', {'type':'application/ld+json'}) oJson = json.loads(data.text)["model"] gives an error of AttributeError: ResultSet…
I have HTML files containing the following structures: <script type="text/json" placeholder-data="1"> {"name":"john","args":{"id":989,"hobbies":["gardening","boxing","guitar","hunting"],"is_rookie":false}} </script> I am only interested in the list name 'hobbies'. How can I extract it with Python ?
I'm doing a following link activity on Python ( it's an assignment on Python Web Access Data - Coursera). Here is the problem: In this assignment you will write a Python program that expands on http://www.py4e.com/code3/urllinks.py. The program will use…