I am using the find function to retrieve this object: <h1 data-testid=“organization-cover-title” class=“sc-1wcv2gl-2 kpUYKd”>Company</h1> With this code below, it returns a NoneType company = soup.find(‘h1’, attrs = {‘data-testid’:‘organization-cover-title’, ‘class’:‘sc-1wcv2gl-2 kpUYKd’}).string It also does not return a string with one or…
I'm trying to scrape specific details as a list from a page using BeautifulSoup in python. <p class="collapse text in" id="list_2"> <big>•</big> car <br> <big>•</big> bike <br> <span id="list_hidden_2" class="inline_hidden collapse in" aria-expanded="true"> <big>•</big> bus <br> <big>•</big> train <br><br> </span>…
I'm trying to get hands on some tickets for the Collosseum in Rome in a few weeks. But the Full Experience Tickets are always sold out! So I thought about tracking the website and check if there is availability for…
For my first experience in Python, I'm using Selenium and Beautifulsoup to retrieve article titles from a website. However, I'm having trouble to take child from a div, I just find the first span but not the second... I present…
I am trying to find different tags at once using find_all() method of BeautifulSoup. I found a way to include all tags in the list to get the respective tags. But I am trying to get tags along with their…
I have to scrape text from a div that has all the article text but the class name of the div is not unique so I tried using CSS selectors but it is returning an empty list. import requests from…
I am parsing some text in Python, using BeautifulSoup4. The address block starts with a cell like this: <td><strong>Address</strong></td> I find the above cell using soup.find("td", "Address") But, now some addresses have a highlight character too, like this: <td><strong><span>*</span>Address</strong></td> This…
Is it possible to remove all text from HTML nodes with a regex? This very simple case seems to work just fine: import htmlmin html = """ <li class="menu-item"> <p class="menu-item__heading">Totopos</p> <p>Chips and molcajete salsa</p> <p class="menu-item__details menu-item__details--price"> <strong> <span…
Im trying to scrape the link of image from url https://www.eaton.com/us/en-us/skuPage.101012%2520G.html All my solutions failed; here are my attempts: print(soup.select_one('[class="module-media-gallery__image lazyload"]')["src"]) img=soup.find('img',attrs={'class':'module-media-gallery__image lazyload'}) img=soup.find('img',class_='module-media-gallery__image lazyload')
Hi all, I am scraping questions on Amazon using the following code: url = "https://www.amazon.com/ask/questions/asin/B0000CFLYJ/1/ref=ask_ql_psf_ql_hza?isAnswered=true" r = requests.get("http://localhost:8050/render.html", params = {'url': url, 'wait': 3}) soup = BeautifulSoup(r.text, 'html.parser') questions = soup.find_all('div', {'class':'a-fixed-left-grid-col a-col-right'}) print(questions) question_list = [] for item in…