I have scraped a JSON from a website. When trying to iterate through the JSON I get a KeyError, but I'm unsure why. The loop is within the length of the JSON. Any ideas as to what is going on?…
So I'm trying to create a Python script that goes to a website. Looks at all the results of coins on the page. Clicks on all the results and checks if there is a telegram link on the page, if…
I'm trying to scrape this site. I used the following code: import requests import json from bs4 import BeautifulSoup api_url ='https://seniorcarefinder.com/Providers/List' headers= { "Content-Type":"application/json; charset=utf-8", "User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:108.0) Gecko/20100101 Firefox/108.0"} body_first_page={"Services":["Independent Living","Assisted Living","Long-Term Care /…
I want to filter a json file from pool.pm For example, https://pool.pm/wallet/$1111 and I want to get all the "policy"'s and how many time it repeats and organize it on a excel using openpyxl and in the first column the…
I'm trying to get a key from a JSON from a website using the following code: import json import requests from bs4 import BeautifulSoup url = input('Enter url:') html = requests.get(url) soup = BeautifulSoup(html.text,'html.parser') data = json.loads(soup.find('script', type='application/json').text) print(data) print("####################################")…
def get_data(url): r = requests.get(url) soup = BeautifulSoup(r.text, 'html.parser') return soup current_data = get_data(link) x = current_data.find_all(text="Style Code:") I'm trying to get the style code of a shoe off ebay but the problem is that it doesn't have a specific…
I have this web scraper program in python, but it prints both tennis players Felix and Alexander. I would like to only print the first available tennis player as a separate item and exclude all the ones after it, so…
I have the following soup: next ... From this I want to extract the href, "some_url" this I want to extract the href, "some_url" and the whole list of the pages that are listed on this page: https://www.catholic-hierarchy.org/diocese/laa.html note: there…
How can I get the average price from a list of scraped items' prices from ebay? This is my code: from urllib.request import Request, urlopen from bs4 import BeautifulSoup import requests from requests_html import HTMLSession link = "https://www.ebay.co.uk/sch/i.html?_from=R40&_trksid=p2334524.m570.l1313&_nkw=5035224123933&_sacat=0&LH_TitleDesc=0&_odkw=EAN5035224123933&_osacat=0" req =…
I prepared three little scripts, that theoretically the should do the same, but two not work properly. I'm not sure what could be wrong. I used PyCharm, and packages was installed inside projects, not globally with PIP. First script don't…