I am trying to use regex function in python to filter out links from the html that I scraped on eBay website. My question is how can I filter out those links with using following pattern: https://www.ebay.com/itm/ + all other…
I tried to make a little Beautiful Soup Script, to analyze prices on eBay. So the problem is, that my soup.findAll() that should find the prices, is sometimes working, sometimes not and I am wondering why. So here is my…
I will use this code to explain my doubt: Using the url without sold filter import requests from bs4 import BeautifulSoup import pandas as pd import numpy as np url = "https://www.ebay.es/sch/i.html?_from=R40&_trksid=p2334524.m570.l1313&_nkw=iphone+x&_sacat=0&LH_TitleDesc=0&_udlo=400&LH_Auction=1&_osacat=0&_odkw=Pok%C3%A9mon+card+Charizard+4%2F102&rt=nc" r = requests.get(url) soup = BeautifulSoup(r.text, "html.parser") results…
The script below is meant to look through ebay listings on the ebay search page. The search page is just a list, so I am trying to loop through each li tag and add the content to a variable. For…
I'm trying to scrape the Tradingview web page with my own chart to read boolstates. Here what I mean exactly With this HTML code of the website I'm working with Debian/Linux on a Server and programming with Python. I tried…
I have a Python script that imports a list of url's from a CSV named list.csv, scrapes them and outputs any anchor text and href links found on each url from the csv: (For reference the list of urls in…
I am having issues with parsing a website. There seems to be a "403 Forbidden" error. Does that mean I cannot scrape through the website? If so, is there some sort of work around? import requests from bs4 import BeautifulSoup…
I'm trying to scrape https://sportsbook.draftkings.com/event/179665865?category=odds&subcategory=player-props however my code wasn't working and when I troubleshot it I realized it was taking me to the original page at https://sportsbook.draftkings.com/event/179665865 The first link is a tab within the second link. Here is the…
So I Wrote the code and ran it and got the .xlsx file but the output is not as the same order of the Url list i put in the code. #importing the libraries import re import lxml import chardet…
I need help with my Twitter bot that will auto tweet every hour (i have sorted out all the api and stuff so its all good). But i cannot seem to be able to run BeautifulSoup the way i intend…