So I Wrote the code and ran it and got the .xlsx file but the output is not as the same order of the Url list i put in the code. #importing the libraries import re import lxml import chardet…
I need help with my Twitter bot that will auto tweet every hour (i have sorted out all the api and stuff so its all good). But i cannot seem to be able to run BeautifulSoup the way i intend…
I'm working on an eBay Scraper, and I'm having some trouble with a simple "AttributeError: 'NoneType' object has no attribute 'text'"... Here is my code url = 'https://www.ebay.com/sch/i.html?_from=R40&_nkw=2017+patrick+mahomes+psa+10+auto&_sacat=0&rt=nc&LH_Sold=1&LH_Complete=1&_ipg=100' def get_data(url): r = requests.get(url) soup = bs(r.text, 'html.parser') return soup def…
How do I scrape text with no specific class? I have pulled up a past eBay listing that sold via auction. Here is the snippet of code from the heading section. <h1 class="it-ttl" id="itemTitle" itemprop="name"><span class="g-hdn">Details about </span>2018 Panini Contenders…
I have a simple script to analyze sold data on eBay (baseball trading cards). It seems to be working fine for the first 4 pages but on the 5th page it simply does not load in the desired html content…
I am trying to scrape the title of every item on an ebay page. This is the page. I first tried to scrape the title of the first listing (lines 5-7 of my code) , and I was successful as…
I am trying to collect data from shoes on eBay. For every item I want to collect all data including the custom description to build up a database. I have collected all aspects such as price, shipping title etc. with…
I am trying to scrape the price of the coin from the link below using the following Python Script, however I am running into some issues. If you could identify where I am going wrong then that would be great!…
I am trying to retrieve the variable in json format to python. url = "https://limitededt.com/collections/footwear/products/adidas-originals-jonah-hill-superstar-fw7577" source = requests.get(url).text soup = BeautifulSoup(source, 'lxml') print(soup.findAll('script')[10]) The code above produces: <script>window.ShopifyAnalytics = window.ShopifyAnalytics || {}; window.ShopifyAnalytics.meta = window.ShopifyAnalytics.meta || {}; window.ShopifyAnalytics.meta.currency = 'SGD';…
<html> <body> <p> {"products":[{"id":2069443051648,"title":"BornxRaised Indian Summer Print Button-Up Shirt - Multi","handle":"bxrb4010smpt-mlt"}] </p> </body> </html> Hi, I am very new to bs4 and web scraping. I am trying to make an app that returns product information like the item's id, title,…