I'm working on an eBay Scraper, and I'm having some trouble with a simple "AttributeError: 'NoneType' object has no attribute 'text'"... Here is my code url = 'https://www.ebay.com/sch/i.html?_from=R40&_nkw=2017+patrick+mahomes+psa+10+auto&_sacat=0&rt=nc&LH_Sold=1&LH_Complete=1&_ipg=100' def get_data(url): r = requests.get(url) soup = bs(r.text, 'html.parser') return soup def…
I am creating web scraper using scrapy python. Here is my code import scrapy class BlogSpider(scrapy.Spider): name = 'blogspider' start_urls = [ 'https://perfumehut.com.pk/shop/', ] def parse(self, response): yield { 'product_link': response.css('a.product-image-link::attr("href")').get(), 'product_title': response.css('h3.product-title>a::text').get(), 'product_price': response.css('span.price > span > bdi::text').get(), }…
I am creating a data scraper using scrapy. I shell the product url using scrapy shell 'https://royalprint.pk/product/name-print-superhero-sweatshirt-011/' and then run this command In [43]: response.css('span.woocommerce-Price-currencySymbol::text').get() Out[43]: 'Rs' It only returns the currency symbol. Here is the source code product image…
I have to collect some data from Twitter via Search. Unfortunately, its not possible to get Twitter API as they have rejected my request many times. I have decided to use twint python module for this purpose. I have installed…
As it is clear GetOldTweets3 is a python library for accessing old tweets which is not easily feasible with libraries like Tweepy. But recently, there is an unsolved issue with it due to the new Twitter API: https://github.com/Mottl/GetOldTweets3/issues/98. The question…
I have a simple script to analyze sold data on eBay (baseball trading cards). It seems to be working fine for the first 4 pages but on the 5th page it simply does not load in the desired html content…
This is part of the json file I have got as an output after running running a python script using the telethon API. [{"_": "Message", "id": 4589, "to_id": {"_": "PeerChannel", "channel_id": 1399858792}, "date": "2020-09-03T14:51:03+00:00", "message": "Looking for product managers /…
I am trying to scrape the title of every item on an ebay page. This is the page. I first tried to scrape the title of the first listing (lines 5-7 of my code) , and I was successful as…
So I have a list of URLs that I pull from a database, and I need to crawl and parse through the JSON response of each URL. Some URLs return null, while others return information that is sent to a…
I am trying to collect data from shoes on eBay. For every item I want to collect all data including the custom description to build up a database. I have collected all aspects such as price, shipping title etc. with…