Suppose I want to scrape the data (marathon running time) in this website: https://www.valenciaciudaddelrunning.com/en/marathon/2021-marathon-ranking/ One Google chrome when I right-click and select 'Inspect' or 'View page source', I don't see the actual data embedded in the source page (e.g. I…
Error: [3528:3760:0205/072321.889:ERROR:device_event_log_impl.cc(192)] [07:23:21.489] USB: usb_service_win.cc:105 SetupDiGetDeviceProperty({{A45C254E-DF1C-4EFD-8020-67D146A850E0}, 6}) failed: Element not found. (0x490) I'm running my application in AWS EC2 Instance and in local it runs fine but not in server. I'm facing above errors in Console as logs and my…
Hi I'm trying to web scrape (with Scrapy) this website https://www.vaniercollege.qc.ca/sports-recreation/weekly-schedule/ from this script below script.py import scrapy from scrapy.crawler import CrawlerProcess from threading import Thread class CourtSpider(scrapy.Spider): name = 'full_page' allowed_domains = ['vaniercollege.qc.ca'] start_urls = ['https://www.vaniercollege.qc.ca/sports-recreation/weekly-schedule/'] def parse(self, response):…
I have this completed for one website, then the html code on the second website is much different. I have tried to find the information online in how to write the code differently but not luck. I am wanting to…
I am trying to get link for a page through a football website page. I have pulled out the <a tags but to get the 'href', it is coming out as empty. I have tried different approaches since going through…
got a bs4 scraper that works with selenium - see far below: well - it works fine so far: see far below my approach to fetch some data form the given page: clutch.co/il/it-services To enrich the scraped data, with additional…
I'm new to web things :) so any help would be much appreciated. I'm trying to get the price of a coin from the Royal Mint web site but the element I require doesn't have an ID or a class…
Let's say I'm trying to scrape transcripts like this one. If you scroll down, you'll see that there is an h2 element that has both the text "Transcript" and has an id='transcript' attribute. If I'm not mistaken, the p elements…
Issue: I cannot select the calendar widget on hotel website (https://www.ihg.com/hotels/us/en/reservation). Error: Node is either not clickable or not an Element What I tried (below is my code): const puppeteer = require('puppeteer') const fs = require('fs/promises') async function start(){ const…
I encountered the following problem scraping the https://nuforc.org/subndx/?id=all URL, which contains a long list of pages (1497) with a 100-line table for each page. I used the following Python code to scrap the web table: import pandas as pd insight_ufo…