Html - CSS Notation for a Scrapy Spider Script

Teron
December 20, 2023
274 views
1 vote
2 Answers

I wrote the below python script to return the item name, price, and link for items listed on https://shop.doverstreetmarket.com/collections/shops-noah

import scrapy

class DSMUKSpider(scrapy.Spider):
name = 'dsmuk'
start_urls = ['https://shop.doverstreetmarket.com/collections/shops-noah']

def parse(self, response):
    for dsmuk_product in response.css('article.h-full'):
        try:
            yield {
                'name': dsmuk_product.css('h2.font-display.text-xs.leading-2xs.md:text-sm.md:leading-xs.mb-2.5.a.span::text').get(),
                'price': dsmuk_product.css('div.flex.flex-wrap.gap-x-2.uppercase.span::text').get().replace('£',''),
                'link': dsmuk_product.css('h2.font-display.text-xs.leading-2xs.md:text-sm.md:leading-xs.mb-2.5.a').attrib['href'],
            }
        except:
            yield {
                
            }`

The desired output table is listed below:

name	price	link
Keith Haring Polaroid Long Sleeve Tee	58	/collections/shops-noah/products/noah-mens-noah-x-keith-haring-polaroid-l-white
Keith Haring Leather Ornament	48	/collections/shops-noah/products/noah-noah-x-keith-haring-leather-or-brown

However, running this spider with the scrapy crawl command yields a blank csv – no headers or cell values.

I suspect that the span class in the middle of the a class containing the item name is preventing the parse from returning the desired text; however, I’m not entirely sure how to tweak the CSS notation to account for this – I’d appreciate any help here. Please see below for a snippet of the underlying html I’m attempting to scrape:

 <li class="col-span-6 sm:col-span-3">
              



<article class="
    h-full flex flex-col relative

    
  ">
  




<div class="mb-2" style="background-color: #F5F5F5;">
  <img src="//shop.doverstreetmarket.com/cdn/shop/files/T160FW23_KEITH_HARRING_POLAROID_LONG_SLEEVE_0393.jpg?v=1702847626&amp;width=600" alt="Noah - Keith Haring Polaroid Long Sleeve Tee - (White)" srcset="//shop.doverstreetmarket.com/cdn/shop/files/T160FW23_KEITH_HARRING_POLAROID_LONG_SLEEVE_0393.jpg?v=1702847626&amp;width=160 160w, //shop.doverstreetmarket.com/cdn/shop/files/T160FW23_KEITH_HARRING_POLAROID_LONG_SLEEVE_0393.jpg?v=1702847626&amp;width=175 175w, //shop.doverstreetmarket.com/cdn/shop/files/T160FW23_KEITH_HARRING_POLAROID_LONG_SLEEVE_0393.jpg?v=1702847626&amp;width=238 238w, //shop.doverstreetmarket.com/cdn/shop/files/T160FW23_KEITH_HARRING_POLAROID_LONG_SLEEVE_0393.jpg?v=1702847626&amp;width=273 273w, //shop.doverstreetmarket.com/cdn/shop/files/T160FW23_KEITH_HARRING_POLAROID_LONG_SLEEVE_0393.jpg?v=1702847626&amp;width=320 320w, //shop.doverstreetmarket.com/cdn/shop/files/T160FW23_KEITH_HARRING_POLAROID_LONG_SLEEVE_0393.jpg?v=1702847626&amp;width=350 350w, //shop.doverstreetmarket.com/cdn/shop/files/T160FW23_KEITH_HARRING_POLAROID_LONG_SLEEVE_0393.jpg?v=1702847626&amp;width=374 374w, //shop.doverstreetmarket.com/cdn/shop/files/T160FW23_KEITH_HARRING_POLAROID_LONG_SLEEVE_0393.jpg?v=1702847626&amp;width=400 400w, //shop.doverstreetmarket.com/cdn/shop/files/T160FW23_KEITH_HARRING_POLAROID_LONG_SLEEVE_0393.jpg?v=1702847626&amp;width=476 476w, //shop.doverstreetmarket.com/cdn/shop/files/T160FW23_KEITH_HARRING_POLAROID_LONG_SLEEVE_0393.jpg?v=1702847626&amp;width=546 546w" width="600" height="600" class=" block w-full h-full aspect-[4/5] object-contain mix-blend-multiply" sizes="(min-width: 1360px)    calc(calc(((100 - 16.2) / 100 * 1360px) - 1.5rem) / 4 - (0.5rem * 3 / 4)),  (min-width: 1280px)    calc(calc(((100vw - (16.2 / 100 * 100vw)) - ((1.5rem * 2) - ((1.5rem * 2) * (16.2 / 100)))) - 1.5rem) / 4 - (0.5rem * 3 / 4)),  (min-width: 744px)    calc(calc(100vw - (1.5rem * 2)) / 4 - (0.5rem * 3 / 4)),  (min-width: 640px)    calc(calc(100vw - (1rem * 2)) / 4 - (0.5rem * 3 / 4)),  calc(calc(100vw - (1rem * 2)) / 2 - (0.5rem / 2))">
</div>


  

  <h2 class="font-display text-xs leading-2xs md:text-sm md:leading-xs mb-2.5" data-id="7153074733318">
    
      <a class="
          before:absolute before:inset-0 before:z-10
          focus:before:focus-ring focus-visible:before:focus-ring
          [&amp;:focus:not(:focus-visible)]:before:not-focus-ring focus:not-focus-ring
        " href="/collections/shops-noah/products/noah-mens-noah-x-keith-haring-polaroid-l-white" @click.prevent="setHistory(7153074733318, '/collections/shops-noah/products/noah-mens-noah-x-keith-haring-polaroid-l-white')">
        
  <span class="block uppercase">
    Noah
  </span>

  
    Keith Haring Polaroid Long Sleeve Tee
  

      </a>
    
  </h2>

  <div class="relative mt-auto">
    <div class="group-hover:invisible text-xs leading-2xs md:text-sm md:leading-xs uppercase">
      
        

<div class="
    flex flex-wrap gap-x-2 uppercase

    

    
  ">
  

  <span class="sr-only">
    
      Regular price
    
  </span>
  <span class="
      
    ">
    
      £58
    
  </span>
  
</div>

      
    </div>

    
  </div>

  
</article>

            </li>
          
            

            <li class="col-span-6 sm:col-span-3">
              



<article class="
    h-full flex flex-col relative

    
  ">
  




<div class="mb-2" style="background-color: #F5F5F5;">
  <img src="//shop.doverstreetmarket.com/cdn/shop/files/A217FW23_KEITH_HARRING_ORNAMENT_0969.jpg?v=1702827766&amp;width=600" alt="Noah - Keith Haring Leather Ornament - (Brown)" srcset="//shop.doverstreetmarket.com/cdn/shop/files/A217FW23_KEITH_HARRING_ORNAMENT_0969.jpg?v=1702827766&amp;width=160 160w, //shop.doverstreetmarket.com/cdn/shop/files/A217FW23_KEITH_HARRING_ORNAMENT_0969.jpg?v=1702827766&amp;width=175 175w, //shop.doverstreetmarket.com/cdn/shop/files/A217FW23_KEITH_HARRING_ORNAMENT_0969.jpg?v=1702827766&amp;width=238 238w, //shop.doverstreetmarket.com/cdn/shop/files/A217FW23_KEITH_HARRING_ORNAMENT_0969.jpg?v=1702827766&amp;width=273 273w, //shop.doverstreetmarket.com/cdn/shop/files/A217FW23_KEITH_HARRING_ORNAMENT_0969.jpg?v=1702827766&amp;width=320 320w, //shop.doverstreetmarket.com/cdn/shop/files/A217FW23_KEITH_HARRING_ORNAMENT_0969.jpg?v=1702827766&amp;width=350 350w, //shop.doverstreetmarket.com/cdn/shop/files/A217FW23_KEITH_HARRING_ORNAMENT_0969.jpg?v=1702827766&amp;width=374 374w, //shop.doverstreetmarket.com/cdn/shop/files/A217FW23_KEITH_HARRING_ORNAMENT_0969.jpg?v=1702827766&amp;width=400 400w, //shop.doverstreetmarket.com/cdn/shop/files/A217FW23_KEITH_HARRING_ORNAMENT_0969.jpg?v=1702827766&amp;width=476 476w, //shop.doverstreetmarket.com/cdn/shop/files/A217FW23_KEITH_HARRING_ORNAMENT_0969.jpg?v=1702827766&amp;width=546 546w" width="600" height="600" class=" block w-full h-full aspect-[4/5] object-contain mix-blend-darken" sizes="(min-width: 1360px)    calc(calc(((100 - 16.2) / 100 * 1360px) - 1.5rem) / 4 - (0.5rem * 3 / 4)),  (min-width: 1280px)    calc(calc(((100vw - (16.2 / 100 * 100vw)) - ((1.5rem * 2) - ((1.5rem * 2) * (16.2 / 100)))) - 1.5rem) / 4 - (0.5rem * 3 / 4)),  (min-width: 744px)    calc(calc(100vw - (1.5rem * 2)) / 4 - (0.5rem * 3 / 4)),  (min-width: 640px)    calc(calc(100vw - (1rem * 2)) / 4 - (0.5rem * 3 / 4)),  calc(calc(100vw - (1rem * 2)) / 2 - (0.5rem / 2))">
</div>


  

  <h2 class="font-display text-xs leading-2xs md:text-sm md:leading-xs mb-2.5" data-id="7153075290374">
    
      <a class="
          before:absolute before:inset-0 before:z-10
          focus:before:focus-ring focus-visible:before:focus-ring
          [&amp;:focus:not(:focus-visible)]:before:not-focus-ring focus:not-focus-ring
        " href="/collections/shops-noah/products/noah-noah-x-keith-haring-leather-or-brown" @click.prevent="setHistory(7153075290374, '/collections/shops-noah/products/noah-noah-x-keith-haring-leather-or-brown')">
        
  <span class="block uppercase">
    Noah
  </span>

  
    Keith Haring Leather Ornament
  

      </a>
    
  </h2>

  <div class="relative mt-auto">
    <div class="group-hover:invisible text-xs leading-2xs md:text-sm md:leading-xs uppercase">
      
        

<div class="
    flex flex-wrap gap-x-2 uppercase

    

    
  ">
  

  <span class="sr-only">
    
      Regular price
    
  </span>
  <span class="
      
    ">
    
      £48
    
  </span>
  
</div>

      
    </div>

    
  </div>

  
</article>

            </li>
          
            

            <li class="col-span-6 sm:col-span-3">
              



<article class="
    h-full flex flex-col relative

    
  ">
  




<div class="mb-2" style="background-color: #F5F5F5;">
  <img src="//shop.doverstreetmarket.com/cdn/shop/files/SS158FW23_THE_CURE_HOODIE_0045.jpg?v=1702827758&amp;width=600" alt="Noah - The Cure Men's Raglan Hoodie - (Black)" srcset="//shop.doverstreetmarket.com/cdn/shop/files/SS158FW23_THE_CURE_HOODIE_0045.jpg?v=1702827758&amp;width=160 160w, //shop.doverstreetmarket.com/cdn/shop/files/SS158FW23_THE_CURE_HOODIE_0045.jpg?v=1702827758&amp;width=175 175w, //shop.doverstreetmarket.com/cdn/shop/files/SS158FW23_THE_CURE_HOODIE_0045.jpg?v=1702827758&amp;width=238 238w, //shop.doverstreetmarket.com/cdn/shop/files/SS158FW23_THE_CURE_HOODIE_0045.jpg?v=1702827758&amp;width=273 273w, //shop.doverstreetmarket.com/cdn/shop/files/SS158FW23_THE_CURE_HOODIE_0045.jpg?v=1702827758&amp;width=320 320w, //shop.doverstreetmarket.com/cdn/shop/files/SS158FW23_THE_CURE_HOODIE_0045.jpg?v=1702827758&amp;width=350 350w, //shop.doverstreetmarket.com/cdn/shop/files/SS158FW23_THE_CURE_HOODIE_0045.jpg?v=1702827758&amp;width=374 374w, //shop.doverstreetmarket.com/cdn/shop/files/SS158FW23_THE_CURE_HOODIE_0045.jpg?v=1702827758&amp;width=400 400w, //shop.doverstreetmarket.com/cdn/shop/files/SS158FW23_THE_CURE_HOODIE_0045.jpg?v=1702827758&amp;width=476 476w, //shop.doverstreetmarket.com/cdn/shop/files/SS158FW23_THE_CURE_HOODIE_0045.jpg?v=1702827758&amp;width=546 546w" width="600" height="600" loading="lazy" class=" block w-full h-full aspect-[4/5] object-contain mix-blend-darken" sizes="(min-width: 1360px)    calc(calc(((100 - 16.2) / 100 * 1360px) - 1.5rem) / 4 - (0.5rem * 3 / 4)),  (min-width: 1280px)    calc(calc(((100vw - (16.2 / 100 * 100vw)) - ((1.5rem * 2) - ((1.5rem * 2) * (16.2 / 100)))) - 1.5rem) / 4 - (0.5rem * 3 / 4)),  (min-width: 744px)    calc(calc(100vw - (1.5rem * 2)) / 4 - (0.5rem * 3 / 4)),  (min-width: 640px)    calc(calc(100vw - (1rem * 2)) / 4 - (0.5rem * 3 / 4)),  calc(calc(100vw - (1rem * 2)) / 2 - (0.5rem / 2))">
</div>


  

  <h2 class="font-display text-xs leading-2xs md:text-sm md:leading-xs mb-2.5" data-id="7153073717510">
    
      <a class="
          before:absolute before:inset-0 before:z-10
          focus:before:focus-ring focus-visible:before:focus-ring
          [&amp;:focus:not(:focus-visible)]:before:not-focus-ring focus:not-focus-ring
        " href="/collections/shops-noah/products/noah-mens-noah-x-the-cure-raglan-hoodie-black" @click.prevent="setHistory(7153073717510, '/collections/shops-noah/products/noah-mens-noah-x-the-cure-raglan-hoodie-black')">
        
  <span class="block uppercase">
    Noah
  </span>

  
    The Cure Men's Raglan Hoodie
  

      </a>
    
  </h2>

  <div class="relative mt-auto">
    <div class="group-hover:invisible text-xs leading-2xs md:text-sm md:leading-xs uppercase">
      
        

<div class="
    flex flex-wrap gap-x-2 uppercase

    

    
  ">
  

  <span class="sr-only">
    
      Regular price
    
  </span>
  <span class="
      
    ">
    
      £198
    
  </span>
  
</div>

      
    </div>

    
  </div>

  
</article>

            </li>

Answers

If tempted to use a pure python approach, you can extract the JSON returned by the script :

import csv, json, re, requests

from bs4 import BeautifulSoup as BS # pip install beautifulsoup4

start_url = "https://shop.doverstreetmarket.com/collections/shops-noah"

headers = {"User-Agent": "Mozilla/5.0 (X11; Linux x86_64)"
           "AppleWebKit/537.36 (KHTML, like Gecko)"}

r = requests.get(start_url, headers=headers)

data = (
    json.loads(re.search(
        r""collection_viewed", (.+?));",
        BS(r.text, "html.parser").find(
            "script", id="web-pixels-manager-setup").text
    ).group(1))["collection"]["productVariants"]
)

filtered_data = [
    dict(
        name=item["product"]["title"].split(" - ", 1)[1],
        price=item["price"]["amount"],
        link=f'/collections/shops-noah{item["product"]["url"]}',
    ) for item in data
]

To make the (.csv), you can use :

with open("output.csv", "w", newline="") as outf:
    header = ["name", "price", "link"]
    writer = csv.DictWriter(outf, fieldnames=header, delimiter=",")
    writer.writeheader(); writer.writerows(filtered_data)

A variant with pandas‘ to_csv :

import pandas as pd # pip install pandas
pd.DataFrame(filtered_data).to_csv("output.csv", sep=",")

Output (144 rows x 3 columns) :

name	price	link
Keith Haring Men’s Crewneck – (White)	148	/collections/shops-noah/products/noah-mens-noah-x-keith-haring-crewneck-white
Keith Haring Men’s Crewneck – (Heather Grey)	148	/collections/shops-noah/products/noah-mens-noah-x-keith-haring-crewneck-heather
Keith Haring Polaroid Long Sleeve Tee – (White)	58	/collections/shops-noah/products/noah-mens-noah-x-keith-haring-polaroid-l-white
…	…	…
Men’s Athletic Trucker – (Orange)	58	/collections/shops-noah/products/noah-mens-athletic-trucker-orange
Men’s Core Logo 5-Panel – (Black)	64	/collections/shops-noah/products/noah-mens-core-logo-5-panel-black
Men’s Core Logo 5-Panel – (Duck)	64	/collections/shops-noah/products/noah-mens-core-logo-5-panel-duck

This should achieve what you are looking for:

Explanation:

For the name property all we simply need to get all the inner text content for all elements that are children of the h2 element, for this we need to use the getall() method which returns a list of strings, so it is neccessary to concat the strings and then strip the whitespace.

For the price property we need the text contents of the second child span element of the div.flex so again we use the getall() method but this time we just select the content in index 1 of the resulting list, then we strip whitespace again.

for the link property we simply need the href attribute for the a tag that is a child of the h2 element… keep it simple.

import scrapy

class DSMUKSpider(scrapy.Spider):
    name = 'dsmuk'
    start_urls = ['https://shop.doverstreetmarket.com/collections/shops-noah']

    def parse(self, response):
        for dsmuk_product in response.css('article.h-full'):
            yield {
                'name': " ".join(dsmuk_product.css('h2 > *::text').getall()).strip(),
                'price': dsmuk_product.css('div.flex > span::text').getall()[1].replace('£','').strip(),
                'link': dsmuk_product.css('h2 > a').attrib['href'],
            }

partial log output

2023-12-19 23:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://shop.doverstreetmarket.com/collections/shops-noah>
{'name': "Keith Haring Men's Crewneck", 'price': '148', 'link': '/collections/shops-noah/products/noah-mens-noah-x-keith-haring-crewneck-white'}
2023-12-19 23:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://shop.doverstreetmarket.com/collections/shops-noah>
{'name': "Keith Haring Men's Crewneck", 'price': '148', 'link': '/collections/shops-noah/products/noah-mens-noah-x-keith-haring-crewneck-heather'}
2023-12-19 23:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://shop.doverstreetmarket.com/collections/shops-noah>
{'name': 'Keith Haring Polaroid Long Sleeve Tee', 'price': '58', 'link': '/collections/shops-noah/products/noah-mens-noah-x-keith-haring-polaroid-l-white'}
2023-12-19 23:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://shop.doverstreetmarket.com/collections/shops-noah>
{'name': 'Keith Haring Leather Ornament', 'price': '48', 'link': '/collections/shops-noah/products/noah-noah-x-keith-haring-leather-or-brown'}
2023-12-19 23:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://shop.doverstreetmarket.com/collections/shops-noah>
{'name': "The Cure Men's Raglan Hoodie", 'price': '198', 'link': '/collections/shops-noah/products/noah-mens-noah-x-the-cure-raglan-hoodie-black'}
2023-12-19 23:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://shop.doverstreetmarket.com/collections/shops-noah>
{'name': "The Cure Men's Raglan Hoodie", 'price': '198', 'link': '/collections/shops-noah/products/noah-mens-noah-x-the-cure-raglan-hoodie-pink'}
2023-12-19 23:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://shop.doverstreetmarket.com/collections/shops-noah>
{'name': "The Cure Men's Crewneck Sweat", 'price': '178', 'link': '/collections/shops-noah/products/noah-mens-noah-x-the-cure-crewneck-sweat-black'}
2023-12-19 23:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://shop.doverstreetmarket.com/collections/shops-noah>
{'name': "The Cure Men's Rugby Cardigan", 'price': '228', 'link': '/collections/shops-noah/products/noah-mens-noah-x-the-cure-rugby-cardigan-black'}
2023-12-19 23:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://shop.doverstreetmarket.com/collections/shops-noah>
{'name': "The Cure Men's Printed Poplin Shirt", 'price': '228', 'link': '/collections/shops-noah/products/noah-mens-noah-x-the-cure-printed-poplin-floral'}
2023-12-19 23:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://shop.doverstreetmarket.com/collections/shops-noah>
{'name': "The Cure Men's Striped Top", 'price': '138', 'link': '/collections/shops-noah/products/noah-mens-noah-x-the-cure-striped-top-pink'}
2023-12-19 23:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://shop.doverstreetmarket.com/collections/shops-noah>
{'name': "The Cure Men's Three Imaginary Boys Tee", 'price': '48', 'link': '/collections/shops-noah/products/noah-mens-noah-x-the-cure-logo-tee-pink'}
2023-12-19 23:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://shop.doverstreetmarket.com/collections/shops-noah>
{'name': "The Cure Men's Why Can't I Be You Tee", 'price': '48', 'link': '/collections/shops-noah/products/noah-mens-noah-x-the-cure-why-cant-i-be-blue'}
2023-12-19 23:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://shop.doverstreetmarket.com/collections/shops-noah>
{'name': "The Cure Men's Why Can't I Be You Tee", 'price': '48', 'link': '/collections/shops-noah/products/noah-mens-noah-x-the-cure-why-cant-i-be-black'}
2023-12-19 23:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://shop.doverstreetmarket.com/collections/shops-noah>
{'name': "The Cure Men's Pictures of You Tee", 'price': '48', 'link': '/collections/shops-noah/products/noah-the-cure-mens-pictures-of-you-tee-black'}
2023-12-19 23:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://shop.doverstreetmarket.com/collections/shops-noah>
{'name': "The Cure Men's Pictures of You Tee", 'price': '48', 'link': '/collections/shops-noah/products/noah-the-cure-mens-pictures-of-you-tee-white'}
2023-12-19 23:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://shop.doverstreetmarket.com/collections/shops-noah>
{'name': "The Cure Men's How Beautiful Tee", 'price': '48', 'link': '/collections/shops-noah/products/noah-mens-noah-x-the-cure-how-beautiful-white'}
2023-12-19 23:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://shop.doverstreetmarket.com/collections/shops-noah>
{'name': 'The Cure Eye Mask', 'price': '28', 'link': '/collections/shops-noah/products/noah-noah-x-the-cure-eye-mask-white'}
2023-12-19 23:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://shop.doverstreetmarket.com/collections/shops-noah>
{'name': "PUMA Men's Quilted Jacket", 'price': '250', 'link': '/collections/shops-noah/products/noah-puma-mens-quilted-jacket-navy'}
2023-12-19 23:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://shop.doverstreetmarket.com/collections/shops-noah>
{'name': "PUMA Men's Ski Sweater", 'price': '185', 'link': '/collections/shops-noah/products/noah-mens-noah-x-puma-ski-sweater-navy-red-aw23-sw047fw23nvy'}
2023-12-19 23:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://shop.doverstreetmarket.com/collections/shops-noah>
{'name': "PUMA Men's Ringer Tee", 'price': '50', 'link': '/collections/shops-noah/products/noah-mens-noah-x-puma-ringer-tee-heather-aw23-kn122fw23hgy'}
2023-12-19 23:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://shop.doverstreetmarket.com/collections/shops-noah>
{'name': "PUMA Men's Ringer Tee", 'price': '50', 'link': '/collections/shops-noah/products/noah-mens-noah-x-puma-ringer-tee-heather-aw23-kn122fw23htn'}
2023-12-19 23:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://shop.doverstreetmarket.com/collections/shops-noah>
{'name': "PUMA Men's Sport Coat", 'price': '1,198', 'link': '/collections/shops-noah/products/noah-puma-mens-sport-coat-camel'}
2023-12-19 23:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://shop.doverstreetmarket.com/collections/shops-noah>
{'name': "PUMA Men's Double-Pleat Drawstring Pant", 'price': '798', 'link': '/collections/shops-noah/products/noah-puma-mens-double-pleat-draws-camel'}

Please signup or login to give your own answer.

Click here to cancel reply.

Html – CSS Notation for a Scrapy Spider Script

Answers