Answers for "A shortcut to the start_requests method with scrapy"

CSS

0

A shortcut to the start_requests method with scrapy

import scrapy


class QuotesSpider(scrapy.Spider):
    name = "quotes"
    start_urls = [
        'http://quotes.toscrape.com/page/1/',
        'http://quotes.toscrape.com/page/2/',
    ]

    def parse(self, response):
        page = response.url.split("/")[-2]
        filename = f'quotes-{page}.html'
        with open(filename, 'wb') as f:
            f.write(response.body)

Posted by: Guest on February-26-2022

Source

Code answers related to "A shortcut to the start_requests method with scrapy"

Code answers related to "CSS"

CSS Answers by Framework

Browse Popular Code Answers by Language

Python

Javascript

Whatever

Shell/Bash

CSS

Html

PHP

SQL

Java

C#