cookiecutter-scrapy
*******************************

:gitee: https://gitee.com/luzhenxiong/cookiecutter-scrapy

项目通用选项
===========================================

enable_batches
------------------------------------

分批处理，持久化记录爬取的页码，每批爬取一页数据，利用Scrapy内置的JOBDIR配置实现

.. seealso::

    `Keeping persistent state between batches <https://docs.scrapy.org/en/latest/topics/jobs.html#keeping-persistent-state-between-batches>`_

use_playwright
------------------------------------

决定是否使用playwright请求网址