README.rst

    Scrapy

    PyPI Version Supported Python Versions Ubuntu macOS Windows Wheel Status Coverage report Conda Version

    Overview

    Scrapy is a fast high-level web crawling and web scraping framework, used to crawl websites and extract structured data from their pages. It can be used for a wide range of purposes, from data mining to monitoring and automated testing.

    Scrapy is maintained by Zyte (formerly Scrapinghub) and many other contributors.

    Check the Scrapy homepage at https://scrapy.org for more information, including a list of features.

    Requirements

    • Python 3.6+
    • Works on Linux, Windows, macOS, BSD

    Install

    The quick way:

    pip install scrapy

    See the install section in the documentation at https://docs.scrapy.org/en/latest/intro/install.html for more details.

    Documentation

    Documentation is available online at https://docs.scrapy.org/ and in the docs directory.

    Releases

    You can check https://docs.scrapy.org/en/latest/news.html for the release notes.

    Community (blog, twitter, mail list, IRC)

    See https://scrapy.org/community/ for details.

    Contributing

    See https://docs.scrapy.org/en/master/contributing.html for details.

    Code of Conduct

    Please note that this project is released with a Contributor Code of Conduct (see https://github.com/scrapy/scrapy/blob/master/CODE_OF_CONDUCT.md).

    By participating in this project you agree to abide by its terms. Please report unacceptable behavior to opensource@zyte.com.

    Companies using Scrapy

    See https://scrapy.org/companies/ for a list.

    Commercial Support

    See https://scrapy.org/support/ for details.

    项目简介

    🚀 Github 镜像仓库 🚀

    源项目地址

    https://github.com/scrapy/scrapy

    发行版本

    当前项目没有发行版本

    贡献者 240

    全部贡献者

    开发语言

    • Python 99.7 %
    • HTML 0.2 %
    • Roff 0.1 %
    • Shell 0.0 %