A high-level Web Crawling and Web Scraping framework
Project Links
Meta
Author: Scrapy developers
Maintainer: Pablo Hoffman
Requires Python: >=3.10
Classifiers
Development Status
- 5 - Production/Stable
Environment
- Console
Framework
- Scrapy
Intended Audience
- Developers
Operating System
- OS Independent
Programming Language
- Python
- Python :: 3
- Python :: 3.10
- Python :: 3.11
- Python :: 3.12
- Python :: 3.13
- Python :: Implementation :: CPython
- Python :: Implementation :: PyPy
Topic
- Internet :: WWW/HTTP
- Software Development :: Libraries :: Application Frameworks
- Software Development :: Libraries :: Python Modules
Scrapy is a web scraping framework to extract structured data from websites. It is cross-platform, and requires Python 3.10+. It is maintained by Zyte (formerly Scrapinghub) and many other contributors.
Install with:
pip install scrapy
And follow the documentation to learn how to use it.
If you wish to contribute, see Contributing.
2.14.2
Mar 12, 2026
2.14.1
Jan 12, 2026
2.14.0
Jan 05, 2026
2.13.4
Nov 17, 2025
2.13.3
Jul 02, 2025
2.13.2
Jun 09, 2025
2.13.1
May 28, 2025
2.13.0
May 08, 2025
2.12.0
Nov 18, 2024
2.11.2
May 14, 2024
2.11.1
Feb 14, 2024
2.11.0
Sep 18, 2023
2.10.1
Aug 30, 2023
2.10.0
Aug 04, 2023
2.9.0
May 08, 2023
2.8.0
Feb 02, 2023
2.7.1
Nov 02, 2022
2.7.0
Oct 17, 2022
2.6.3
Sep 27, 2022
2.6.2
Jul 25, 2022
2.6.1
Mar 01, 2022
2.6.0
Mar 01, 2022
2.5.1
Oct 05, 2021
2.5.0
Apr 06, 2021
2.4.1
Nov 17, 2020
2.4.0
Oct 11, 2020
2.3.0
Aug 04, 2020
2.2.1
Jul 17, 2020
2.2.0
Jun 24, 2020
2.1.0
Apr 24, 2020
2.0.1
Mar 18, 2020
2.0.0
Mar 03, 2020
1.8.4
Feb 14, 2024
1.8.3
Jul 25, 2022
1.8.2
Mar 01, 2022
1.8.1
Oct 05, 2021
1.8.0
Oct 29, 2019
1.7.4
Oct 21, 2019
1.7.3
Aug 01, 2019
1.7.2
Jul 23, 2019
1.7.1
Jul 18, 2019
1.7.0
Jul 18, 2019
1.6.0
Jan 30, 2019
1.5.2
Jan 22, 2019
1.5.1
Jul 11, 2018
1.5.0
Dec 29, 2017
1.4.0
May 18, 2017
1.3.3
Mar 10, 2017
1.3.2
Feb 13, 2017
1.3.1
Feb 08, 2017
1.3.0
Dec 21, 2016
1.2.3
Mar 03, 2017
1.2.2
Dec 06, 2016
1.2.1
Oct 21, 2016
1.2.0
Oct 03, 2016
1.1.4
Mar 03, 2017
1.1.3
Sep 22, 2016
1.1.2
Aug 18, 2016
1.1.1
Jul 13, 2016
1.1.0
May 11, 2016
1.1.0rc4
Apr 28, 2016
1.1.0rc3
Mar 01, 2016
1.1.0rc2
Feb 29, 2016
1.1.0rc1
Feb 04, 2016
1.0.7
Mar 03, 2017
1.0.6
May 04, 2016
1.0.5
Feb 03, 2016
1.0.4
Dec 30, 2015
1.0.3
Aug 11, 2015
1.0.2
Aug 06, 2015
1.0.1
Jul 01, 2015
1.0.0
Jun 19, 2015
1.0.0rc3
Jun 12, 2015
1.0.0rc2
Jun 05, 2015
1.0.0rc1
May 22, 2015
0.24.6
Apr 20, 2015
0.24.5
Feb 25, 2015
0.24.4
Aug 09, 2014
0.24.3
Aug 09, 2014
0.24.2
Jul 08, 2014
0.24.1
Jun 27, 2014
0.24.0
Jun 26, 2014
0.22.2
Feb 14, 2014
0.22.1
Feb 08, 2014
0.22.0
Jan 17, 2014
0.20.2
Dec 09, 2013
0.20.1
Nov 28, 2013
0.20.0
Nov 08, 2013
0.18.4
Oct 10, 2013
0.18.3
Oct 03, 2013
0.18.2
Sep 04, 2013
0.18.1
Aug 27, 2013
0.18.0
Aug 10, 2013
0.16.5
May 30, 2013
0.16.4
Jan 23, 2013
0.16.3
Dec 07, 2012
0.16.2
Nov 09, 2012
0.16.1
Oct 26, 2012
0.16.0
Oct 18, 2012
0.14.4
May 15, 2012
0.14.3
Apr 20, 2012
0.14.2
Mar 11, 2012
0.14.1
Jan 02, 2012
0.12.0.2550
Oct 25, 2011
0.10.4.2364
Nov 16, 2010
0.9
Jun 28, 2010
0.8
Dec 12, 2009
0.7
Jan 20, 2010
0.9.win32
Jun 28, 2010
0.8.win32
Dec 12, 2009
0.7.win32
Jan 20, 2010
0.14.3.win32
Apr 20, 2012
0.14.2.win32
Mar 11, 2012
0.14.1.win32
Jan 02, 2012
Wheel compatibility matrix
Files in release
Extras:
None
Dependencies:
cryptography
(>=37.0.0)
cssselect
(>=0.9.1)
defusedxml
(>=0.7.1)
itemadapter
(>=0.1.0)
itemloaders
(>=1.0.1)
lxml
(>=4.6.4)
packaging
parsel
(>=1.5.0)
protego
(>=0.1.15)
pydispatcher
(>=2.0.5)
pyopenssl
(>=22.0.0)
pypydispatcher
(>=2.1.0)
queuelib
(>=1.4.2)
service-identity
(>=18.1.0)
tldextract
twisted
(<=25.5.0,>=21.7.0)
w3lib
(>=1.17.0)
zope-interface
(>=5.1.0)