Library of web-related functions
Project Links
Meta
Author: Scrapy project
Requires Python: >=3.10
Classifiers
Development Status
- 5 - Production/Stable
Intended Audience
- Developers
Operating System
- OS Independent
Programming Language
- Python
- Python :: 3
- Python :: 3.10
- Python :: 3.11
- Python :: 3.12
- Python :: 3.13
- Python :: 3.14
- Python :: Implementation :: CPython
- Python :: Implementation :: PyPy
Topic
- Internet :: WWW/HTTP
- Software Development :: Libraries :: Python Modules
Overview
This is a Python library of web-related functions, such as:
remove comments, or tags from HTML snippets
extract base url from HTML snippets
translate entites on HTML strings
convert raw HTTP headers to dicts and vice-versa
construct HTTP auth header
converting HTML pages to unicode
sanitize urls (like browsers do)
extract arguments from urls
Requirements
Python 3.10+
Install
pip install w3lib
Documentation
License
The w3lib library is licensed under the BSD license.
2.4.1
Mar 20, 2026
2.4.0
Jan 29, 2026
2.3.1
Jan 27, 2025
2.3.0
Jan 27, 2025
2.2.1
Jun 12, 2024
2.2.0
Jun 05, 2024
2.1.2
Aug 03, 2023
2.1.1
Dec 09, 2022
2.1.0
Nov 28, 2022
2.0.1
Aug 11, 2022
2.0.0
Aug 11, 2022
1.22.0
May 13, 2020
1.21.0
Aug 09, 2019
1.20.0
Jan 11, 2019
1.19.0
Jan 25, 2018
1.18.0
Aug 03, 2017
1.17.0
Feb 08, 2017
1.16.0
Nov 10, 2016
1.15.0
Jul 29, 2016
1.14.3
Jul 14, 2016
1.14.2
Apr 11, 2016
1.14.1
Apr 07, 2016
1.14.0
Apr 06, 2016
1.13.0
Nov 05, 2015
1.12.0
Jul 29, 2015
1.11.0
Jan 13, 2015
1.10.0
Aug 20, 2014
1.9.0
Aug 16, 2014
1.8.1
Aug 14, 2014
1.8.0
Jul 31, 2014
1.7.1
Jul 25, 2014
1.7.0
Jul 25, 2014
1.6
Jun 02, 2014
1.5
Nov 09, 2013
1.4
Nov 09, 2013
1.3
Jun 04, 2013
1.2
May 15, 2012
1.1
Apr 18, 2012
1.0
Apr 17, 2011
Wheel compatibility matrix
Files in release
No dependencies