freebsd-ports/www/py-w3lib/pkg-descr
2016-12-02 09:21:58 +00:00

14 lines
479 B
Text

This is a Python library of web-related functions, such as:
- remove comments, or tags from HTML snippets
- extract base url from HTML snippets
- translate entites on HTML strings
- encoding mulitpart/form-data
- convert raw HTTP headers to dicts and vice-versa
- construct HTTP auth header
- converting HTML pages to unicode
- RFC-compliant url joining
- sanitize urls (like browsers do)
- extract arguments from urls
WWW: https://github.com/scrapy/w3lib/