c637402081
they now redirect to anyway. All new urls checked to return 200, I've fixed a couple of them in the process. Approved by: portmgr blanket, mat
14 lines
418 B
Text
14 lines
418 B
Text
Weblib provides tools to solve typical tasks in web scraping:
|
|
|
|
* processing HTML
|
|
* handling text encodings
|
|
* controling repeating and parallel tasks
|
|
* parsing RSS/ATOM feeds
|
|
* preparing data for HTTP requests
|
|
* working with DOM tree
|
|
* working with text and numeral data
|
|
* list of common user agents
|
|
* cross-platform file locking
|
|
* operations with files and directories
|
|
|
|
WWW: https://pypi.org/project/weblib/
|