Changes:
1.16.2
------
### Additions
- [derpibooru] add `search` and `gallery` extractors (#862)
- [foolfuuka] add `board` and `search` extractors (#1044, #1174)
- [gfycat] add `date` metadata field (#1138)
- [pinterest] add support for getting all boards of a user (#1205)
- [sankaku] add support for book searches (#1204)
- [twitter] fetch media from pinned tweets (#1203)
- [wikiart] add extractor for single paintings (#1233)
- [downloader:http] add MIME type and signature for `.ico` files (#1211)
- add a `d` format string conversion for timestamp values
- add `"ascii"` as a special `path-restrict` value
### Fixes
- [hentainexus] fix extraction (#1234)
- [instagram] categorize single highlight URLs as `highlights` (#1222)
- [redgifs] fix search results
- [twitter] fix login with username & password
- [twitter] fetch tweets from `homeConversation` entries
Changes:
1.13.0
======
Additions
---------
- Support for
- `furaffinity` (#284)
- `8kun` (#582)
- `bcy` (#592)
- [blogger] implement video extraction (#587)
- [oauth] add option to specify port number used by local server (#604)
- [pixiv] add `rating` metadata field (#595)
- [pixiv] recognize tags at the end of new bookmark URLs
- [reddit] add `videos` option
- [weibo] use youtube-dl to download from m3u8 manifests
- implement `parent-directory` option (#551)
- extend filename formatting capabilities:
- implement field name alternatives (#525)
- allow multiple "special" format specifiers per replacement field (#595)
- allow for numeric list and string indices
Changes
-------
- [reddit] handle reddit-hosted images and videos natively (#551)
- [twitter] change default value for `videos` to `true`
Fixes
-----
- [cloudflare] unescape challenge URLs
- [deviantart] fix video extraction from `extended_fetch` results
- [hitomi] implement workaround for "broken" redirects
- [khinsider] fix and improve metadata extraction
- [patreon] filter duplicate files per post (#590)
- [piczel] fix extraction
- [pixiv] fix user IDs for bookmarks API calls (#596)
- [sexcom] fix image URLs
- [twitter] force old login page layout (#584, #598)
- [vsco] skip "invalid" entities
- improve functions to load/save cookies.txt files (#586)
Removals
--------
- [yaplog] remove module
Changes:
### Additions
- [4chan] add extractor for entire boards (#510)
- [realbooru] add extractors for pools, posts, and tag searches (#514)
- [instagram] implement a `videos` option (#521)
- [vsco] implement a `videos` option
- [postprocessor:metadata] implement a `bypost` option for downloading the
metadata of an entire post (#511)
### Changes
- [reddit] change the default value for `comments` to `0`
- [vsco] improve image resolutions
- make filesystem-related errors during file downloads non-fatal (#512)
### Fixes
- [foolslide] add fallback for chapter data extraction
- [instagram] ignore errors during post-page extraction
- [patreon] avoid errors when fetching user info (#508)
- [patreon] improve URL pattern for single posts
- [reddit] fix errors with `t1` submissions
- [vsco] fix user profile extraction … again
- [weibo] handle unavailable/deleted statuses
- [downloader:http] improve rate limit handling
- retain trailing zeroes in Cloudflare challenge answers
Changes:
1.11.1
======
### Fixes
- Fix inclusion of bash completion and man pages in source distributions
1.11.0
======
### Additions
- Support for
- `blogger` (#364)
- `nozomi` (#388)
- `issuu` (#413)
- `naver` (#447)
- Extractor for `twitter` search results (#448)
- Extractor for `deviantart` user profiles with configurable targets
(#377, #419)
- `--ugoira-conv-lossless` (#432)
- `cookies-update` option to allow updating cookies.txt files (#445)
- Optional `cloudflare` and `video` installation targets (#460)
- Allow executing commands with the `exec` post-processor after all files
are downloaded (#413, #421)
### Changes
- Rewrite `imgur` using its public API (#446)
- Rewrite `luscious` using GraphQL queries (#457)
- Adjust default `nijie` filenames to match `pixiv`
- Change enumeration index for gallery extractors from `page` to `num`
- Return non-zero exit status when errors occurred
- Forward proxy settings to youtube-dl downloader
- Install bash completion script into `share/bash-completion/completions`
### Fixes
- Adapt to new `instagram` page layout when logged in (#391)
- Support protected `twitter` videos (#452)
- Extend `hitomi` URL pattern and fix gallery extraction
- Restore OAuth2 authentication error messages
- Miscellaneous fixes for `patreon` (#444), `deviantart` (#455),
`sexcom` (#464), `imgur` (#467), `simplyhentai`
Changes:
1.10.6
------
# Additions
- `--exec` command-line option to specify a command to run after each
file download (#421)
# Changes
- Include titles in `gfycat` default filenames (#434)
# Fixes
- Fetch working download URLs for `deviantart` (#436)
- Various fixes and improvements for `yaplog` blogs (#443)
- Fix image URL generation for `hitomi` galleries
- Miscellaneous fixes for `behance` and `xvideos`
Changes:
1.10.5
------
### Additions
- `instagram.highlights` option to include highlighted stories when
downloading user profiles (#329)
- Support for `/user/` URLs on `reddit` (#350)
- Support for `imgur` user profiles and favorites (#420)
- Additional metadata fields on `nijie`(#423)
### Fixes
- Improve handling of private `deviantart` artworks (#414) and
429 status codes (#424)
- Prevent fatal errors when trying to open download-archive files (#417)
- Detect and ignore unavailable videos on `weibo` (#427)
- Update the `scope` of new `reddit` refresh-tokens (#428)
- Fix inconsistencies with the `reddit.comments` option (#429)
- Extend URL patterns for `hentaicafe` manga and `pixiv` artworks
- Improve detection of unavailable albums on `luscious` and `imgbb`
- Miscellaneous fixes for `tsumino`
Changes:
1.10.3
------
### Additions
- Provide `filename` metadata for all `deviantart` files (#392, #400)
- Implement a `ytdl.outtmpl` option to let youtube-dl handle filenames by
itself (#395)
- Support `seiga` mobile URLs (#401)
### Fixes
- Extract more than the first 32 posts from `piczel` galleries (#396)
- Fix filenames of archives created with `--zip` (#397)
- Skip unavailable images and videos on `flickr` (#398)
- Fix filesystem paths on Windows with Python 3.6 and lower (#402)
Changes:
1.10.2
======
### Additions
- Support for `instagram` stories and IGTV (#371, #373)
- Support for individual `imgbb` images (#363)
- `deviantart.quality` option to set the JPEG compression quality for newer
images (#369)
- `enumerate` option for `extractor.skip` (#306)
- `adjust-extensions` option to control filename extension adjustments
- `path-remove` option to remove control characters etc. from filesystem
paths
### Changes
- Rename `restrict-filenames` to `path-restrict`
- Adjust `pixiv` metadata and default filename format (#366)
- Set `filename` to `"{category}_{user[id]}_{id}{suffix}.{extension}"` to
restore the old default
- Improve and optimize directory and filename generation
### Fixes
- Allow the `classify` post-processor to handle files with unknown filename
extension (#138)
- Fix rate limit handling for OAuth APIs (#368)
- Fix artwork and scraps extraction on `deviantart` (#376, #392)
- Distinguish between `imgur` album and gallery URLs (#380)
- Prevent crash when using `--ugoira-conv` (#382)
- Handle multi-image posts on `patreon` (#383)
- Miscellaneous fixes for `*reactor`, `simplyhentai`
Changes:
1.10.0
------
### Warning
- Prior to version 1.10.0 all cache files were created world readable
(mode `644`) leading to possible sensitive information disclosure on
multi-user systems.
It is recommended to restrict access permissions of already existing files
(`/tmp/.gallery-dl.cache`) with `chmod 600`.
Windows users should not be affected.
### Additions
- Support for
- `vsco` (#331)
- `imgbb` (#361)
- `adultempire` (#340)
- `restrict-filenames` option to create Windows-compatible filenames on any
platform (#348)
- `forward-cookies` option to control cookie forwarding to youtube-dl (#352)
### Changes
- The default cache file location on non-Windows systems is now
`$XDG_CACHE_HOME/gallery-dl/cache.sqlite3` or
`~/.cache/gallery-dl/cache.sqlite3`
- New cache files are created with mode `600`
- `exhentai` extractors will always use `e-hentai.org` as domain
### Fixes
- Logging into `exhentai` now collects more cookies than just `ipb_member_id`
and `ipb_pass_hash`
- Better handling of `exhentai` image limits and errors (#356, #360)
- Try to prevent ZIP file corruption (#355)
- Miscellaneous fixes for `behance`, `ngomik`
Changes:
1.9.0
-----
### Additions
- Support for
- `erolord` (#326)
- Add login support for `instagram` (#195)
- Add `--no-download` and `extractor.*.download` disable file downloads (#220)
- Add `-A/--abort` to specify the number of consecutive download skips before
aborting
- Interpret `-1` as infinite retries (#300)
- Implement custom log message formats per log-level (#304)
- Implement an `mtime` post-processor that sets file modification times
according to metadata fields (#332)
- Implement a `twitter.content` option to enable tweet text extraction
(#333, #338)
- Enable `date-min/-max/-format` options for `tumblr` (#337)
### Changes
- Set file modification times according to their `Last-Modified` header when
downloading (#236, #277)
- Use `--no-mtime` or `downloader.*.mtime` to disable this behavior
- Duplicate download URLs are no longer silently ignored (controllable with
`extractor.*.image-unique`)
- Deprecate `--abort-on-skip`
### Fixes
- Retry downloads on OpenSSL exceptions (#324)
- Ignore unavailable pins on `sexcom` instead of raising an exception (#325)
- Use Firefox's SSL/TLS ciphers to prevent Cloudflare CAPTCHAs (#342)
- Improve folder name matching on `deviantart` (#343)
- Forward cookies to `youtube-dl` to allow downloading private videos
- Miscellaneous fixes for `35photo`, `500px`, `newgrounds`, `simplyhentai`
Changes:
1.8.7
-----
Additions:
- Support for
- `vanillarock` (#254)
- `nsfwalbum` (#287)
- `artist` and `tags` metadata for `hentaicafe` (#238)
- `description` metadata for `instagram` (#310)
- Format string option to replace a substring with another
- `R<old>/<new>/` (#318)
Changes:
- Delete empty archives created by the `zip` post-processor (#316)
Fixes:
- Handle `hitomi` Game CG galleries correctly (#321)
- Miscellaneous fixes for `deviantart`, `hitomi`, `pururin`, `kissmanga`,
`keenspot`, `mangoxo`, `imagefap`
Changes:
1.8.5
-----
### Additions
- Support for
- `keenspot` (#223)
- `sankakucomplex` (#258)
- `folders` option for `deviantart` to add a list of containing folders to
each file's metadata (#276)
- `captcha` option for `kissmanga` and `readcomiconline` to control CAPTCHA
handling (#279)
- `filename` metadata for files downloaded with youtube-dl (#291)
### Changes
- Adjust `wallhaven` extractors to new page layout:
- use API and add `api-key` option
- removed traditional login support
- Provide original filenames for `patreon` downloads (#268)
- Use e-hentai.org or exhentai.org depending on input URL (#278)
### Fixes
- Fix pagination over `sankaku` popular listings (#265)
- Fix folder and collection extraction on `deviantart` (#271)
- Detect "AreYouHuman" redirects on `readcomiconline` (#279)
- Miscellaneous fixes for `hentainexus`, `livedoor`, `ngomik`
Changes:
### Additions
- Support for
- `patreon` (#226)
- `hentainexus` (#256)
- `date` metadata fields for `pixiv` (#248), `instagram` (#250),
`exhentai`, and `newgrounds`
### Changes
- Improved `flickr` metadata and video extraction (#246)
### Fixes
- Download original GIF animations from `deviantart` (#242)
- Ignore missing `edge_media_to_comment` fields on `instagram` (#250)
- Fix serialization of `datetime` objects for `--write-metadata` (#251, #252)
- Allow multiple post-processor command-line options at once (#253)
- Prevent crash on `booru` sites when no tags are available (#259)
- Fix extraction on `instagram` after `rhx_gis` field removal (#266)
- Avoid Cloudflare CAPTCHAs for Python interpreters built
against OpenSSL < 1.1.1
- Miscellaneous fixes for `luscious`
Changes:
1.8.3
-----
### Additions
- Support for
- `plurk` (#212)
- `sexcom` (#147)
- `--clear-cache`
- `date` metadata fields for `deviantart`, `twitter`, and `tumblr` (#224, #232)
### Changes
- Standalone executables are now built using PyInstaller:
- uses the latest CPython interpreter (Python 3.7.3)
- available on several platforms (Windows, Linux, macOS)
- includes the `certifi` CA bundle, `youtube-dl`, and `pyOpenSSL` on Windows
### Fixes
- Patch `urllib3`'s default list of SSL/TLS ciphers to prevent Cloudflare
CAPTCHAs (#227)
- Windows users need to install `pyOpenSSL` for this to take effect
- Provide fallback URLs for `twitter` images (#237)
- Send `Referer` headers when downloading from `hitomi` (#239)
- Updated login procedure on `mangoxo`
pkgsrc changes:
- Configuration files and man pages were accidentally installed
in etc/ and share/man. Add a SUBST_SED in order to avoid hard-coded
paths and install bash completions in share/bash_completions.d.
Changes:
1.8.2
=====
Additions
---------
- Support for
- `pixnet` (#177)
- `wikiart` (#179)
- `mangoxo` (#184)
- `yaplog` (#190)
- `livedoor` (#190)
- Login support for `mangoxo` (#184) and `twitter` (#214)
Changes
-------
- Increased required `Requests` version to 2.11.0
Fixes
-----
- Improved image quality on `reactor` sites (#210)
- Support `imagebam` galleries with more than 100 images (#219)
- Updated Cloudflare bypass code
Changes:
1.8.0
-----
### Added
- Support for:
- `weibo`
- `pururin` (#174)
- `fashionnove` (#175)
- `shopify` sites in general (#175)
- Snap packaging (#169, #170, #187, #188)
- Automatic Cloudflare DDoS protection bypass
- Extractor and Job information for logging format strings
- `dynastyscans` image and search extractors (#163)
- `deviantart` scraps extractor (#168)
- `artstation` extractor for artwork listings (#172)
- `smugmug` video support and improved image format selection (#183)
### Changed
- More metadata for `nhentai` galleries
- Combined `myportfolio` extractors into one
- Renamed `name` metadata field to `filename` and removed the original `filename` field
- Simplified and improved internal data structures
- Optimized creation of child extractors
### Fixed
- Filter empty `tumblr` URLs (#165)
- Filter ads and improve connection speed on `hentaifoundry`
- Show proper error messages if `luscious` galleries are unavailable
- Miscellaneous issues on `mangahere`, `ngomik`, `simplyhentai`, `imgspice`
### Removed
- `seaotterscans`
