youtube-dl 2018.03.20:
Core
[extractor/common] Improve thumbnail extraction for HTML5 entries
Generalize XML manifest processing code and improve XSPF parsing
[extractor/common] Add _download_xml_handle
[extractor/common] Add support for relative URIs in _parse_xspf
Extractors
[7plus] Extract series metadata
[9now] Bypass geo restriction
[cbs] Skip unavailable assets
[canalc2] Add support for HTML5 videos
[ceskatelevize] Add support for iframe embeds
[prosiebensat1] Add support for galileo.tv
[generic] Add support for xfileshare embeds
[bilibili] Switch to v2 playurl API
[bilibili] Fix and improve extraction
[heise] Improve extraction
[instagram] Fix user videos extraction
Changes:
version 2018.01.14
Extractors
* [youtube] Fix live streams extraction (#15202)
* [wdr] Bypass geo restriction
* [wdr] Rework extractors (#14598)
+ [wdr] Add support for wdrmaus.de/elefantenseite (#14598)
+ [gamestar] Add support for gamepro.de (#3384)
* [viafree] Skip rtmp formats (#15232)
+ [pandoratv] Add support for mobile URLs (#12441)
+ [pandoratv] Add support for new URL format (#15131)
+ [ximalaya] Add support for ximalaya.com (#14687)
+ [digg] Add support for digg.com (#15214)
* [limelight] Tolerate empty pc formats (#15150, #15151, #15207)
* [ndr:embed:base] Make separate formats extraction non fatal (#15203)
+ [weibo] Add extractor (#15079)
+ [ok] Add support for live streams
* [canalplus] Fix extraction (#15072)
* [bilibili] Fix extraction (#15188)
version 2018.01.07
Core
* [utils] Fix youtube-dl under PyPy3 on Windows
* [YoutubeDL] Output python implementation in debug header
Extractors
+ [jwplatform] Add support for multiple embeds (#15192)
* [mitele] Fix extraction (#15186)
+ [motherless] Add support for groups (#15124)
* [lynda] Relax URL regular expression (#15185)
* [soundcloud] Fallback to avatar picture for thumbnail (#12878)
* [youku] Fix list extraction (#15135)
* [openload] Fix extraction (#15166)
* [lynda] Skip invalid subtitles (#15159)
* [twitch] Pass video id to url_result when extracting playlist (#15139)
* [rtve.es:alacarta] Fix extraction of some new URLs
* [acast] Fix extraction (#15147)
version 2017.12.31
Core
+ [extractor/common] Add container meta field for formats extracted
in _parse_mpd_formats (#13616)
+ [downloader/hls] Use HTTP headers for key request
* [common] Use AACL as the default fourcc when AudioTag is 255
* [extractor/common] Fix extraction of DASH formats with the same
representation id (#15111)
Extractors
+ [slutload] Add support for mobile URLs (#14806)
* [abc:iview] Bypass geo restriction
* [abc:iview] Fix extraction (#14711, #14782, #14838, #14917, #14963, #14985,
#15035, #15057, #15061, #15071, #15095, #15106)
* [openload] Fix extraction (#15118)
- [sandia] Remove extractor
- [collegerama] Remove extractor
+ [mediasite] Add support for sites based on Mediasite Video Platform (#5428,
#11185, #14343)
+ [ufctv] Add support for ufc.tv (#14520)
* [pluralsight] Fix missing first line of subtitles (#11118)
* [openload] Fallback on f-page extraction (#14665, #14879)
* [vimeo] Improve password protected videos extraction (#15114)
* [aws] Fix canonical/signed headers generation on python 2 (#15102)
Changes:
2017.12.28
----------
Extractors
+ [internazionale] Add support for internazionale.it (#14973)
* [playtvak] Relax video regular expression and make description optional
(#15037)
+ [filmweb] Add support for filmweb.no (#8773, #10368)
+ [23video] Add support for 23video.com
+ [espn] Add support for fivethirtyeight.com (#6864)
+ [umg:de] Add support for universal-music.de (#11582, #11584)
+ [espn] Add support for espnfc and extract more formats (#8053)
* [youku] Update ccode (#14880)
+ [openload] Add support for oload.stream (#15070)
* [youku] Fix list extraction (#15065)
2017.12.23
----------
Core
* [extractor/common] Move X-Forwarded-For setup code into _request_webpage
+ [YoutubeDL] Add support for playlist_uploader and playlist_uploader_id in
output template (#11427, #15018)
+ [extractor/common] Introduce uploader, uploader_id and uploader_url
meta fields for playlists (#11427, #15018)
* [downloader/fragment] Encode filename of fragment being removed (#15020)
+ [utils] Add another date format pattern (#14999)
Extractors
+ [kaltura] Add another embed pattern for entry_id
+ [7plus] Add support for 7plus.com.au (#15043)
* [animeondemand] Relax login error regular expression
+ [shahid] Add support for show pages (#7401)
+ [youtube] Extract uploader, uploader_id and uploader_url for playlists
(#11427, #15018)
* [afreecatv] Improve format extraction (#15019)
+ [cspan] Add support for audio only pages and catch page errors (#14995)
+ [mailru] Add support for embed URLs (#14904)
* [crunchyroll] Future-proof XML element checks (#15013)
* [cbslocal] Fix timestamp extraction (#14999, #15000)
* [discoverygo] Correct TTML subtitle extension
* [vk] Make view count optional (#14979)
* [disney] Skip Apple FairPlay formats (#14982)
* [voot] Fix format extraction (#14758)
2017.12.14
----------
Core
* [postprocessor/xattr] Clarify NO_SPACE message (#14970)
* [downloader/http] Return actual download result from real_download (#14971)
Extractors
+ [itv] Extract more subtitles and duration
* [itv] Improve extraction (#14944)
+ [byutv] Add support for geo restricted videos
* [byutv] Fix extraction (#14966, #14967)
+ [bbccouk] Fix extraction for 320k HLS streams
+ [toutv] Add support for special video URLs (#14179)
* [discovery] Fix free videos extraction (#14157, #14954)
* [tvnow] Fix extraction (#7831)
+ [nickelodeon:br] Add support for nickelodeon brazil websites (#14893)
* [nick] Improve extraction (#14876)
* [tbs] Fix extraction (#13658)
Changes:
version 2017.10.29
Core
* [extractor/common] Prefix format id for audio only HLS formats
+ [utils] Add support for zero years and months in parse_duration
Extractors
* [egghead] Fix extraction (#14388)
+ [fxnetworks] Extract series metadata (#14603)
+ [younow] Add support for younow.com (#9255, #9432, #12436)
* [dctptv] Fix extraction (#14599)
* [youtube] Restrict embed regex (#14600)
* [vimeo] Restrict iframe embed regex (#14600)
* [soundgasm] Improve extraction (#14588)
- [myvideo] Remove extractor (#8557)
+ [nbc] Add support for classic-tv videos (#14575)
+ [vrtnu] Add support for cookies authentication and simplify (#11873)
+ [canvas] Add support for vrt.be/vrtnu (#11873)
* [twitch:clips] Fix title extraction (#14566)
+ [ndtv] Add support for sub-sites (#14534)
* [dramafever] Fix login error message extraction
+ [nick] Add support for more nickelodeon sites (no, dk, se, ch, fr, es, pt,
ro, hu) (#14553)
Core
[YoutubeDL] Improve default format specification (#13704)
[YoutubeDL] Do not override id, extractor and extractor_key for
url_transparent entities
[extractor/common] Fix playlist_from_matches
Extractors
[itv] Fix production id extraction (#13671, #13703)
[vidio] Make duration non fatal and fix typo
[mtv] Skip missing video parts (#13690)
[sportbox:embed] Fix extraction
[npo] Add support for npo3.nl URLs (#13695)
[dramafever] Remove video id from title (#13699)
[egghead:lesson] Add support for lessons (#6635)
[funnyordie] Extract more metadata (#13677)
[youku:show] Fix playlist extraction (#13248)
[dispeak] Recognize sevt subdomain (#13276)
[adn] Improve error reporting (#13663)
[crunchyroll] Relax series and season regex (#13659)
[spiegel:article] Add support for nexx iframe embeds (#13029)
[nexx:embed] Add support for iframe embeds
[nexx] Improve JS embed extraction
[pearvideo] Add support for pearvideo.com (#13031)
versions.
youtube-dl versions are (strftime(3)-ese, except for optional part):
`%Y.%m.%d[.<i>]'. Preserve the `.<i>' optional part (without accidently
deleting the dot!) for PKGNAME.
Core
[YoutubeDL] Don't expand environment variables in meta fields
Extractors
[spiegeltv] Delegate extraction to nexx extractor
[nexx] Add support for nexx.cloud
[generic] Fix rutube embeds extraction
[karrierevideos] Fix title extraction
[youtube] Don't capture YouTube Red ad for creator meta field
[slideshare] Fix extraction
[5tv] Add another video URL pattern
[drtv] Make HLS and HDS extraction non fatal
[ted] Fix subtitles extraction
[vine] Make sure the title won't be empty
[twitter] Support HLS streams in vmap URLs
[periscope] Support pscp.tv URLs in embedded frames
[twitter] Extract mp4 urls via mobile API
[niconico] Fix authentication error handling
[giantbomb] Extract m3u8 formats
[vlive:playlist] Add support for playlists
Changes:
version 2017.06.18
Core
* [downloader/common] Use utils.shell_quote for debug command line
* [utils] Use compat_shlex_quote in shell_quote
* [postprocessor/execafterdownload] Encode command line (#13407)
* [compat] Fix compat_shlex_quote on Windows (#5889, #10254)
* [postprocessor/metadatafromtitle] Fix missing optional meta fields processing
in --metadata-from-title (#13408)
* [extractor/common] Fix json dumping with --geo-bypass
+ [extractor/common] Improve jwplayer subtitles extraction
+ [extractor/common] Improve jwplayer formats extraction (#13379)
Extractors
* [polskieradio] Fix extraction (#13392)
+ [xfileshare] Add support for fastvideo.me (#13385)
* [bilibili] Fix extraction of videos with double quotes in titles (#13387)
* [4tube] Fix extraction (#13381, #13382)
+ [disney] Add support for disneychannel.de (#13383)
* [npo] Improve URL regular expression (#13376)
+ [corus] Add support for showcase.ca
+ [corus] Add support for history.ca (#13359)
version 2017.06.12
Core
* [utils] Handle compat_HTMLParseError in extract_attributes (#13349)
+ [compat] Introduce compat_HTMLParseError
* [utils] Improve unified_timestamp
* [extractor/generic] Ensure format id is unicode string
* [extractor/common] Return unicode string from _match_id
+ [YoutubeDL] Sanitize more fields (#13313)
Extractors
+ [xfileshare] Add support for rapidvideo.tv (#13348)
* [xfileshare] Modernize and pass Referer
+ [rutv] Add support for testplayer.vgtrk.com (#13347)
+ [newgrounds] Extract more metadata (#13232)
+ [newgrounds:playlist] Add support for playlists (#10611)
* [newgrounds] Improve formats and uploader extraction (#13346)
* [msn] Fix formats extraction
* [turbo] Ensure format id is string
* [sexu] Ensure height is int
* [jove] Ensure comment count is int
* [golem] Ensure format id is string
* [gfycat] Ensure filesize is int
* [foxgay] Ensure height is int
* [flickr] Ensure format id is string
* [sohu] Fix numeric fields
* [safari] Improve authentication detection (#13319)
* [liveleak] Ensure height is int (#13313)
* [streamango] Make title optional (#13292)
* [rtlnl] Improve URL regular expression (#13295)
* [tvplayer] Fix extraction (#13291)
Changes:
version 2017.05.01
Core
+ [extractor/common] Extract view count from JSON-LD
* [utils] Improve unified_timestamp
+ [utils] Add video/mp2t to mimetype2ext
* [downloader/external] Properly handle live stream downloading cancellation
(#8932)
+ [utils] Add support for unicode whitespace in clean_html on python 2 (#12906)
Extractors
* [infoq] Make audio format extraction non fatal (#12938)
* [brightcove] Allow whitespace around attribute names in embedded code
+ [zaq1] Add support for zaq1.pl (#12693)
+ [xvideos] Extract duration (#12828)
* [vevo] Fix extraction (#12879)
+ [noovo] Add support for noovo.ca (#12792)
+ [washingtonpost] Add support for embeds (#12699)
* [yandexmusic:playlist] Fix extraction for python 3 (#12888)
* [anvato] Improve extraction (#12913)
* Promote to regular shortcut based extractor
* Add mcp to access key mapping table
* Add support for embeds extraction
* Add support for anvato embeds in generic extractor
* [xtube] Fix extraction for older FLV videos (#12734)
* [tvplayer] Fix extraction (#12908)
version 2017.04.28
Core
+ [adobepass] Use geo verification headers for all requests
- [downloader/fragment] Remove assert for resume_len when no fragments
downloaded
+ [extractor/common] Add manifest_url for explicit group rendition formats
* [extractor/common] Fix manifest_url for m3u8 formats
- [extractor/common] Don't list master m3u8 playlists in format list (#12832)
Extractor
* [aenetworks] Fix extraction for shows with single season
+ [go] Add support for Disney, DisneyJunior and DisneyXD show pages
* [youtube] Recognize new locale-based player URLs (#12885)
+ [streamable] Add support for new embedded URL schema (#12844)
* [arte:+7] Relax URL regular expression (#12837)
Changes:
version 2017.04.26
Core
* Introduce --keep-fragments for keeping fragments of fragmented download
on disk after download is finished
* [YoutubeDL] Fix output template for missing timestamp (#12796)
* [socks] Handle cases where credentials are required but missing
* [extractor/common] Improve HLS extraction (#12211)
- Extract m3u8 parsing to separate method
- Improve rendition groups extraction
- Build stream name according stream GROUP-ID
- Ignore reference to AUDIO group without URI when stream has no CODECS
- Use float for scaled tbr in _parse_m3u8_formats
* [utils] Add support for TTML styles in dfxp2srt
* [downloader/hls] No need to download keys for fragments that have been
already downloaded
* [downloader/fragment] Improve fragment downloading
- Resume immediately
- Don't concatenate fragments and decrypt them on every resume
- Optimize disk storage usage, don't store intermediate fragments on disk
- Store bookkeeping download state file
+ [extractor/common] Add support for multiple getters in try_get
+ [extractor/common] Add support for video of WebPage context in _json_ld
(#12778)
+ [extractor/common] Relax JWPlayer regular expression and remove
duplicate URLs (#12768)
Extractors
* [iqiyi] Fix extraction of Yule videos
* [vidio] Improve extraction and sort formats
+ [brightcove] Match only video elements with data-video-id attribute
* [iqiyi] Fix playlist detection (#12504)
- [azubu] Remove extractor (#12813)
* [porn91] Fix extraction (#12814)
* [vidzi] Fix extraction (#12793)
+ [amp] Extract error message (#12795)
+ [xfileshare] Add support for gorillavid.com and daclips.com (#12776)
* [instagram] Fix extraction (#12777)
+ [generic] Support Brightcove videos in <iframe> (#12482)
+ [brightcove] Support URLs with bcpid instead of playerID (#12482)
* [brightcove] Fix _extract_url (#12782)
+ [odnoklassniki] Extract HLS formats
version 2017.04.17
Extractors
* [limelight] Improve extraction LimelightEmbeddedPlayerFlash media embeds and
add support for channel and channelList embeds
* [generic] Extract multiple Limelight embeds (#12761)
+ [itv] Extract series metadata
* [itv] Fix RTMP formats downloading (#12759)
* [itv] Use native HLS downloader by default
+ [go90] Extract subtitles (#12752)
+ [go90] Extract series metadata (#12752)
version 2017.04.16
Core
* [YoutubeDL] Apply expand_path after output template substitution
+ [YoutubeDL] Propagate overridden meta fields to extraction results of type
url (#11163)
Extractors
+ [generic] Extract RSS entries as url_transparent (#11163)
+ [streamango] Add support for streamango.com (#12643)
+ [wsj:article] Add support for articles (#12558)
* [brightcove] Relax video tag embeds extraction and validate ambiguous embeds'
URLs (#9163, #12005, #12178, #12480)
+ [udemy] Add support for react rendition (#12744)
version 2017.04.15
Extractors
* [youku] Fix fileid extraction (#12741, #12743)
version 2017.04.14
Core
+ [downloader/hls] Add basic support for EXT-X-BYTERANGE tag (#10955)
+ [adobepass] Improve Comcast and Verison login code (#10803)
+ [adobepass] Add support for Verizon (#10803)
Extractors
+ [aenetworks] Add support for specials (#12723)
+ [hbo] Extract HLS formats
+ [go90] Add support for go90.com (#10127)
+ [tv2hu] Add support for tv2.hu (#10509)
+ [generic] Exclude URLs with xml ext from valid video URLs (#10768, #11654)
* [youtube] Improve HLS formats extraction
* [afreecatv] Fix extraction for videos with different key layout (#12718)
- [youtube] Remove explicit preference for audio-only and video-only formats in
order not to break sorting when new formats appear
* [canalplus] Bypass geo restriction
version 2017.04.11
Extractors
* [afreecatv] Fix extraction (#12706)
+ [generic] Add support for <object> YouTube embeds (#12637)
* [bbccouk] Treat bitrate as audio+video bitrate in media selector
+ [bbccouk] Skip unrecognized formats in media selector (#12701)
+ [bbccouk] Add support for https protocol in media selector (#12701)
* [curiositystream] Fix extraction (#12638)
* [adn] Update subtitle decryption key
* [chaturbate] Fix extraction (#12665, #12688, #12690)
Changes:
version 2017.04.09
Extractors
+ [medici] Add support for medici.tv (#3406)
+ [rbmaradio] Add support for redbullradio.com URLs (#12687)
+ [npo:live] Add support for default URL (#12555)
* [mixcloud:playlist] Fix title, description and view count extraction (#12582)
+ [thesun] Add suport for thesun.co.uk (#11298, #12674)
+ [ceskateleveize:porady] Add support for porady (#7411, #12645)
* [ceskateleveize] Improve extraction and remove URL replacement hacks
+ [kaltura] Add support for iframe embeds (#12679)
* [airmozilla] Fix extraction (#12670)
* [wshh] Extract html5 entries and delegate to generic extractor (12676)
+ [raiplay] Extract subtitles
+ [xfileshare] Add support for vidlo.us (#12660)
+ [xfileshare] Add support for vidbom.com (#12661)
+ [aenetworks] Add more video URL regular expressions (#12657)
+ [odnoklassniki] Fix format sorting for 1080p quality
+ [rtl2] Add support for you.rtl2.de (#10257)
+ [vshare] Add support for vshare.io (#12278)
version 2017.04.03
Core
+ [extractor/common] Add censorship check for TransTelekom ISP
* [extractor/common] Move censorship checks to a separate method
Extractors
+ [discoveryvr] Add support for discoveryvr.com (#12578)
+ [tv5mondeplus] Add support for tv5mondeplus.com (#11386)
+ [periscope] Add support for pscp.tv URLs (#12618, #12625)
version 2017.04.02
Core
* [YoutubeDL] Return early when extraction of url_transparent fails
Extractors
* [rai] Fix and improve extraction (#11790)
+ [vrv] Add support for series pages
* [limelight] Improve extraction for audio only formats
* [funimation] Fix extraction (#10696, #11773)
+ [xfileshare] Add support for vidabc.com (#12589)
+ [xfileshare] Improve extraction and extract hls formats
+ [crunchyroll] Pass geo verifcation proxy
+ [cwtv] Extract ISM formats
+ [tvplay] Bypass geo restriction
+ [vrv] Add support for vrv.co
+ [packtpub] Add support for packtpub.com (#12610)
+ [generic] Pass base_url to _parse_jwplayer_data
+ [adn] Add support for animedigitalnetwork.fr (#4866)
+ [allocine] Extract more metadata
* [allocine] Fix extraction (#12592)
* [openload] Fix extraction
version 2017.03.26
Core
* Don't raise an error if JWPlayer config data is not a Javascript object
literal. _find_jwplayer_data now returns a dict rather than an str. (#12307)
* Expand environment variables for options representing paths (#12556)
+ [utils] Introduce expand_path
* [downloader/hls] Delegate downloading to ffmpeg immediately for live streams
Extractors
* [afreecatv] Fix extraction (#12179)
+ [atvat] Add support for atv.at (#5325)
+ [fox] Add metadata extraction (#12391)
+ [atresplayer] Extract DASH formats
+ [atresplayer] Extract HD manifest (#12548)
* [atresplayer] Fix login error detection (#12548)
* [franceculture] Fix extraction (#12547)
* [youtube] Improve URL regular expression (#12538)
* [generic] Do not follow redirects to the same URL
version 2017.03.24
Extractors
- [9c9media] Remove mp4 URL extraction request
+ [bellmedia] Add support for etalk.ca and space.ca (#12447)
* [channel9] Fix extraction (#11323)
* [cloudy] Fix extraction (#12525)
+ [hbo] Add support for free episode URLs and new formats extraction (#12519)
* [condenast] Fix extraction and style (#12526)
* [viu] Relax URL regular expression (#12529)
version 2017.03.22
Extractors
- [pluralsight] Omit module title from video title (#12506)
* [pornhub] Decode obfuscated video URL (#12470, #12515)
* [senateisvp] Allow https URL scheme for embeds (#12512)
Changes:
version 2016.10.07
Extractors
+ [iprima] Detect geo restriction
* [facebook] Fix video extraction (#10846)
+ [commonprotocols] Support direct MMS links (#10838)
+ [generic] Add support for multiple vimeo embeds (#10862)
+ [nzz] Add support for nzz.ch (#4407)
+ [npo] Detect geo restriction
+ [npo] Add support for 2doc.nl (#10842)
+ [lego] Add support for lego.com (#10369)
+ [tonline] Add support for t-online.de (#10376)
* [techtalks] Relax URL regular expression (#10840)
* [youtube:live] Extend URL regular expression (#10839)
+ [theweatherchannel] Add support for weather.com (#7188)
+ [thisoldhouse] Add support for thisoldhouse.com (#10837)
+ [nhl] Add support for wch2016.com (#10833)
* [pornoxo] Use JWPlatform to improve metadata extraction
version 2016.10.02
Core
* Fix possibly lost extended attributes during post-processing
+ Support pyxattr as well as python-xattr for --xattrs and
--xattr-set-filesize (#9054)
Extractors
+ [jwplatform] Support DASH streams in JWPlayer
+ [jwplatform] Support old-style JWPlayer playlists
+ [byutv:event] Add extractor
* [periscope:user] Fix extraction (#10820)
* [dctp] Fix extraction (#10734)
+ [instagram] Extract video dimensions (#10790)
+ [tvland] Extend URL regular expression (#10812)
+ [vgtv] Add support for tv.aftonbladet.se (#10800)
- [aftonbladet] Remove extractor
* [vk] Fix timestamp and view count extraction (#10760)
+ [vk] Add support for running and finished live streams (#10799)
+ [leeco] Recognize more Le Sports URLs (#10794)
+ [instagram] Extract comments (#10788)
+ [ketnet] Extract mzsource formats (#10770)
* [limelight:media] Improve HTTP formats extraction
version 2016.09.27
Core
+ Add hdcore query parameter to akamai f4m formats
+ Delegate HLS live streams downloading to ffmpeg
+ Improved support for HTML5 subtitles
Extractors
+ [vk] Add support for dailymotion embeds (#10661)
* [promptfile] Fix extraction (#10634)
* [kaltura] Speed up embed regular expressions (#10764)
+ [npo] Add support for anderetijden.nl (#10754)
+ [prosiebensat1] Add support for advopedia sites
* [mwave] Relax URL regular expression (#10735, #10748)
* [prosiebensat1] Fix playlist support (#10745)
+ [prosiebensat1] Add support for sat1gold sites (#10745)
+ [cbsnews:livevideo] Fix extraction and extract m3u8 formats
+ [brightcove:new] Add support for live streams
* [soundcloud] Generalize playlist entries extraction (#10733)
+ [mtv] Add support for new URL schema (#8169, #9808)
* [einthusan] Fix extraction (#10714)
+ [twitter] Support Periscope embeds (#10737)
+ [openload] Support subtitles (#10625)
version 2016.09.24
Core
+ Add support for watchTVeverywhere.com authentication provider based MSOs for
Adobe Pass authentication (#10709)
Extractors
+ [soundcloud:playlist] Provide video id for early playlist entries (#10733)
+ [prosiebensat1] Add support for kabeleinsdoku (#10732)
* [cbs] Extract info from thunder videoPlayerService (#10728)
* [openload] Fix extraction (#10408)
+ [ustream] Support the new HLS streams (#10698)
+ [ooyala] Extract all HLS formats
+ [cartoonnetwork] Add support for Adobe Pass authentication
+ [soundcloud] Extract license metadata
+ [fox] Add support for Adobe Pass authentication (#8584)
+ [tbs] Add support for Adobe Pass authentication (#10642, #10222)
+ [trutv] Add support for Adobe Pass authentication (#10519)
+ [turner] Add support for Adobe Pass authentication
version 2016.09.19
Extractors
+ [crunchyroll] Check if already authenticated (#10700)
- [twitch:stream] Remove fallback to profile extraction when stream is offline
* [thisav] Improve title extraction (#10682)
* [vyborymos] Improve station info extraction
version 2016.09.18
Core
+ Introduce manifest_url and fragments fields in formats dictionary for
fragmented media
+ Provide manifest_url field for DASH segments, HLS and HDS
+ Provide fragments field for DASH segments
* Rework DASH segments downloader to use fragments field
+ Add helper method for Wowza Streaming Engine formats extraction
Extractors
+ [vyborymos] Add extractor for vybory.mos.ru (#10692)
+ [xfileshare] Add title regular expression for streamin.to (#10646)
+ [globo:article] Add support for multiple videos (#10653)
+ [thisav] Recognize HTML5 videos (#10447)
* [jwplatform] Improve JWPlayer detection
+ [mangomolo] Add support for Mangomolo embeds
+ [toutv] Add support for authentication (#10669)
* [franceinter] Fix upload date extraction
* [tv4] Fix HLS and HDS formats extraction (#10659)
pkgsrc changes:
- Use :S modifier exactly two times (instead of using the 'g'
option) in PKGNAME to properly handle VERSION_DATEs with minor
revisions. No other functional changes intended.
Changes:
2016.06.18*
-----------
[carambatv] add extractor
[nickde] add extractor
2016.06.16
----------
[*] misc bug fixes and improvements
2016.06.14
----------
[rockstargames] add new extractor
[*] misc bug fixes and improvements
2016.06.12
----------
[telewebion] add new extractor
[*] misc bug fixes and improvements
2016.06.11*
-----------
[vidio] add extractor
[youku:show] add new extractor
[weibo] remove the extractor
[vulture] remove the extractor
[*] misc bug fixes and improvements
2016.06.03
----------
[seeker] add new extractor
[loc] add extractor
[*] misc bug fixes and improvements
2016.06.02
----------
[*] misc bug fixes and improvements
2016.05.30.2.*
--------------
[afreecatv] add new extractor
[WDR] various bug fixes and improvements
[*] misc bug fixes and improvements
Changes:
2016.05.30
----------
[coub] add new extractor
[eyedottv] add new extractor
[radiocanada] add new extractor
[reuters] add new extractor
[*] various bug fixes and improvements
2016.05.21.2
------------
[*] check for python3 rsa module
2016.05.21.1
------------
[*] check for pandoc
2016.05.21
----------
[cbslocal] add a new extractor
[sendtonews] add a new extractor
[anvato] add a new extractor
[localnews8] add a new extractor
[learnr] add a new extractor
[formula1] add a new extractor
[abcnews] add a new extractor
[*] various bug fixes and improvements
2016.05.16
----------
[collegehumor] remove extractor
[3qsdn] add extractor
[cinemassacre] remove extractor
[sina] fix extraction
[openload] fix extraction
[ustudio] add support ustudio app/embed urls
[nrk] rework extractor
[*] various bug fixes and improvements
2016.05.10
----------
[socks] add support for SOCKS proxies
[ceskatele] add support for live streams
[mva] add new extractor
[litv] add new extractor
[fczenit] misc fixes
[udemy] modernize
[yandexmusic] modernize
[vevo] various improvements
[*] various bug fixes and improvements
Changes:
2016.04.06:
[*] Various bug fixes and improvements
2016.04.05:
[cbs] add base extractor
[movieclips] fix extraction
[camwithher] Add extractor
[cbsinteractive] Add support for ZDNet videos
[instagram:user] Fix extraction (fixes#9059)
[youtube] Add support for zwearz (Closes#9062)
[zdf] Extract subtitles (closes#9081)
[auroravid] Add extractor (Closes#9070)
[deezer] Fix extraction (Closes#9086)
[*] Various bug fixes and improvements
2016.04.01:
[nbc] add new extractor for csnne.com(#5432)
[tenplay] remove extractor(fixes#6927)
[voxmedia] Add new extractor(closes#3182)
[*] Various bug fixes and improvements
2016.03.27:
[twitter] Fix extraction (closes#8966)
[*] Various bug fixes and improvements
2016.03.26:
[*] Various bug fixes and improvements
2016.03.25:
[hbo] Add new extractor
[cda] Add new extractor for cda.pl
[biobiotv] Add extractor
[francetvinfo] Add support for france3-regions and strip title (Closes#7673)
[openload] Add new extractor (closes#8489)
Add extractor for thescene.com (closes#8929)
[youtube:live] Add extractor (Closes#8959)
[*] Various bug fixes and improvements
2016.03.18:
[thestar] Add new extractor(closes#5955)
[tv3] Add new extractor(closes#8059)
[utils] Add extract_attributes for extracting html tag attributes
[bravotv] Add new extractor(#4657)
[once] Add new format extractor
[*] Various bug fixes and improvements
* Provide more metadata
* Add support for alternative layout
* add support pages of type embed
* add support for pages of type tag
* Fix resolution with missing height in output template dict
* fix video_id for --download-archive
* Fix config URL extraction
* support ap.vgtv.no and fix old videos extraction
pkgsrc changes:
o Add a patch in order to also honor ffmpeg[23] and ffprobe[23].
Noticed by Adrien Fernandes.
Changes:
2016.03.01:
[webofstories] Tolerate malforder og:title (Closes#8417)
[zdf] Ignore hls manifests that use https (closes#8665)
[mdr] Fix extraction (Closes#8702)
[rtve.es:live] Fix extraction
[*] other misc bug fixes and improvements
2016.02.27:
[xfileshare] Add support for powerwatch (Closes#8628)
[facebook] Support mobile URLs (closes#8638)
[uStudio] Add new extractor
[space] Remove extractor (Closes#8662) - Now uses ooyala embed
[vidzi] Fix extraction
[videomega] Fix extraction (closes#7606)
[bokecc] Add new extractor (#2336)
[imdb] Recognize 1080p formats (Closes#8677)
[tnaflixnetwork:embed] Add extractor
[dplay] add support for it.dplay.com and dplay.dk
[dplay] Add support for dplay.no
[*] other misc bug fixes and improvements
pkgsrc changes:
o Take the MAINTAINERship
Changes:
2016.02.22:
o [animeondemand] Add extractor (#8518)
o [noz] Add new extractor
o [screenjunkies] Add new extractor
o [arte:magazine] Add extractor
o Misc bug fixes and improvements.
* Improve dailymotion embed detection
* strip http urls in smil manifest
* Improve base url construction
* Pass mpd base url to _parse_mpd_formats
* Allow bestvideo+bestaudio for any extractor
* Add direct mpd url test
* Improve multifeed videos extraction
[youtube] added vcodec/acodec/abr for multiple itags
[utils] Add more items to mimetype2ext (#8293)
[utils] Reorder items in mimetype2ext alphabetically
[youtube] Prefer info from YouTube than _formats (#8293)
[common] Keep full codec name from m3u8 manifests
[facebook] Add shortcut and reformat _VALID_URL
[facebook:post] Add extractor (Closes#8321)
[vevo] extract all formats and bypass geo restriction
[vevo] extract metadata and formats from api if videoinfo is empty
[cspan] Fix clip/prog id extraction (#8317)
[vevo] fallback to youtube video only if vevo video is geo restricted
[cspan] Extract from path when no qualities (Closes#8317)
[instagram] Make description optional (Closes#8326)
[daum.net] Fixes#8331
[extractor/common] Auto calculate tbr when missing
[spankbang] Fix formats extraction
[spankbang] Fix title extraction (Closes#8329)
[extractor/common] detect media playlist in _extract_m3u8_formats
[cbsnews] extract all formats
[cbsnews] Remove unused import
[utils] fix dfxp2srt text extraction(fixes#8055)
[ndr:embed:base] Add missing ext for m3u8
[ok] Add support for mobile URLs (Closes#8345)
[bbc] Add another title regex (Closes#8340)
[bbc] Add another description regex
[bbc] Add test for #8147
[ffmpeg] fix adding metadata when using m3u8_native(fixes#8350)
[youtube:user] Require 'https?://' in the url (fixes#8356)
[azubu] Add extractor for live streams (closes#8343)
[cspan] Unescape path (Closes#8365)
[extractor/common] Restrict checks when auto calculating tbr
[espn] Improve video id extraction (Closes#8368)
[daum] Fix copy-paste mistake
[daum] Fix add view_count, comment_count to test
[daum.net] Move the request to ClipInfoXml.do
[daum.net] Support VodPlayer.swf URLs (closes#8173)
[daum] Add 'thumbnail' to all _TESTS
[facebook] Support alternative webpage form
[youtube] Move decrypt_sig out of _parse_dash_manifest
[daum.net] Support for playlists, user channels
[downloader/f4m] Prefer bootstrap url attribute over inline bootstrap
[matchtv] Add extractor (Closes#8313)
[options] Add missing closing parenthesis
[common] _parse_dash_manifest() from youtube.py
[downloader/fragment] Do not report total bytes estimation and eta
[downloader/f4m] Add live stream flag to context
[common] Modify _parse_dash_manifest for use in Facebook
[downloader/fragment] Remove superfluous whitespace
[facebook] Add support for DASH manifests
[youtube] Pass self._formats to _parse_dash_manifest
[common] Fix for youtube
[common] Prefer the manifest than formats_dict in determining codecs
[downloader/f4m] Do not update fragment list while test
[youtube] Remove '(v|a)codec': 'none' entries
[common] Rename to namespace
[common] Remove unused arguments
[common] Add _extract_dash_manifest_formats
[facebook] Add md5 for the test case with DASH
[generic] Add support for Limelight API
[limelight] fix format sorting and make m3u8 and f4m extraction
[npo] Add extension for m3u8
[viidea] Skip download for the test case requiring ffmpeg
[vgtv] Fix test_VGTV_2
[screenwavemedia] Fix HLS extension and test_TeamFour
[tv2] Fix test_TV2
[senateisvp] Fix test_SenateISVP and test_SenateISVP_1
[nrktv] Fix _TESTS
[nbc] Use NBC's id and fix _TESTS
[nba] Add ext for hls formats and fix test_NBA
[schooltv] Add extractor for SchoolTV playlists
[schooltv] Improve video id regex
[Gamekings] Fix url from .tv to .nl
[letv] Fix LetvCloud extraction
[Gamekings] Fix viewing of old videos
[youtube] Use authentication for entry list base extractor (Closes#8380)
[youtube] Filter duplicates in playlists base extractor
[test_youtube_lists] Fix TestYoutubeLists.test_youtube_course
[test_subtitles] Fix TestRaiSubtitles
[xuite] Replace the test case with my uploaded one
[FFmpegSubtitlesConvertorPP] delete old subtitle files (fixes#8382)
[youtube] Use 'orderedSet' instead of 'set' to preserve the order
[gamekings] Add MD5 back
[gamekings] add_ie
[gamekings] Stricter checks
[acast] Fix extraction
[acast] Remove ACastBaseIE
[allocine] Fix extraction of test_allocine_1 and update tests
[bpb] Fix extraction and update tests
[allocine] Use xpath_element
[vidzi] Fix extraction
[vidzi] Fix _TESTS
[YoutubeDL] Do not override ie_key in url_transparent
[kickstarter] Eliminate the warning message and add_ie
[kickstarter] Fix title and test_kickstarter
[daum] PEP8
[daum] Do not match a single URL with multiple info extractors
[daum] Update test_daum_1
[daum.net:user] Match more URLs (#1952)
[vk:uservideos] Improve _VALID_URL (Closes#8389)
[test_YoutubeDL] Fix test_youtube_format_selection
[ffmpeg] fix adding metadata when using --hls-prefer-native(#8350)
[utils] dfxp2srt: make TTMLPElementParser inherit from object
[cbsnews] add support for live videos(fixes#7010)
[srgssr] use flv as ext for rtmp formats
[README.md] Clarify unavailable sequences in output format
[kuwo] Check for georestriction
[generic] extract m3u8 formats when mpegurl content type detected
[youtube] fix subtitle extraction(fixes#8415)
[youtube] fix subtitle order
[test_subtitles] update youtube subtitles tests
[arte.tv:+7] Fix extraction (fixes#8427)
[downloader/common] report_retry: Don't crash when retries is infinite
[cbsnews] Extract subtitles
[cbsnews] Simplify subtitles extraction and fix test
[arte:future] Fix extraction
[arte:future] Make duplicated test matching only
[arte:cinema] Add extractor
[nuevo] Generalize nuevo extractor and add support for trollvids
[nuevo] Simplify nuevo extractors
[ruleporn] Add new extractor
[nuevo] Improve thumbnail extraction
[ruleporn] Rework in terms of nuevo
[lovehomeporn] Add extractor
[SVTPlay] Add subtitle support
[svt] Improve subtitles extraction and add test
[options] Clarify language tags
[kanalplay] Use IETF language tag
[drtv] Use IETF language tag
Update during the freeze approved by jperkin@
(while strictly speaking net/youtube-dl is a leaf package there are various
possible consumers, e.g. multimedia/mpv)
Changes:
2015.12.18:
o Misc bugfixes and improvements (most user visible change is the fixes
for #7900 and #7901 that fixes extraction of various youtube videos)
2015.12.13
o New [funimation] extractor
o Misc bugfixes and improvements
2015.12.10:
o Misc bugfixes and improvements
Changes:
2015.11.24
----------
o Misc bug fixes and improvements
2015.11.23
----------
o Misc bug fixes and improvements (most user visible change are fixes for
youtube extractor)
2015.11.21
----------
o Misc bug fixes and improvements
2015.11.19
----------
o Misc bug fixes and improvements
2015.11.18
----------
o Add extractor for dplay
o Misc bug fixes and improvements
2015.11.15
----------
o Misc bug fixes and improvements
2015.11.13
----------
o Add extractor for vidto
o Misc bug fixes and improvements
* get format_id from video file ext
* check for the offline error page
* treat the offline error as an expected ExtractorError
* Look for sm4:video:embed
* Add _extract_url
* Use _extract_url for mtvservices
ok by wiz@.
pkgsrc changes:
o Install the fish completion file in the proper directory (thanks to wiz@ for
noticing that)
Changes:
2015.08.09
o [periscope] add extractor
o [quickscope] add extractor
o misc bug fixes and improvements
2015.08.06
o misc bug fixes and improvements
2015.07.28
o [bbcnews] add support for bbc.com/news
o [dcn] add new extractor
o [lecture2go] add new extractor
o misc bug fixes and improvements
2015.07.21
o [sportschau] add support for sportschau.de
o [appleconnect] add new extractor
o misc bug fixes and improvements
2015.07.18
o [rdsca] new extractor
o [myvi:embed] add extractor
o misc bug fixes and improvements
2015.07.07
o [gfycat] various fixes
Changes:
2015.05.04:
o Various fixes for existing extractors.
2015.05.03:
o Add extractor to [foxsports]
o Remove [Grooveshark] extractor (grooveshark.com was shut down on 2015/04/30)
o Add new extractor [baiduvideo]
2015.04.28:
o Various fixes for existing extractors.
2015.04.26:
o Add support for [gfycat]
o Add extractor to [Senate]
o Various fixes for existing extractors.
Changes:
2015.04.17
[QQMusic] Add new extractor
[srf] Add new extractor
2015.04.09
[Gamersyde] Add new extractor
[RadioJavan] Add new extractor
Remove check for ssl certs: When it uses a capath instead of a cafile,
'get_ca_certs' or 'cert_store_stats' only returns certificates already used in
a connection
[udn] Add new extractor
2015.04.03
[Dumpert] Add new extractor (Dutch video site Dumpert)
2015.03.28
[22tracks] Add new extractor
[Varzesh3] Add new extractor
2015.03.24
[safari] Add safaribooksonline extractor
[pornovoisines] Add extractor
[MiomioTV] Add new extractor
[nrk:playlist] Add extractor
2015.03.18
[ultimedia] Add extractor
[primesharetv] Add primeshare.tv extractor
[rtve] Add new extractor for rtve infantil
2015.03.15
[viewster] Add extractor
[kanalplay] Add extractor
[footyroom] Add extractor
[ssa] Add extractor
[yamusic] rename to yandexmusic
2015.03.09
[pladform] Add extractor
[gazeta] Add new extractor
[eagleplatform] Add extractor
[douyutv] Add new extractor
[playwire] Add extractor
2015.03.03.1
Make sure netrc works for all extractors with login support
2015.03.03
[downloader/external] Add support for custom options
2015.02.28
[thechive] remove in favor of Kaltura
[oppetarkiv] Add new extractor and merge with svtplay
[odnoklassniki] Add extractor
[kaltura] Add new extractor
[TheChiveIE] added support for thechive.com
While here also add a comment to document how to get a useful changelog (altough
it is also very complete because it include all commit messages) for future
pkgsrc commits.
Changes:
2014.08.05:
o [vimeo] various improvements
2014.08.02.1:
o [ubu] better quality support (.mp4)
o [pbs] various improvements (including frontline video support)
SyntaxError: Non-UTF-8 code starting with '\xb7' in file youtube-dl on line 3, but no encoding declared; see http://python.org/dev/peps/pep-0263/ for details
by installing the original unmodified file and a wrapper script.
I'm not sure why it broke or why this works better, but it does for me (TM).
Bump PKGREVISION.