./net/gallery-dl, Command-line program to download image galleries and collections

[ CVSweb ] [ Homepage ] [ RSS ] [ Required by ] [ Add to tracker ]


Branch: CURRENT, Version: 1.27.6, Package name: gallery-dl-1.27.6, Maintainer: leot

gallery-dl is a command-line program to download image galleries
and image collections from several image hosting sites.


Required to run:
[devel/py-setuptools] [databases/py-sqlite3] [devel/py-requests] [lang/python37]

Required to build:
[pkgtools/cwrappers]

Master sites:

Filesize: 481.746 KB

Version history: (Expand)


CVS history: (Expand)


   2024-10-20 11:56:27 by Leonardo Taccari | Files touched by this commit (3)
Log message:
gallery-dl: Update to 1.27.6

Changes:
1.27.6
======
- [ao3] add `subscriptions` extractor
- [boosty] add support
- [civitai] add `post` extractors
- [pixiv] support unlisted artworks
- Several bug fixes and improvements

1.27.5
======
- [ao3] add support
- [civitai] add support
- [cohost] add support
- Several bug fixes and improvements

1.27.4
======
- [sexcom] add `likes` extractor
- [wikimedia] add `wiki` extractor
- Several bug fixes and improvements
   2023-08-17 23:41:45 by Leonardo Taccari | Files touched by this commit (3) | Package updated
Log message:
gallery-dl: Update to 1.25.8

Changes:
## 1.25.8 - 2023-07-15
### Changes
- update default User-Agent header to Firefox 115 ESR
### Additions
- [gfycat] support `@me` user
- [gfycat] implement login support
- [reddit] notify users about registering an OAuth application
- [twitter] add `ratelimit` option
- [twitter] use `TweetResultByRestId` endpoint that allows accessing
  single Tweets without login
### Removals
- [bcy] remove module
- [lineblog] remove module

## 1.25.7 - 2023-07-02
### Additions
- [flickr] add 'exif' option
- [flickr] add 'metadata' option
- [mangapark] add 'source' option
- [twitter] extend 'conversations' option

## 1.25.6 - 2023-06-17
### Additions
- [blogger] download files from `lh*.googleusercontent.com`
- [fantia] extract `plan` metadata
- [fantia] emit warning for non-visible content sections
- [furaffinity] extract `favorite_id` metadata
- [jschan] add generic extractors for jschan image boards
- [kemonoparty] support `.su` TLDs
- [pixiv:novel] add `novel-bookmark` extractor
- [pixiv:novel] add `full-series` option
- [postimage] add gallery support, update image extractor
- [redgifs] support galleries
- [twitter] extract `conversation_id` metadata
- [vipergirls] add login support
- [vipergirls] use API endpoints
- [formatter] implement `H` conversion

## 1.25.5 - 2023-05-27
### Additions
- [8muses] add `parts` metadata field
- [danbooru] add `date` metadata field
- [e621] add `date` metadata field
- [gofile] add basic password support
- [imagechest] implement API support
- [instagram] add `order-files` option
- [instagram] add `order-posts` option
- [instagram] add `metadata` option
- [jpgfish] add `jpg.fishing` extractors
- [lensdump] add `lensdump.com` extractors
- [mangaread] add `mangaread.org` extractors
- [misskey] add `favorite` extractor
- [pixiv] add `novel` support
- [reddit] support cross-posted media
- [postprocessor:exec] support tilde expansion for `command`
- [formatter] support slicing strings as bytes

## 1.25.4 - 2023-05-07
### Additions
- [4chanarchives] add `thread` and `board` extractors
- [foolfuuka] add `archive.palanq.win`
- [imgur] add `favorite-folder` extractor
- [mangadex] add `status` and `tags` metadata
- allow selecting a domain with `--cookies-from-browser`
- add `--cookies-export` command-line option
- add `-C` as short option for `--cookies`
- include exception type in config error messages

### Removals
- [420chan] remove module
- [foolfuuka] remove `archive.alice.al` and `tokyochronos.net`
- [foolslide] remove `sensescans.com`
- [nana] remove module

## 1.25.3 - 2023-04-30
### Additions
- [imagefap] extract `description` and `categories` metadata
- [imxto] add `gallery` extractor
- [itchio] add `game` extractor
- [nitter] extract user IDs from encoded banner URLs
- [pixiv] allow sorting search results by popularity
- [reddit] match `preview.redd.it` URLs
- [sankaku] support post URLs with MD5 hashes
- [shimmie2] add generic extractors for Shimmie2 sites
- [tumblr] add `day` extractor
- [twitter] support `profile-conversation` entries
- [vipergirls] add `thread` and `post` extractors
- [downloader:http] add `consume-content` option

## 1.25.2 - 2023-04-15
### Additions
- [deviantart] add `public` option
- [nitter] extract videos from `source` elements
- [twitter] add `date_liked` and `date_bookmarked` metadata for liked and
  bookmarked Tweets
- [urlshortener] add support for bit.ly & t.co
- [downloader:http] add MIME type and signature for `.heic` files

## 1.25.1 - 2023-03-25
### Additions
- [nitter] support nitter.it
- [twitter] add `hashtag` extractor
- [twitter] support Tweet content with >280 characters
- [formatter] support loading f-strings from template files
- [formatter] support filesystem paths for `\fM` modules
- [formatter] support putting keys in quotes (e.g. `user['name']`)
- [postprocessor:metadata] add `skip` option
   2023-08-14 07:25:36 by Thomas Klausner | Files touched by this commit (1247)
Log message:
*: recursive bump for Python 3.11 as new default
   2023-03-19 12:56:01 by Leonardo Taccari | Files touched by this commit (3) | Package updated
Log message:
gallery-dl: Update to 1.25.0

Changes:
## 1.25.0 - 2023-03-11
### Changes
- [e621] split `e621` extractors from `danbooru` module
- [deviantart] remove mature scraps warning
- [deviantart] use `/collections/all` endpoint for favorites
- [newgrounds] update default image and audio archive IDs to prevent ID overlap
- rename `--ignore-config` to `--config-ignore`

### Extractors
- [catbox] add `file` extractor
- [deviantart] add `search` extractor
- [deviantart] add `gallery-search` extractor
- [deviantart] support `fxdeviantart.com` URLs (##3740)
- [e621] implement `notes` and `pools` metadata extraction
- [gelbooru] add `favorite` extractor
- [imagetwist] support `phun.imagetwist.com` and `imagehaha.com` domains
- [instagram] add `user` metadata field
- [manganelo] update and fix metadata extraction
- [manganelo] support mobile-only chapters
- [mangasee] extract `author` and `genre` metadata
- [misskey] add `misskey` extractors
- [pornpics] add `gallery` and `search` extractors
- [redgifs] support v3 URLs
- [redgifs] add `collection` extractors
- [shopify] support ohpolly.com
- [szurubooru] add `tag` and `post` extractors
- [twitter] add `transform` option

### Options
- [postprocessor:metadata] add `sort` and `separators` options
- [postprocessor:exec] implement archive options
- add `--config-create` command-line option
- add `--config-toml` command-line option to load config files in TOML format
- add `output.stdout`, `output.stdin`, and `output.stderr` options
- add `hash_md5` and `hash_sha1` functions
- implement `globals` option to enable defining custom functions for `eval` \ 
statements
- implement `archive-pragma` option to use SQLite PRAGMA statements
- implement `actions` to trigger events on logging messages
- implement ability to load external extractor classes
  - `-X/--extractors` command-line options
  - `extractor.modules-sources` config option

### Fixes
- [bunkr] fix extraction
- [danbooru] send gallery-dl User-Agent
- [deviantart] fix crash when handling deleted deviations in status updates
- [fanbox] fix crash with missing images
- [imagefap] update `gallery` URLs
- [imagefap] fix infinite pagination loop
- [imagefap] fix metadata extraction
- [oauth] use default name for browsers without `name` attribute
- [pinterest] unescape search terms
- [pixiv] fix `--write-tags` for `"tags": "original"`
- [poipiku] warn about incorrect passwords
- [reddit] update `videos` option
- [soundgasm] rewrite
- [telegraph] fix extraction when images are not in `<figure>` elements
- [tumblr] raise more detailed errors for dashboard-only blogs
- [twitter] fix some `original` retweets not downloading
- [ytdl] fix `--parse-metadata`
- [downloader:ytdl] prevent exception on empty results

### Improvements
- [downloader:http] use `time.monotonic()`
- [downloader:http] update `_http_retry` to accept a Python function
- [postprocessor:metadata] speed up JSON encoding
- replace `json.loads/dumps` with direct calls to \ 
`JSONDecoder.decode/JSONEncoder.encode`
- improve `option.Formatter` performance

### Removals
- [nitter] remove `nitter.pussthecat.org`

## 1.24.5 - 2023-01-28
### Additions
- [booru] add `url` option
- [danbooru] extend `metadata` option
- [deviantart] add extractor for status updates
- [deviantart] add support for `/deviation/` and `fav.me` URLs
- [kemonoparty] extract `hash` metadata for discord files
- [lexica] add `search` extractor
- [mastodon] add `num` and `count` metadata fields
- [nudecollect] add `image` and `album` extractors
- [wikifeet] add `gallery` extractor
- [downloader:http] add signature checks for `.blend`, `.obj`, and `.clip` files
- add `extractor.retry-codes` option
- add `-O/--postprocessor-option` command-line option
- improve `write-pages` output

### Fixes
- [bunkr] fix downloading `.mkv` and `.ts` files
- [fantia] send `X-CSRF-Token` headers
- [generic] fix regex for non-src image URLs
- [hiperdex] update domain
- [hotleak] fix video URLs
- [instagram] always show `cursor` value after errors
- [instagram] update API domain, headers, and csrf token handling
- [oauth] show `client-id`/`api-key` values
- [philomena] match URLs with www subdomain
- [sankaku] update URL pattern
- [twitter] refresh guest tokens
- [twitter] fix search pagination
- [twitter] use `"browser": "firefox"` by default

## 1.24.4 - 2023-01-11
### Additions
- [downloader:http] add `validate` option

### Fixes
- [kemonoparty] fix regression from commit 473bd380

## 1.24.3 - 2023-01-10
### Additions
- [danbooru] extract `uploader` metadata
- [deviantart] initial implementation of username & password login for `scraps`
- [fanleaks] add `post` and `model` extractors
- [imagefap] add `folder` extractor
- [lynxchan] support `bbw-chan.nl`
- [pinterest] support `All Pins` boards
- [pinterest] add `domain` option
- [pixiv] implement `metadata-bookmark` option
- [tcbscans] add `chapter` and `manga` extractors
- [twitter] implement `syndication=extended`
- implement slice notation for `range` options
- allow `filter` options to be a list of expressions

### Fixes
- [behance] use delay between requests
- [bunkr] fix URLs returned by API
- [fanbox] return `imageMap` files in order
- [imagefap] use delay between requests
- [imagefap] warn about redirects to `/human-verification`
- [kemonoparty] reject invalid/empty files
- [myhentaigallery] handle whitespace before title tag
- [poipiku] fix extraction for a different warning button style
- [poipiku] warn about login requirements
- [telegraph] fix file URLs
- [twitter] fix crash when using `expand` and `syndication`
- [twitter] apply tweet type checks before uniqueness check
- [twitter] force `https://` for TwitPic URLs
- [ytdl] adapt to yt-dlp changes
- update and improve documentation

## 1.24.2 - 2022-12-18
### Additions
- [2chen] support `.club` URLs
- [deviantart] extract sta.sh URLs from `text_content`
- [deviantart] add `/view` URL support
- [e621] implement `threshold` option to control pagination
- [fapello] add `post`, `user` and `path` extractors
- [imgur] add support for imgur.io URLs
- [lynxchan] add generic extractors for lynxchan imageboards
- [mangafox] extract more metadata
- [pixiv] extract `date_url` metadata
- [soundgasm] add `audio` and `user` extractors
- [webmshare] add `video` extractor
- support Firefox containers for `--cookies-from-browser`

### Fixes
- [2chen] fix file URLs
- [bunkr] update domain
- [exhentai] fix pagination
- [imagetwist] fix extraction
- [imgth] rewrite
- [instagram] prevent post `date` overwriting file `date`
- [khinsider] fix metadata extraction
- [komikcast] update domain and fix extraction
- [reddit] increase `id-max` default value
- [seiga] raise error when redirected to login page
- [sexcom] fix video URLs
- [twitter] update `search` pagination
- [warosu] fix and update
- [zerochan] update for layout v3
- restore paths for archived files
- use `util.NONE` as `keyword-default` default value

### Removals
- [foolslide] remove `kireicake`
- [kissgoddess] remove module

## 1.24.1 - 2022-12-04
### Additions
- [artstation] add `pro-first` option
- [artstation] add `max-posts` option
- [fapachi] add `post` and `user` extractors
- [inkbunny] provide additional metadata
- [nitter] add `retweets` option
- [nitter] add `videos` option
- [nitter] support `/i/web/` and `/i/user/` URLs
- [pixhost] add `gallery` support
- [weibo] add `count` metadata field
- [downloader:http] add `retry-codes` option
- [formatter] implement `S` format specifier to sort lists
- implement `version-metadata` option

### Fixes
- [2chen] fix extraction
- [bcy] fix JSONDecodeError
- [bunkr] fix video downloads
- [bunkr] use `media-files` servers for more file types
- [itaku] remove `Extreme` rating
- [hitomi] apply format check for every image
- [hotleak] fix UnboundLocalError
- [nitter] sanitize filenames
- [nitter] retry downloads on 404
- [nitter] set `hlsPlayback` cookie
- [patreon] fix `403 Forbidden` errors
- [patreon] improve `campaign_id` extraction
- [patreon] update API query parameters
- [pixiv] preserve `tags` order
- [reddit] use `dash_url` for videos
- [twitter] fix error when using user IDs for suspended accounts
- [weibo] fix bug with empty `playback_list`
- [downloader:http] fix potential `ZeroDivisionError`

### Removals
- [lolisafe] remove `zz.ht`

## 1.24.0 - 2022-11-20
### Additions
- [exhentai] add metadata to search results
- [gelbooru_v02] implement `notes` extraction
- [instagram] add `guide` extractor
- [lolisafe] add support for xbunkr
- [mastodon] add `instance_remote` metadata field
- [nitter] add extractors for Nitter instances
- [pixiv] add support for new daily AI rankings category
- [twitter] add `avatar` and `background` extractors
- [uploadir] add support for `uploadir.com`
- [wallhaven] add `user` extractor
- [downloader:http] add `chunk-size` option
- [downloader:http] add file signature check for `.mp4` files
- [downloader:http] add file signature check and MIME type for `.avif` files
- [postprocessor] implement `post-after` event
- [postprocessor:metadata] implement `"mode": "jsonl"`
- [postprocessor:metadata] add `open`, `encoding`, and `private` options
- add `--chunk-size` command-line option
- add `--user-agent` command-line option
- implement `http-metadata` option
- implement `"user-agent": "browser"`

### Changes
- [deviantart] restore cookies warning for mature scraps
- [instagram] use REST API for unauthenticated users by default
- [downloader:http] increase default `chunk-size` to 32768 bytes
- build Windows executables using py2exe's new `freeze()` API
- build executables on GitHub Actions with Python 3.11
- reword error text for unsupported URLs

### Fixes
- [exhentai] fix pagination
- [khinsider] fix extraction
- [realbooru] fix download URLs
- [realbooru] fix `tags` extraction
- [tumblr] fall back to `gifv` when possible
- [twitter] fix login
- [twitter] update URL for syndication API
- [weibo] send `Referer` headers
- [ytdl] update `parse_bytes` location

### Improvements
- [imxto] extract additional metadata
- [instagram] allow downloading avatars for private profiles
- [pixiv] raise error for invalid search/ranking parameters
- [twitter] update `bookmarks` pagination
- [downloader:http] refactor file signature checks
- [downloader:http] improve `-r/--limit-rate` accuracy
- add loaded config files to debug output
- improve `-K` output for lists

### Removals
- [instagram] remove login support
- [instagram] remove `channel` extractor
- [ngomik] remove module

## 1.23.5 - 2022-10-30
### Fixes
- [instagram] fix AttributeError on user stories extraction

## 1.23.4 - 2022-10-29
### Additions
- [aibooru] add support for aibooru.online
- [instagram] add 'avatar' extractor
- [instagram] support 'instagram.com/s/' highlight URLs
- [instagram] extract 'coauthors' metadata
- [mangasee] add support for 'mangalife'
- [mastodon] add 'bookmark' extractor
- [mastodon] support cross-instance user references and '/web/' URLs
- [moebooru] implement 'notes' extraction
- [pixiv] extend 'metadata' option
- [reactor] match 'best', 'new', 'all' URLs
- [smugloli] add 'smugloli' extractors
- [tumblr] add 'fallback-delay' and 'fallback-retries' options
- [vichan] add generic extractors for vichan imageboards
### Fixes
- [bcy] fix extraction
- [gelbooru] support alternate parameter order in post URLs
- [hentai2read] support minor versions in chapter URLs
- [hentaihere] support minor versions in chapter URLs
- [kemonoparty] fix 'dms' extraction
- [kemonoparty] update pagination offset
- [manganelo] update domain to 'chapmanganato.com'
- [pixiv] use 'exact_match_for_tags' as default search mode
- [redgifs] fix 'token' extraction
- [skeb] fix extraction
- improve compatibility of DownloadArchive

## 1.23.3 - 2022-10-15
### Additions
- [2chen] Add `2chen.moe` extractor
- [8chan] add `thread` and `board` extractors
- [deviantart] add `group` option
- [fanbox] add `content` metadata field
- [instagram] restore `cursor` functionality
- [instagram] restore warnings for private profiles
- [nana] add `nana` extractors
- [nijie] add `feed` and `followed` extractors
- [tumblr] support `https://www.tumblr.com/BLOGNAME` URLs
- [tumblr] add `offset` option
- [vk] add `tagged` extractor
- add `path-extended` option
- emit debug logging messages before calling time.sleep()

### Changes
- [postprocessor:metadata] assume `"mode": "custom"` when \ 
`format` is given

### Fixes
- [artstation] skip missing projects
- [danbooru] fix ugoira metadata extraction
- [deviantart] fix `deviation` extraction
- [hitomi] fall back to `webp` when selected format is not available
- [imagefap] fix and improve folder extraction and gallery pagination
- [instagram] fix login
- [nozomi] fix extraction
- [redgifs] fix extraction
- [tumblr] sleep between fallback retries
- [vk] unescape error messages
- fix duplicated metadata bug with `-j`
- fix bug when processing input file comments

## 1.23.2 - 2022-10-01
### Additions
- [artstation] support search filters
- [blogger] add `label` and `query` metadata fields
- [exhentai] add a slash to the end of gallery URLs
- [instagram] add `count` metadata field
- [instagram] add `api` option
- [kemonoparty] add `count` metadata field
- [mastodon] warn about moved accounts
- [newgrounds] add `games` extractor
- [newgrounds] extract `type` metadata
- [pixiv] add `series` extractor
- [sankaku] implement `refresh` option
- [skeb] add `search` extractor and `filters` option
### Fixes
- [deviantart] fix extraction
- [fappic] fix extraction
- [instagram] extract higher-resolution photos
- [instagram] fix `username` and `fullname` metadata for saved posts
- [instagram] update API headers
- [kemonoparty] send `Referer` headers
- [kemonoparty] restore `favorites` API endpoints
- [myportfolio] use fallback when no images are found
- [plurk] fix extraction
- [sankaku] detect expired links
- [tumblr] retry extraction of failed higher-resolution images
   2022-09-18 15:34:20 by Leonardo Taccari | Files touched by this commit (3) | Package updated
Log message:
gallery-dl: Update to 1.23.1

Changes:
## 1.23.1 - 2022-09-18
### Additions
- [flickr] add support for `secure.flickr.com` URLs
- [hotleak] add hotleak extractors
- [instagram] add `highlight_title` and `date` metadata for highlight
  downloads
- [paheal] add support for videos
- [twitter] add general support for unified cards
- [twitter] implement `cards-blacklist` option
- [tumblr] fetch high-quality inline images
- [tumblr] implement `ratelimit` option
- [zerochan] add `metadata` option
- [postprocessor:zip] implement `files` option

### Fixes
- [bunkr] fix extraction
- [bunkr] use `media-files` servers for `m4v` and `mov` downloads
- [exhentai] improve 509.gif detection
- [exhentai] guess extension for original files
- [poipiku] use `img-org.poipiku.com` as image domain
- [reddit] prevent exception with empty submission URLs
- [redgifs] fix download URLs
- [smugmug] update default API credentials
- [twitter] provide proper `date` for syndication results
- [twitter] fix new-style `/card_img/` URLs
- remove all whitespace before comments after input file URLs

## 1.23.0 - 2022-08-28
### Changes
- [twitter] update `user` and `author` metdata fields
  - for URLs with a single username or ID like `https://twitter.com/USER` or a
    search with a single `from:` statement, `user` will now always refer to the
    user referenced in the URL.
  - for all other URLs like `https://twitter.com/i/bookmarks`, `user` and
    `author` refer to the same user
  - `author` will always refer to the original Tweet author
- [twitter] update `quote_id` and `quote_by` metadata fields
  - `quote_id` is now non-zero for quoted Tweets and contains the Tweet ID of
    the quotng Tweet (was the other way round before)
  - `quote_by` is only defined for quoted Tweets like before, but now contains
    the screen name of the user quoting this Tweet
- [skeb] improve archive IDs for thumbnails and article images
### Additions
- [artstation] add `num` and `count` metadata fields
- [catbox] add `album` extractor
- [blogger] emit metadata for posts without files
- [foolfuuka] update supported domains
- [gelbooru] add support for `api_key` and `user_id`
- [gelbooru] implement pagination for `pool` results
- [instagram] add support for a user's saved collections
- [instagram] provide `date` for directory format strings
- [kemonoparty] add `favorites` option
- [oauth] add `host` config option
- [rule34] implement pagination for `pool` results
- [skeb] add option to download `article` images
- [tumblr] download higher-quality images
- [tumblr] add `count` metadata field
- [wallhaven] implement `metadata` option
- [zerochan] add `tag` and `image` extractors
- [zerochan] implement login with username & password
- [postprocessor:metadata] implement `mode: modify` and `mode: delete`
- [formatter] add `g` conversion for slugifying a string
- [formatter] apply `:J` only to lists
- implement `path-metadata` option
- allow comments after input file URLs
- add global `warnings` option to control `urllib3` warning behavior
### Fixes
- [bunkr] fix extraction
- [deviantart] use public access token for journals
- [e621] fix extraction of `popular` posts
- [fanbox] download cover images in original size
- [mastodon] allow downloading without access token
- [hitomi] update cache expiry time
- [hitomi] fix error when number of tag results is a multiple of 25
- [mangahere] fix `page-reverse` option
- [poipiku] fix posts with more than one image
- [poipiku] update filter for static images
- [slideshare] fix metadata extraction
- [twitter] unescape `+` in search queries
- [twitter] fall back to unfiltered search
- [twitter] ignore invalid user entries
- [vk] prevent exceptions for broken/invalid photos
- [vsco] fix `collection` extraction
- [weibo] prevent exception for missing `playback_list`
- [weibo] prevent errors when paginating over album entries
   2022-07-17 18:19:04 by Leonardo Taccari | Files touched by this commit (3) | Package updated
Log message:
gallery-dl: Update to 1.22.4

Changes:
## 1.22.4 - 2022-07-15
### Additions
- [instagram] add `pinned` metadata field
- [itaku] categorize sections by group
- [khinsider] extract `platform` metadata
- [tumblr] support `/blog/view` URLs
- [twitter] implement `strategy` option
- [twitter] add `count` metadata field
- [formatter] implement `O` format specifier
- [postprocessor:mtime] add `value` option
- add `--no-postprocessors` command-line option
- implement `format-separator` option
### Changes
- [pinterest] handle section pins with separate extractors
- [postprocessor:ugoira] enable `mtime` by default
### Fixes
- [bunkr] fix extraction
- [hentaifoundry] fix metadata extraction
- [itaku] fix user caching
- [itaku] fix `date` parsing
- [kemonoparty] ensure all files have an `extension`
- [komikcast] update domain
- [mangakakalot] update domain
- [newgrounds] only attempt to login if necessary
- [newgrounds] prevent exception on empty results
- [nozomi] reduce memory consumption during searches
- [pixiv] fix default `background` filenames
- [sankaku] rewrite file URLs to s.sankakucomplex.com
- [slideshare] fix `description` extraction
- [twitter] ignore previously seen Tweets
- [twitter] unescape HTML entities in `content`
- [weibo] handle invalid or broken status objects
- [postprocessor:zip] ensure target directory exists
- make `brotli` an *optional* dependency
- limit path length for `--write-pages` output on Windows
### Removals
- [foolfuuka] remove archive.wakarimasen.moe

## 1.22.3 - 2022-06-28
### Changes
- [twitter] revert strategy changes for user URLs
- update default User-Agent headers

## 1.22.2 - 2022-06-27
### Additions
- [cyberdrop] add fallback URLs
- [horne] add support for horne.red
- [itaku] add `gallery` and `image` extractors
- [poipiku] add `user` and `post` extractors
- [skeb] add `following` extractor
- [twitter] implement `expand` option
- [twitter] implement `csrf` option
- [unsplash] add `collection_title` and `collection_id` metadata fields
- [weibo] support `tabtype=video` listings
- [formatter] implement slice operator as format specifier
- support cygwin/BSD/etc for `--cookies-from-browser`
### Fixes
- [instagram] improve metadata generated by `_parse_post_api()`
- [instagram] fix `tag` extractor
- [instagram] automatically invalidate expired login sessions
- [twitter] fix pagination for conversion tweets
- [twitter] improve `"replies": "self"`
- [twitter] improve strategy for user URLs
- [vk] take URLs from `*_src` entries
- [weibo] fix URLs generated by `user` extractor
- [weibo] fix retweets
- [downloader:ytdl] update `_set_outtmpl()`
- [formatter] fix `!j` conversion for non-serializable types
- [snap] Fix missing libslang dependency

## 1.22.1 - 2022-06-04
### Additions
- [gfycat] add support for collections
- [instagram] support specifying users by ID
- [paheal] extract more metadata
- [reddit] add `home` extractor
- [weibo] support usernames in URLs
- [weibo] support `livephoto` and `gif` files
- [weibo] add support for several different `tabtype` listings
- [postprocessor:metadata] write to stdout by setting filename to "-"
- implement `output.ansi` option
- support user-defined `output.mode` settings
### Changes
- [readcomiconline] remove default `browser` setting
- [weibo] switch to desktop API
- fix command-line argument name of `--cookies-from-browser`
### Fixes
- [bunkr] change domain to `app.bunkr.is`
- [deviantart] fix folder listings with `"pagination": "manual"`
- [gofile] fix 401 Unauthorized errors
- [hypnohub] move to gelbooru_v02 instances
- [instagram] fix and update extractors
- [nozomi] remove slashes from search terms
- [pixiv] include `.gif` in background fallback URLs
- [sankaku] extend URL patterns
- [subscribestar] fix `date` metadata

## 1.22.0 - 2022-05-25
### Additions
- [gelbooru_v01] add `favorite` extractor
- [instagram] add `tagged_users` to keywords for stories
- [lolisafe] implement `domain` option
- [naverwebtoon] support (best)challenge comics
- [nijie] support /history_nuita.php listings
- [pixiv] provide more data when `metadata` is enabled
- [shopify] support several more sites by default
- [twitter] extract alt texts as `description`
- [twitter] recognize vxtwitter URLs
- [weasyl] implement `metadata` option
- implement `--cookies-from-browser`
- implement `output.colors` options
- implement string literals in replacement fields
- support using extended format strings for archive keys
### Changes
- [foolfuuka] match 4chan filenames
- [pixiv] implement `include` option
  - provide `avatar`/`background` downloads as separate extractors
- [twitter] use a better strategy for user URLs
- [twitter] disable `cards` by default
- delay directory creation
- flush writes to stdout/stderr
- build executables on GitHub Actions with Python 3.10
### Fixes
- [artstation] use `"browser": "firefox"` by default
- [imgur] prevent exception with empty albums
- [instagram] report redirects to captcha challenges
- [khinsider] fix metadata extraction
- [mangafox] send Referer headers
- [mangahere] send Referer headers
- [mangasee] use randomly generated PHPSESSID cookie
- [pixiv] make retrieving ugoira metadata non-fatal
- [readcomiconline] update deobfuscation code
- [realbooru] fix extraction
- [vk] handle photos without width/height info
- [vk] fix user ID extraction
- [webtoons] extract real episode numbers
- create missing directories for archive files
- detect circular references with `-K`
- replace "\f" in `--filename` arguments with a form feed character
### Removals
- [gelbooru_v01] remove tlb.booru.org from supported domains

## 1.21.2 - 2022-04-27
### Additions
- [deviantart] implement `pagination` option
- [pixiv] implement `background` option
- [postprocessor:ugoira] report ffmpeg/mkvmerge errors
### Fixes
- [cyberdrop] match cyberdrop.to URLs
- [e621] fix 403 errors
- [issuu] fix extraction
- [mangadex] download from available chapters despite `externalUrl`
- [photovogue] update domain and api endpoint
- [sexcom] add fallback for empty files
- [twitter] improve syndication video selection
- [twitter] fix various syndication issues
- [vk] fix extraction
- [weibo] fix infinite retries for deleted accounts
- [postprocessor:ugoira] use compatible paths with mkvmerge
- [postprocessor:ugoira] do not auto-select the `image2` demuxer

## 1.21.1 - 2022-04-08
### Additions
- [gofile] add gofile.io extractor
- [instagram] add `previews` option
- [kemonoparty] add `duplicates` option
- [pinterest] add extractor for created pins
- [pinterest] support multiple files per pin
- [telegraph] Add telegra.ph extractor
- [twitter] add `syndication` option
- [twitter] accept fxtwitter.com URLs
- [downloader:http] support using an arbitrary method and sending POST data
- [postprocessor:metadata] implement archive options
- [postprocessor:ugoira] add `mtime` option
- [postprocessor:ugoira] support setting timecodes with `mkvmerge`
- [formatter] support evaluating f-string literals
- add `--ugoira-conv-copy` command-line option
- implement a `contains()` function for filter statements
### Fixes
- [aryion] provide correct `date` metadata independent of DST
- [furaffinity] fix search result pagination
- [hitomi] update and fix metadata extraction
- [kissgoddess] extract all images
- [mangasee] unescape manga names
- [newgrounds] update and fix pagination
- [newgrounds] warn about age-restricted posts
- [pinterest] do not force `m3u8_native` for video downloads
- [twibooru] fix posts without `name`
- [unsplash] replace dash with space in search API queries
- [postprocessor:mtime] fix timestamps from datetime objects
- fix yet another bug in `_check_cookies()`
- fix loading/storing cookies without domain

## 1.21.0 - 2022-03-14
### Additions
- [fantia] add `num` enumeration index
- [fantia] support "Blog Post" content
- [imagebam] add support for /view/ paths
- [kemonoparty] match beta.kemono.party URLs
- [kissgoddess] add `gallery` and `model` extractors
- [mememuseum] add `tag` and `post` extractors
- [newgrounds] add `post_url` metadata field
- [patreon] add `image_large` file type
- [toyhouse] support `art` listings
- [twibooru] add extractors for searches, galleries, and posts
- [postprocessor:metadata] implement `mtime` option
- [postprocessor:mtime] add `event` option
- add fish shell completion
- add `timedelta` class to global namespace in filter expressions
### Changes
- [seiga] require authentication with `user_session` cookie
  - remove username & password login due to 2FA
- refactor proxy support
  - allow gallery-dl proxy settings to overwrite environment proxies
  - allow specifying different proxies for data extraction and download
### Fixes
- [bunkr] fix mp4 downloads
- [fanbox] fetch data for each individual post
- [hentaicosplays] send `Referer` header
- [imagebam] set `nsfw_inter` cookie
- [kemonoparty] limit default filename length
- [mangadex] fix chapters without `translatedLanguage`
- [newgrounds] fix video descriptions
- [skeb] add `sent-requests` option
- [slideshare] fix extraction
- [subscribestar] unescape attachment URLs
- [twitter] fix handling of 429 Too Many Requests responses
- [twitter] warn about age-restricted Tweets
- [twitter] handle Tweets with "softIntervention" entries
- [twitter] update query hashes
- fix another bug in `_check_cookies()`

## 1.20.5 - 2022-02-14
### Additions
- [furaffinity] add `layout` option
- [lightroom] add Lightroom gallery extractor
- [reddit] support standalone submissions on personal user pages
- [redgifs] support i.redgifs.com URLs
- [wallpapercave] add extractor for images and search results
- add `signals-ignore` option
### Changes
- [danbooru] merge `danbooru` and `e621` extractors
  - support `atfbooru`
  - remove support for old e621 tag search URLs
### Fixes
- [furaffinity] improve new/old layout detection
- [imgbox] fix ImgboxExtractor
- [inkbunny] rename search parameters to their API equivalents
- [kemonoparty] handle files without names
- [twitter] fix extraction
- [vk] fix infinite pagination loops
- [downloader:ytdl] make `ImportError`s non-fatal

## 1.20.4 - 2022-02-06
### Additions
- [e621] add `favorite` extractor
- [hitomi] add `format` option
- [kohlchan] add Kohlchan extractors
- [sexcom] add `pins` extractor
- [twitter] add `warnings` option
- add ability to disable TLS 1.2
- add examples for custom gelbooru instances
### Fixes
- [bunkr] fix mp4 downloads
- [gelbooru] improve and fix pagination
- [hitomi] "fix" 403 errors
- [kemonoparty] fix downloading smaller text files
- [patreon] disable TLS 1.2 by default
- [twitter] restore errors for protected timelines etc
- [twitter] restore `logout` functionality
- [twitter] provide fallback URLs for card images
- [weibo] update pagination code
   2022-06-30 13:19:02 by Nia Alarie | Files touched by this commit (524)
Log message:
*: Revbump packages that use Python at runtime without a PKGNAME prefix
   2022-02-05 13:00:34 by Leonardo Taccari | Files touched by this commit (4)
Log message:
gallery-dl: Update to 1.20.3

Changes:
## 1.20.3
- Fixes to kemonoparty and twitter extractors.

## 1.20.2
- Add event extractor for twitter
- Add `--source-address` command-line option #2206
- Enable cards option on twitter extractor by default
- Several fixes

## 1.20.1
- Add newgrounds search extractor
- Restore `-d/--dest` functionality from before 1.20.0
- Change short option for `--directory` to `-D`
- Several fixes

## 1.20.0
- Improve several extractors
- Add a generic extractor
- Add `-d/--directory` and `-f/--filename` command-line options
- Add `--sleep-request` and `--sleep-extractor` command-line options
- Prefer yt-dlp over youtube-dl
- Rename `--write-infojson` to `--write-info-json`
- Several fixes

## 1.19.3
- Improve several extractors
- Several fixes
- Remove seisoparty

## 1.19.2
- Improve several extractors
- Several fixes

## 1.19.1 - 2021-10-24
- Improve several extractors
- Several fixes

## 1.19.0 - 2021-10-01
- Improve several extractors
- Implement a download progress indicator
- Implement a `page-reverse` option
- Implement a way to specify extended format strings
- Add a `--write-infojson` command-line option
- Several fixes