[youtube] Endless "Incomplete data received" when downloading playlist #10394
Description
DO NOT REMOVE OR SKIP THE ISSUE TEMPLATE
- I understand that I will be blocked if I intentionally remove or skip any mandatory* field
Checklist
- I'm reporting that yt-dlp is broken on a supported site
- I've verified that I have updated yt-dlp to nightly or master (update instructions)
- I've checked that all provided URLs are playable in a browser with the same IP and same login details
- I've checked that all URLs and arguments with special characters are properly quoted or escaped
- I've searched known issues and the bugtracker for similar issues including closed ones. DO NOT post duplicates
- I've read the guidelines for opening an issue
- I've read about sharing account credentials and I'm willing to share it if required
Region
No response
Provide a description that is worded well enough to be understood
For certain Youtube playlists the processing of the playlist itself fails.
It is not fatal in the sense that if I dont use --extractor-retries infinite, then it can download the videos on the playlist, but for archiving purposes I wouldn't want to use that unless necessary.
An optimal fix would accept the amount of data that youtube has returned, and save that into the appropriate output files.
In the command output I have also included the command that should be able to reproduce the issue, along with an example playlist where this occurs.
#1787 is similar, but that is for downloading comments, this is for playlists.
Provide verbose output that clearly demonstrates the problem
- Run your yt-dlp command with -vU flag added (
yt-dlp -vU <your command line>) - If using API, add
'verbose': TruetoYoutubeDLparams instead - Copy the WHOLE output (starting with
[debug] Command-line config) and insert it below
Complete Verbose Output
yt-dlp --no-config --extractor-retries infinite -vU --simulate https://www.youtube.com/playlist?list=PLYc8xAEfO0PTjG7nVafkLeVxQ5raSJwc8
[debug] Command-line config: ['--no-config', '--extractor-retries', 'infinite', '-vU', '--simulate', 'https://www.youtube.com/playlist?list=PLYc8xAEfO0PTjG7nVafkLeVxQ5raSJwc8']
[debug] Encodings: locale cp1252, fs utf-8, pref cp1252, out utf-8, error utf-8, screen utf-8
[debug] yt-dlp version stable@2024.07.07 from yt-dlp/yt-dlp [b337d2989] (win_exe)
[debug] Python 3.8.10 (CPython AMD64 64bit) - Windows-10-10.0.18363-SP0 (OpenSSL 1.1.1k 25 Mar 2021)
[debug] exe versions: ffmpeg 7.0-full_build-www.gyan.dev (setts), ffprobe 7.0-full_build-www.gyan.dev
[debug] Optional libraries: Cryptodome-3.20.0, brotli-1.1.0, certifi-2024.07.04, curl_cffi-0.5.10, mutagen-1.47.0, requests-2.32.3, sqlite3-3.35.5, urllib3-2.2.2, websockets-12.0
[debug] Proxy map: {}
[debug] Request Handlers: urllib, requests, websockets, curl_cffi
[debug] Loaded 1834 extractors
[debug] Fetching release info: https://api.github.com/repos/yt-dlp/yt-dlp/releases/latest
Latest version: stable@2024.07.07 from yt-dlp/yt-dlp
yt-dlp is up to date (stable@2024.07.07 from yt-dlp/yt-dlp)
[youtube:tab] Extracting URL: https://www.youtube.com/playlist?list=PLYc8xAEfO0PTjG7nVafkLeVxQ5raSJwc8
[youtube:tab] PLYc8xAEfO0PTjG7nVafkLeVxQ5raSJwc8: Downloading webpage
[youtube:tab] PLYc8xAEfO0PTjG7nVafkLeVxQ5raSJwc8: Redownloading playlist API JSON with unavailable videos
[download] Downloading playlist: Minecraft Modokkal (1.7.10)
[youtube:tab] PLYc8xAEfO0PTjG7nVafkLeVxQ5raSJwc8 page 1: Downloading API JSON
WARNING: [youtube:tab] Incomplete data received. Retrying (1/inf)...
[youtube:tab] PLYc8xAEfO0PTjG7nVafkLeVxQ5raSJwc8 page 1: Downloading API JSON
WARNING: [youtube:tab] Incomplete data received. Retrying (2/inf)...
[youtube:tab] PLYc8xAEfO0PTjG7nVafkLeVxQ5raSJwc8 page 1: Downloading API JSON
WARNING: [youtube:tab] Incomplete data received. Retrying (3/inf)...
[youtube:tab] PLYc8xAEfO0PTjG7nVafkLeVxQ5raSJwc8 page 1: Downloading API JSON
WARNING: [youtube:tab] Incomplete data received. Retrying (4/inf)...
[youtube:tab] PLYc8xAEfO0PTjG7nVafkLeVxQ5raSJwc8 page 1: Downloading API JSON
WARNING: [youtube:tab] Incomplete data received. Retrying (5/inf)...
[snip]