Porteus switched from youtube-dl to yt-dlp - and how to get the most recent version

[Rava]

hi Rava give a tube link to the movie

The link is right there, all you need is the code representing the chosen video/audio formats:

Code: Select all

yt-dlp -f 243+250 https://www.youtube.com/watch?v=yMXL4NiKJ0A

and

Code: Select all

yt-dlp -f 243+250 yMXL4NiKJ0A

are the same. My bad, I forgot to add the needed chosen formats - 243+250 - to get the same results / warning I presume.

[beny]

hi Rava but is a review so no movie in, for me tell hey you have the last version of yt-dlp i have to upgrade but no problem to downloads at all when i have upgraded the software report here. ok work

[Rava]

is a review so no movie in

sure it's a review my issue was with it's warning

Code: Select all

WARNING: [youtube] yMXL4NiKJ0A: nsig extraction failed: You may experience throttling for some formats
         Install PhantomJS to workaround the issue

I have no idea what "nsig extraction" is, nor did I ever install PhantomJS

And the " You may experience throttling for some formats" is vague as can be, it would only be an issue if there could be "throttling" for the formats I choose.

[beny]

hi Rava grab the zip file on github site and i use yt-dlp inside the directory and the link is downloaded without issue so also without the video resolution into the line,but i can confirm no need to install phantomjs that is a browser?

[Rava]

grab the zip file on github site and i use yt-dlp inside the directory

I want the update-browser script to work correctly, therefore I am testing that version of yt-dlp…
Maybe ncmprhnsbl knows if some "PhantomJS" is needed or not, or why the update-browser created yt-dlp differs in that regard to the zip file on github…

[beny]

hi Rava the package yt-dlp is very basic,maybe some link are missed in the full version do not have issue

[Rava]

hi Rava the package yt-dlp is very basic,maybe some link are missed in the full version do not have issue

Indeed it is, this is its contents as created by update-browser script

Code: Select all

root@porteus:/mnt/live/memory/images/031-yt-dlp-RECENT.xzm# find .
.
./usr
./usr/bin
./usr/bin/yt-dlp
./var
./var/lib
./var/lib/pkgtools
./var/lib/pkgtools/packages
./var/lib/pkgtools/packages/yt-dlp-2022.08.19-noarch-1ncm

Does your 031-yt-dlp module contains more files?

[beny]

no i have done the package and unsquashfs it and it is the same only an /usr/bin

[Rava]

no i have done the package and unsquashfs it and it is the same only an /usr/bin

does /usr/bin/yt-dlp differ?

Code: Select all

guest@porteus:~$ md5sum /usr/bin/yt-dlp
03564d8d1cd735155143f87c1c464334  /usr/bin/yt-dlp

Added in 1 minute 12 seconds:

Code: Select all

guest@porteus:~$ yt-dlp --version
2022.08.19

[beny]

a313c57b0ba3713b8e5edc3f22382583 /tmp/squashfs-root/usr/bin/yt-dlp
and version is 2022-9-1

[Rava]

version is 2022-9-1

I see, I will update and see if that fixes it (I presume it will)

Added in 10 minutes 4 seconds:
update-browser -d -y fails, there is only an "index.html" in the target directory - and an dir2xzm error code. See for yourself:

Code: Select all

root@porteus:/Porteus_modules/yt-dlp# update-browser -d -y
 Starting checks ... 
[OK] User is root.
[OK] Distro is Porteus
Downloading live script ...
Downloading: update-youtube-dl-live  DONE
Work will be done in: /Porteus_modules/yt-dlp dir2xzm 

 Note: now using yt-dlp instead of youtube-dl.

you have version 2022.08.19 installed
Checking http://dl.porteus.org/x86_64/current/modules
The Porteus SERVER version is :   

The latest yt-dlp version is    :  2022.09.01 

 You can choose to download the premade module from our server, 
 or download the version from github. 

 Would you like to download the porteus server version? [y/n]
 Would you like to download  yt-dlp-2022.09.01  ? [y/n]
Downloading: yt-dlp https://objectsgithubusercontentcom/github-production-release-asset-2e65be/307260205/859ffbc6-701a-46aa-af11-979df2343b49?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20220909%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20220909T005250Z&X-Amz-Expires=300&X-Amz-Signature=e649261fa1aa778e31b3c3f6258cb0c59a128c60ed853fd25927fc1b3ad7d760&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=307260205&response-content-disposition=attachment%3B%20filename%3Dyt-dlp&response-content-type=application%2Foctet-st02:52:5 DONE
Downloading: SHA2-256SUMS https://objectsgithubusercontentcom/github-production-release-asset-2e65be/307260205/4ad611ea-3b34-4b3b-96e2-a52731994329?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20220909%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20220909T005133Z&X-Amz-Expires=300&X-Amz-Signature=260f336368f4fe92195457a6178c41703e94ebbd0f2239f5a575a832dd51b1d6&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=307260205&response-content-disposition=attachment%3B%20filename%3DSHA2-256SUMS&response-content-type=application%2Foctet-st02:52: DONE
Verifying download integrity..
Server  : 3db4b47c28f9cab13bfd470ad66a2eb98a82fe42c36a202d001d7cea700af616
Download: 3db4b47c28f9cab13bfd470ad66a2eb98a82fe42c36a202d001d7cea700af616
Download verified.

Convert directory tree into a zstd or xz compressed module
usage: /usr/bin/dir2xzm <-option> source_directory output_file.xzm
 options:  -x : use xz compression. 
 options:  -z : use zstd compression. 
 if no option is given xz is used. 
           -h       : show this usage. 

Your module  yt-dlp-2022.09.01-noarch-1ncm.xzm  is ready in /Porteus_modules/yt-dlp 
 Please copy it to your modules folder or somewhere safe. 

root@porteus:/Porteus_modules/yt-dlp# l
total 36
drwxr-xr-x  2 root   4096 2022-09-09 02:52 .
drwxr-xr-x 40 guest 28672 2022-09-09 02:51 ..
-rw-r--r--  1 root   3481 2022-09-09 02:52 index.html
root@porteus:/Porteus_modules/yt-dlp# l /tmp/yt*
/bin/ls: cannot access '/tmp/yt*': No such file or directory

Where did it download it into?

I presume the script needs to check if dir2xzm results in zero return value - or not, since obviously no module got created in my case - therefore no yt-dlp-2022.09.01-noarch-1ncm.xzm to be found.
And why else would dir2xzm print its error message - unless there was an error that prevented dir2xzm from creating the target module.

[Rava]

Thanks to beny I could confirm the manual download:

Code: Select all

root@porteus:/Porteus_modules/yt-dlp# wget https://github.com/yt-dlp/yt-dlp/releases/download/2022.09.01/yt-dlp
--2022-09-09 03:05:01--  https://github.com/yt-dlp/yt-dlp/releases/download/2022.09.01/yt-dlp
Resolving github.com (github.com)... 140.82.121.4
Connecting to github.com (github.com)|140.82.121.4|:443... connected.
HTTP request sent, awaiting response... 302 Found
Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/307260205/859ffbc6-701a-46aa-af11-979df2343b49?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20220909%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20220909T010424Z&X-Amz-Expires=300&X-Amz-Signature=9cc6b1cf70c248578619a56359bade42d6bcf3c91491f23692896c7261c1e9a0&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=307260205&response-content-disposition=attachment%3B%20filename%3Dyt-dlp&response-content-type=application%2Foctet-stream [following]
--2022-09-09 03:05:01--  https://objects.githubusercontent.com/github-production-release-asset-2e65be/307260205/859ffbc6-701a-46aa-af11-979df2343b49?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20220909%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20220909T010424Z&X-Amz-Expires=300&X-Amz-Signature=9cc6b1cf70c248578619a56359bade42d6bcf3c91491f23692896c7261c1e9a0&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=307260205&response-content-disposition=attachment%3B%20filename%3Dyt-dlp&response-content-type=application%2Foctet-stream
Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.111.133, 185.199.110.133, 185.199.108.133, ...
Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.111.133|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 2562169 (2.4M) [application/octet-stream]
Saving to: ‘yt-dlp’

yt-dlp              100%[===================>]   2.44M  1.04MB/s    in 2.3s    

2022-09-09 03:05:04 (1.04 MB/s) - ‘yt-dlp’ saved [2562169/2562169]

root@porteus:/Porteus_modules/yt-dlp# file yt-dlp
yt-dlp: a /usr/bin/env python3 script executable (binary data)
root@porteus:/Porteus_modules/yt-dlp# md5sum yt-dlp
a313c57b0ba3713b8e5edc3f22382583  yt-dlp

Now I will manually create the module…

[Rava]

Done, I even manually edited its var/lib/pkgtools/packages/yt-dlp-2022.08.19-noarch-1ncm and renamed it into yt-dlp-2022.09.01-noarch-1rav

Code: Select all

guest@porteus:/Porteus_modules/yt-dlp$ head -n 1 031-yt-dlp-2022.09.01-noarch-1rav/var/lib/pkgtools/packages/yt-dlp-2022.09.01-noarch-1rav 
PACKAGE NAME: yt-dlp-2022.09.01-noarch-1rav

So that I know whom to blame with that version.

Code: Select all

guest@porteus:/Porteus_modules$ yt-dlp --version
2022.09.01

Added in 9 minutes 37 seconds:
Now looking if the new version changes anything about the initial "nsig extraction" issue and its tip to install "PhantomJS" - spoiler alert, it does not. Same old same old:

Code: Select all

guest@porteus:/myvideo/review$ mkdir yMXL4NiKJ0A
guest@porteus:/myvideo/review$ cd yMXL4NiKJ0A
guest@porteus:/myvideo/review/yMXL4NiKJ0A$ yt-dlp -f 243+250 yMXL4NiKJ0A
[youtube] yMXL4NiKJ0A: Downloading webpage
[youtube] yMXL4NiKJ0A: Downloading android player API JSON
[youtube] yMXL4NiKJ0A: Downloading player 6a14c793
WARNING: [youtube] yMXL4NiKJ0A: nsig extraction failed: You may experience throttling for some formats
         Install PhantomJS to workaround the issue. Please download it from https://phantomjs.org/download.html
         n = 7L-bLHi2IFfzo_d8kEnV1 ; player = https://www.youtube.com/s/player/6a14c793/player_ias.vflset/en_US/base.js
[info] yMXL4NiKJ0A: Downloading 1 format(s): 243+250
[download] Destination: THE LORD OF THE RINGS： THE RINGS OF POWER (EPISODES 1 AND 2) REVIEW ｜ Double Toasted [yMXL4NiKJ0A].f243.webm
[download] 100% of 78.77MiB in 01:26 at 928.22KiB/s
[download] Destination: THE LORD OF THE RINGS： THE RINGS OF POWER (EPISODES 1 AND 2) REVIEW ｜ Double Toasted [yMXL4NiKJ0A].f250.webm
[download] 100% of 18.89MiB in 00:18 at 1.02MiB/s
[Merger] Merging formats into "THE LORD OF THE RINGS： THE RINGS OF POWER (EPISODES 1 AND 2) REVIEW ｜ Double Toasted [yMXL4NiKJ0A].webm"
Deleting original file THE LORD OF THE RINGS： THE RINGS OF POWER (EPISODES 1 AND 2) REVIEW ｜ Double Toasted [yMXL4NiKJ0A].f250.webm (pass -k to keep)
Deleting original file THE LORD OF THE RINGS： THE RINGS OF POWER (EPISODES 1 AND 2) REVIEW ｜ Double Toasted [yMXL4NiKJ0A].f243.webm (pass -k to keep)
guest@porteus:/myvideo/review/yMXL4NiKJ0A$ md5sum THE\ LORD\ OF\ THE\ RINGS：\ THE\ RINGS\ OF\ POWER\ \(EPISODES\ 1\ AND\ 2\)\ REVIEW\ ｜\ Double\ Toasted\ \[yMXL4NiKJ0A\].webm ../THE\ LORD\ OF\ THE\ RINGS：\ THE\ RINGS\ OF\ POWER\ \(EPISODES\ 1\ AND\ 2\)\ REVIEW\ ｜\ Double\ Toasted\ \[yMXL4NiKJ0A\].webm 
928095d46694db03cb9586935cd93c02  THE LORD OF THE RINGS： THE RINGS OF POWER (EPISODES 1 AND 2) REVIEW ｜ Double Toasted [yMXL4NiKJ0A].webm
8b6cca28792f38501ca0a841bba6aea6  ../THE LOnRD OF THE RINGS： THE RINGS OF POWER (EPISODES 1 AND 2) REVIEW ｜ Double Toasted [yMXL4NiKJ0A].webm
guest@porteus:/myvideo/review/yMXL4NiKJ0A$ l THE\ LORD\ OF\ THE\ RINGS：\ THE\ RINGS\ OF\ POWER\ \(EPISODES\ 1\ AND\ 2\)\ REVIEW\ ｜\ Double\ Toasted\ \[yMXL4NiKJ0A\].webm ../THE\ LORD\ OF\ THE\ RINGS：\ THE\ RINGS\ OF\ POWER\ \(EPISODES\ 1\ AND\ 2\)\ REVIEW\ ｜\ Double\ Toasted\ \[yMXL4NiKJ0A\].webm 
-rwxrwxrwx 1 guest 102400607 2022-09-08 01:20 ../THE\ LORD\ OF\ THE\ RINGS：\ THE\ RINGS\ OF\ POWER\ (EPISODES\ 1\ AND\ 2)\ REVIEW\ ｜\ Double\ Toasted\ [yMXL4NiKJ0A].webm
-rwxrwxrwx 1 guest 102400607 2022-09-08 01:20 THE\ LORD\ OF\ THE\ RINGS：\ THE\ RINGS\ OF\ POWER\ (EPISODES\ 1\ AND\ 2)\ REVIEW\ ｜\ Double\ Toasted\ [yMXL4NiKJ0A].webm

As you can see, my 2nd download differs in its md5sum, the file sizes are the same, and also the same warning stuff :

Code: Select all

WARNING: [youtube] yMXL4NiKJ0A: nsig extraction failed: You may experience throttling for some formats
         Install PhantomJS to workaround the issue. Please download it from https://phantomjs.org/download.html
         n = 7L-bLHi2IFfzo_d8kEnV1 ; player = https://www.youtube.com/s/player/6a14c793/player_ias.vflset/en_US/base.js

At least I was able to manually create me a 031-yt-dlp-2022.09.01-noarch-1rav.xzm

[ncmprhnsbl]

update-browser -d -y fails

should be fixed now, just some variables defined in the wrong order (only effected the -d option)

as for the warning, i'd file that under: it's just warning. as long as you get what you want, no harm done.

[Rava]

as for the warning, i'd file that under: it's just warning. as long as you get what you want, no harm done.

So far I saw no issue with the video but also not managed to fully watch it.