When trying to download from http://video.pbs.org/video/2360819929
F:\rtmpdump>perl get_flash_videos --proxy http://127.0.0.1:8087 http://video.pbs .org/video/2355017821/ Using method 'pbs' for http://video.pbs.org/video/2355017821/ Downloading http://video.pbs.org/video/2355017821/ RTMPDump v2.4 (c) 2010 Andrej Stepanchuk, Howard Chu, The Flvstreamer Team; license: GPL Connecting ... INFO: Connected... ERROR: Closing connection: NetStream.Play.StreamNotFound Download failed, no valid file downloaded Couldn't download any videos.
Comment #1
Posted on Mar 27, 2013 by Massive Camel$ ./get_flash_videos http://video.pbs.org/video/2355017821/ Using method 'pbs' for http://video.pbs.org/video/2355017821/ Downloading http://video.pbs.org/video/2355017821/ RTMPDump 2.4pl2 (c) 2010 Andrej Stepanchuk, Howard Chu, The Flvstreamer Team; license: GPL Connecting ... INFO: Connected... Starting download at: 0.000 kB INFO: Metadata: INFO: duration 783.60 INFO: moovPosition 32.00 INFO: width 640.00 INFO: height 360.00 INFO: videocodecid avc1 INFO: audiocodecid mp4a INFO: avcprofile 77.00 INFO: avclevel 31.00 INFO: aacaot 2.00 INFO: videoframerate 29.97 INFO: audiosamplerate 44100.00 INFO: audiochannels 2.00 INFO: trackinfo: INFO: length 23506483.00 INFO: timescale 30000.00 INFO: language und INFO: sampledescription: INFO: sampletype avc1 INFO: length 34556928.00 INFO: timescale 44100.00 INFO: language und INFO: sampledescription: INFO: sampletype mp4a Shields_and_Brooks_on_Obama_in_the_Mideast,_GOP_in_Overhaul.flv: 3% (2657.72 / 80537.09 KiB)^C
That works from here without the use of a proxy.
The other url also works from here.
$ perl get_flash_videos http://video.pbs.org/video/2360819929
Using method 'pbs' for http://video.pbs.org/video/2360819929
Downloading http://video.pbs.org/video/2360819929
RTMPDump 2.4pl2
(c) 2010 Andrej Stepanchuk, Howard Chu, The Flvstreamer Team; license: GPL
Connecting ...
INFO: Connected...
Starting download at: 0.000 kB
INFO: Metadata:
INFO: duration 3280.00
INFO: moovPosition 32.00
This is using OpenBSD amd64 current. With the latest versions.
Try this site without the proxy.
Comment #2
Posted on Apr 4, 2013 by Swift HorseAfter removing the proxy, the site became unaccessible.
F:\rtmpdump>perl get_flash_videos --subtitles http://video.pbs.org/video/2358778 286/ Using method 'pbs' for http://video.pbs.org/video/2358778286/ Downloading http://video.pbs.org/video/2358778286/
It stayed unchanged for ever.
Comment #3
Posted on Apr 4, 2013 by Massive CamelThat suggests you need a proxy but why, if available on internet for me, maybe accessing from work? Could try a socks proxy if one is available. Using --debug the rtmpdump command is this:-
Running rtmpdump --verbose --pageUrl 'http://video.pbs.org/video/2355017821/' --rtmp 'rtmp://sdwfchwqitj2v.cloudfront.net/cfx/st/mp4:cove2.0/newshour/e950cc77-91c2-4b27-9e16-c83ca10fd6d7/hd-mezzanine-16x9/20130322_shieldsbrooksYT-16x9-mp4-800k.mp4' --flv 'Shields_and_Brooks_on_Obama_in_the_Mideast,_GOP_in_Overhaul.flv' --swfUrl 'http://www-tc.pbs.org/video/media/swf/PBSPlayer.swf?18809'
If I use a socks proxy, then rtmpdump uses a socks proxy for the download...
$ perl get_flash_videos --debug --proxy socks://127.0.0.1:8087 http://video.pbs.org/video/2355017821/ ...... Using proxy server socks://127.0.0.1:8087 FlashVideo::RTMPDownloader=HASH(0xcfb4b354d30) Running rtmpdump --verbose --resume --pageUrl 'http://video.pbs.org/video/2355017821/' --rtmp 'rtmp://sdwfchwqitj2v.cloudfront.net/cfx/st/mp4:cove2.0/newshour/e950cc77-91c2-4b27-9e16-c83ca10fd6d7/hd-mezzanine-16x9/20130322_shieldsbrooksYT-16x9-mp4-800k.mp4' --flv 'Shields_and_Brooks_on_Obama_in_the_Mideast,_GOP_in_Overhaul.flv' --socks '127.0.0.1:8087' --swfUrl 'http://www-tc.pbs.org/video/media/swf/PBSPlayer.swf?18809' ......
You can't use a http proxy for rtmpdump.
I used ssh -D 8087 host to create my socks proxy.
From the F: that looks to be windows. Some things to check 1. Version of rtmpdump - ensure you have a recent version, some older 2.4 versions fail. Run with debug, and upload output to a site, and provide a link. 2. get_flash_videos which version, there have been changes to the proxy code a few months ago. 3. Does the site work from a browser. 4. Try the rtmpdump commands direct
Comment #4
Posted on Apr 5, 2013 by Swift HorseThank you very much for your kind help. With the help of Rtmpdumphelper.exe . I can get all the codes needed in a direct running of rtmpdump.exe .And I am able to download now.
By the way, is there a national geographic.pm for current use ?
Comment #5
Posted on Apr 5, 2013 by Massive CamelWhat is the difference between the rtmpdump used by get_flash_videos and the parameters your using from rtmpdumphelper.
Some sites may work using the Generic method, there is nothing specific for National Geographic, there may have been past requests.
This doesn't work...
get_flash_videos http://video.nationalgeographic.com/video/news/space-technology-news/predicting-meteorite-impacts-vin/
But looking at page....
var vpOptions = new NGPlayer.Options({ ..... swfURL: ('http://images.nationalgeographic.com/wpf/' === '/static/') ? 'http://' + window.location.host + 'http://images.nationalgeographic.com/wpf/sites/video/swf/ngplayer_v2.5.swf': 'http://images.nationalgeographic.com/wpf/sites/video/swf/ngplayer_v2.5.swf', adenabled:getQueryParam('adenabled'), adprogramid: '4a67dd6268de7',
HTML5src:'/video/player/media-mp4/predicting-meteorite-impacts-vin/mp4/variant-playlist.m3u8'
....
Download playlist....
That contains playlists for different bandwidths. Selecting one
That contains playlist, with chunks
predicting-meteorite-impacts-vin_220_layer0_8000000_0.ts .... predicting-meteorite-impacts-vin_220_layer0_8000000_12.ts
chunks can be downloaded... http://h5media.nationalgeographic.com/video/player/media-mp4/predicting-meteorite-impacts-vin/mp4/predicting-meteorite-impacts-vin_660/predicting-meteorite-impacts-vin_220_layer0_8000000_0.ts
Combining chunks gives the video, Downloading and combining m3u8 has been done before, for another site, using ffmpeg.
So very possible to add support. PS That chunk plays only a few seconds worth.
Comment #6
Posted on Apr 5, 2013 by Swift HorseIt seems that the solution only works for clips, not for full episodes such as:
http://channel.nationalgeographic.com/channel/taboo/videos/the-third-sex/
The source code of the full episodes pages are totally different.
Comment #7
Posted on Apr 5, 2013 by Massive CamelBoth would need to be supported... For the full episode... found these lines...
.......
....... http://channelhd-f.akamaihd.net/mpx/video/Nat_Geo_Channels/15/408/15097718_The_Third_Sex_B_015.flv", "permalink": "http://channel.nationalgeographic.com/channel/taboo/videos/the-third-sex/", "width": "610", "height": "374", "siteid": "mainplayer", "adenabled": "true", "poster": "//channel.nationalgeographic.com/exposure/content/photo/photo/435208_the-third-sex49_epsicuaitwlfo42x7yedw6mpvtncurxrbvj6lwuht2ya6mzmafma_610x374.jpg","title":"The Third Sex","cuepoints": "783,1243,1751,2192", "restricted": "US" }'> .......
Downloading http://channelhd-f.akamaihd.net/mpx/video/Nat_Geo_Channels/15/408/15097718_The_Third_Sex_B_015.flv is what's required. Seems to be restrictied to US. Tried and halts after 7Mb, so might be limited to this outside US, or splits on the cuepoints, or needs something additional to download the complete episode.
Example attached - does the first 7Mb(at least here). Place in either .get_flash_videos/plugins or lib/FlashVideo/Site.
Comment #8
Posted on Apr 7, 2013 by Swift HorseCan you help to find out the m3u8 link to the full episode videos from national geographic , http://channel.nationalgeographic.com/channel/videos/the-medical-heroin-experiment/ , for example ?
Comment #9
Posted on Apr 7, 2013 by Massive CamelIt doesn't have a m3u8, it does have this
http://channelhd-f.akamaihd.net/channel/feed/00513/08353_00_the-medical-hero_015.flv
With the previous attached site plugin
$ perl -Ilib ./get_flash_videos http://channel.nationalgeographic.com/channel/videos/the-medical-heroin-experiment/ Using method 'nationalgeographic' plugin version 0.00 for http://channel.nationalgeographic.com/channel/videos/the-medical-heroin-experiment/ Downloading http://channel.nationalgeographic.com/channel/videos/the-medical-heroin-experiment/ Downloading http://channelhd-f.akamaihd.net/channel/feed/00513/08353_00_the-medical-hero_015.flv... The_Medical_Heroin_Experiment___National_Geographic_Channel.flv: 0% (1738.48 / 2097152.00 KiB)^C
Stops after 7.9Mb from here, doesn't appear to have restrictions, maybe needs a login or something. Same in browser only see around 50sec of the video.
Status: New
Labels:
Type-Defect
Priority-Medium