I'm trying to download multiple .mp4 files from a website. Right now I'm having to go to each individual page, go into the source code and finding the text ".mp4" and dragging the URL that ends with the mp4 file name to Downie which downloads it.
The problem with this process is that there are 30 files that I'd have to work on individually to download. Was wondering if there was a Macro I could create to automate this process?
This is much easier if you have Lynx installed, but you can it with standard old curl.
Something like this should work:
#!/usr/bin/env zsh -f
URL='https://example.com/some/path/here/'
cd ~/Downloads/
curl -sfLS "$URL" \
| tr '>|<| |"|\47' '\012' \
| egrep -i '^http.*\.mp4$' \
| while read line
do
curl -fL --remote-name "$line"
done
The URL= line is where you should put in the actual URL between the ' marks
the cd line says "change directory to ~/Downloads/". You could change this to anywhere you wanted the files downloaded
the first curl line will fetch the web page (like what you'd see if you did View Source in Safari
the tr line says: "Look through the HTML source and whenever you find a > or < or " or ' (that's \47), replace it with a newline (that's \012)
the egrep line says "look for URLs that start with HTTP and ends with MP4. (it will ignore case) ¹
that will create a list of URLs. The while read line starts a loop which will process each line, that is, each URL,
the second curl line will download the mp4 file
¹ Sometimes URLs are not given completely. For example, instead of
https://example.com/some/path/here/file.mp4
they might just use
/some/path/here/file.mp4
If that is the case, I'll need to know the actual details of the download page to explain how to do it.
I tried following the instructions here https://www.youtube.com/watch?v=Jd0YhCs8jS8
but that didn't work!
Here is a url to 1 of 30 vids I'd like to download: https://www.wintv.live/player/farfeshplushlsadz/?video=1vod5n/zelzal-30.mp4
Is there an URL that has all of the videos linked to it? That would be the only way to try to automate getting all of them.
That being said, the one URL that you shared is using JavaScript, which may make it impossible to automate downloading all of them, but I can't say for sure until I see the "playlist" page.
I have another idea but still need help:
How do I create a Macro to copy and paste the URLs one by one from the text file to Downie?
Don't know how to do it with Keyboard Maestro but here's a shell script.
Assuming that the text file with the URLs (I assume each URL is on a separate line) is in your Desktop and named filename.txt it would work like this:
#!/usr/bin/env zsh -f
# change this to the actual folder and filename
FILE="$HOME/Desktop/filename.txt"
fgrep -i http "$FILE" | while read line
do
open -a 'Downie 3' "$line"
done
But, having said that, I think you can just copy the URLs from the filenames from the text file and paste it right into the Downie window, as shown here:
That's probably the best option 
Thank you for all your help!
Thanks for mentioning Downie, it is perfect for what I am doing. Greetings from the far future!
