How to automate batch downloading of files

Рет қаралды 66,748

Күн бұрын

Пікірлер: 25

@garydixon4913 10 жыл бұрын

Early in this video, Will tries to use of the Perl lwp-download perl command for downloading one URL at a time. However, he had trouble when putting several of these commands within a single batch file. This trouble can easily be overcome by preceding each lwp-download command in the batch script with: cmd /c For example: cmd /c lwp-download URL [path-for-downloaded-file] cmd /c lwp-download next-URL [path-for-next-downloaded-file] ... This works because the lwp-download command is trying to forcibly exit from the cmd shell, after its single download completes. When used within a batch script, the first such command stops the batch shell from running, preventing subsequent commands in the script from running. The cmd /c prefix added to each line shields the batch script from this ending behavior. It runs each lwp-download command in its own cmd shell, and then forces this inner cmd shell to complete (return to the batch script) after lwp-download exits (no matter how it exits). People using Perl on a Windows PC may find this solution easier to use than downloading the URL2FILE program.

@wdoerner 10 жыл бұрын

Great catch! Thanks!!

@byronliu7620 4 жыл бұрын

it says no file , unable to download exe, its been taken off

@mitalpattni1977 6 жыл бұрын

URL2FILE application doesn't work anymore , i am getting a 404 error!

@wdoerner 13 жыл бұрын

@GntlTch good suggestion on "Download Them All". When I made the video, there didn't seem to be a lot of options for decent batch file downloads or webcrawling (or at least couldn't find much on forums or via Google searchers). Do you know of decent freeware for webcrawling instead of writing Perl scripts? I used Web Extractor to get data off webpages before (instead of download the entire HTML page) but it's not free. The open source/freeware I tried were pretty bad and not user friendly.

@jokerbox_official 6 жыл бұрын

what about mac? good video but it seems more like a lot of road blocks you are hitting. should have just said what works...instead of all the issues you had.

@olugbenga.akinyemi 8 жыл бұрын

Great tutorial bro. But can I pause and restart a batch download from the last point ?

@PS2-Pro 9 жыл бұрын

Hey man can u help me out ?? i tried to download a game from direct link using cmd but whenever I double click on it a new page comes up in the browser ( chrome) but I get the forbiden 403 can u help me out plz and thanks

@Arijit536 10 жыл бұрын

we have to download five different files from five different website in linux machine. so how to use activeperl in that regard with "wget" command?

@mwidunn 6 жыл бұрын

Thanks . . . but, WAY too complicated to do.

@GntlTch 13 жыл бұрын

(Continuing - exceeded char limit): cURL (curl.haxx.se), is a great freeware alternate for URL2FILE. It is available for over 50 OpSys - from AIX to x/OS. It is open source, has an active user and developer community,supports a huge list of protocols and offers a library of modules for inclusion in your own app.