Tuesday 25 June 2019

Most efficient way to download array of remote file URLs?

I'm working on a Node project where I have an array of files such asvar urls = ["http://web.site/file1.iso", "https://web.site/file2.pdf", "https://web.site/file3.docx", ...];I'm looking to download those files locally in the most efficient way possible. There could be as many as several dozen URLs in this array... Is there a good library that would help me abstract this out? I need something that I can call with the array and the local directory to that will follow redirects, work with http & https, intelligently limit simultaneous downloads, etc.

Submitted June 26, 2019 at 03:13AM by xd1936

No comments:

Post a Comment