Promise.all with thousands of GET request

Hey everyone, I have a quick question. I wrote a script that checks the response of a bunch of URLs. There is a function that takes a url string then does a GET request on the url string and then returns the response from said GET request. This function gets called multiple times for each URL and then stores it in an array which I then call Promise.all with said array. When the array has like maybe 2-3000 of those responses, the app processes. But when this array has like 15,000 responses waiting to be completed, the script looks like it stalls. I guess my question is whether or not Promise.all has a limit on the size of the array it takes? Or is the amount of requests causing the script to stall? Is it my internet service seeing the spike in GET requests?

Submitted August 13, 2018 at 03:36PM by TheBigTreezy