Friday 28 April 2017

How is Nodejs for: web scraping thousands/millions of pages for data (i.e. scraping Amazon product pages).

A hypothetical:What if you wanted to scrap Amazon product pages for various pieces of data (product info, ratings, etc...), and you wanted to do this on a large scale (thousands/millions of products), how well equipped is Node.js at handling such a task?I know it can technically be done, but is it wise to use Node.js for such a task? I ask because I've read elsewhere that, for the project I'm describing, it would be better to use something like Python.

Submitted April 29, 2017 at 07:03AM by MonkeyOnARock1

No comments:

Post a Comment