Monday 30 November 2015

How can I structure this?

Hey,I ran into some issues while creating a simple web scraper.Here's the deal.Fetch 100 pages in parallel.Get page ID of each urlAdd person name and id to the database (person ID will be the same with page ID)Each person has one, two or three professions. Fetch these profession names' from pages, add them into database if they don't exist and add these to the pivot table.Each person has at least one photo, fetch those too and add it to the pivot table.What would be the fastest way to achieve this? I'm kinda new into promises, callbacks, requests and everything.

Submitted December 01, 2015 at 12:33AM by laraveling

No comments:

Post a Comment