Hi there! I'm trying to learn some node/express. I wrote a simple web crawler based on this tutorial. I believe it works but I guess it could be done much better. Would anybody would be so kind and take a look at my code to show me the weekest parts of it? Crawler with url provided should gather all internal links and follow them to do the same. So basically the aim of this crawler is to gather all internal links of a given domain.Here is a link to a part of my controller responsible for crawling.So: what could be done better? How to made that script more performant?Thanks in advance!
Submitted January 18, 2017 at 10:53PM by filipoi
No comments:
Post a Comment