robots-agent: robots.txt HTTP agent with in-built cache (new NPM package)

http://bit.ly/2LI2hxv

Submitted December 27, 2018 at 12:15PM by gajus0