You can also use the #caoscrawler #pip package on #pypi:

https://pypi.org/project/caoscrawler/