modified: LICENSE modified: NOTICE modified: README.md modified: composer.json modified: pysitemap/crawler.py modified: requirements.txt modified: run.py modified: setup.py
now using requests and lxml.html (both required to install) links with error code != 200 will be written in file errors.txt in the path ./