now using requests and lxml.html (both required to install) links with error code != 200 will be written in file errors.txt in the path ./