Sitemap generator
 
 
Kamo Petrosyan 75c4770b12 docstring and comments for code 5 years ago
pysitemap docstring and comments for code 5 years ago
tests mechanize removed 7 years ago
.gitignore docstring and comments for code 5 years ago
CANGELOG новый файл: CANGELOG 7 years ago
LICENSE Update LICENSE 7 years ago
NOTICE modified: .gitignore 7 years ago
README.md docstring and comments for code 5 years ago
composer.json modified: .gitignore 7 years ago
requirements.txt text writer 5 years ago
run.py docstring and comments for code 5 years ago
setup.py docstring and comments for code 5 years ago
sitemap.xml aiohttp and aiofile 5 years ago

README.md

pysitemap

Sitemap generator

installing

pip install sitemap-generator

requirements

asyncio
aiofile
aiohttp

example

import sys
import logging
from pysitemap import crawler
if __name__ == '__main__':
    if '--iocp' in sys.argv:
        from asyncio import events, windows_events
        sys.argv.remove('--iocp')
        logging.info('using iocp')
        el = windows_events.ProactorEventLoop()
        events.set_event_loop(el)
    # root_url = sys.argv[1]
    root_url = 'https://www.haikson.com'
    crawler(root_url, out_file='sitemap.xml')