Fincer
/
sitemap-generator
mirror of https://github.com/Fincer/sitemap-generator
1
0
Fork 0
Code Issues 0 Projects 0 Releases 0 Wiki Activity
Sitemap generator
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
34 Commits
4 Branches
243 KiB
Tree: 2c4d7c5a11
Branches Tags
${ item.name }
Create branch ${ searchTerm }
from '2c4d7c5a11'
${ noResults }
sitemap-generator/run.py

16 lines
510 B
Raw Normal View History

modified: .gitignore modified: LICENSE modified: NOTICE modified: README.md modified: composer.json modified: pysitemap/crawler.py modified: requirements.txt modified: run.py modified: setup.py
6 years ago
​
​
​
​
​
​
​
​
​
​
​
​
​
​
​
 
  1. import pysitemap
  2. 

  3. """

  4. Example script
  5. Uses gevent to implement multiprocessing if Gevent installed
  6. To install gevent:
  7.     $ pip install gevent
  8. """

  9. 

  10. if __name__ == '__main__':
  11.     url = 'http://www.example.com/'  # url from to crawl
  12.     logfile = 'errlog.log'  # path to logfile
  13.     oformat = 'xml'  # output format
  14.     outputfile = 'sitemap.xml'  # path to output file
  15.     crawl = pysitemap.Crawler(url=url, logfile=logfile, oformat=oformat, outputfile=outputfile)
  16.     crawl.crawl(pool_size=20)