Fincer
/
sitemap-generator
mirror of https://github.com/Fincer/sitemap-generator
1
0
Fork 0
Code Issues 0 Projects 0 Releases 0 Wiki Activity
Sitemap generator
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
32 Commits
4 Branches
672 KiB
Tree: 020772659a
Branches Tags
${ item.name }
Create branch ${ searchTerm }
from '020772659a'
${ noResults }
sitemap-generator/run.py

16 lines
494 B
Raw Normal View History

Release
9 years ago
​
​
​
example script changed
9 years ago
​
​
Release
9 years ago
​
Code cleanup
8 years ago
​
​
​
​
0.2.8
9 years ago
Multiprocessing version 0.3.4
9 years ago
 
  1. import pysitemap
  2. 

  3. """

  4. Example script
  5. Uses gevent to implement multiprocessing if Gevent installed
  6. To install gevent:
  7.     $ pip install gevent
  8. """

  9. 

  10. if __name__ == '__main__':
  11.     url = 'http://www.example.com/'  # url from to crawl
  12.     logfile = 'errlog.log'  # path to logfile
  13.     oformat = 'xml'  # output format
  14.     outputfile = 'sitemap.xml'  # path to output file
  15.     crawl = pysitemap.Crawler(url=url, logfile=logfile, oformat=oformat, outputfile=outputfile)
  16.     crawl.crawl(pool_size=20)