Code
pycreep
a scalable web crawler whose extensibility is keyed by regular expressions matching against urls.
Project Information
- License: GNU GPL v3
- svn-based source control
Labels:
python
jobba
webcrawler
scalable