A very small and very simple web crawler
- Python > 3.4
- External libraries you may need to download:
- requests
- urllib
Regex used:
https://regex101.com/r/oN6dE6/10
- Multithreading
- Derived crawler classes
kunalbhagawati/crawler
Folders and files
| Name | Name | Last commit date | ||
|---|---|---|---|---|