jsclose
authored
building out more error handling for crawler, also can build for a certain number of docs mode, modified url crawling scoring
| Name | Last commit | Last update |
|---|---|---|
| .. | ||
| Readers | ||
| tests | ||
| HouseKeeper.cpp | ||
| HouseKeeper.h | ||
| UrlFrontier.cpp | ||
| UrlFrontier.h | ||
| crawler.cpp | ||
| crawler.h | ||
| savedQueue.txt | ||
| spider.cpp | ||
| spider.h | ||
| spiderTest.cpp | ||