refactored queues and added timeouts
parent
faebcefc
No related branches found
No related tags found
Showing
- CMakeLists.txt 23 additions, 0 deletionsCMakeLists.txt
- build/0-seek.txt 0 additions, 0 deletionsbuild/0-seek.txt
- build/0-wordseek.txt 0 additions, 0 deletionsbuild/0-wordseek.txt
- build/0.txt 4873 additions, 5363 deletionsbuild/0.txt
- build/1-seek.txt 0 additions, 0 deletionsbuild/1-seek.txt
- build/1-wordseek.txt 0 additions, 0 deletionsbuild/1-wordseek.txt
- build/1.txt 1376 additions, 2179 deletionsbuild/1.txt
- build/master.txt 0 additions, 0 deletionsbuild/master.txt
- build/savedQueue.txt 1629 additions, 1208 deletionsbuild/savedQueue.txt
- crawler/Readers/HttpReader.cpp 8 additions, 0 deletionscrawler/Readers/HttpReader.cpp
- crawler/Readers/HttpsReader.cpp 6 additions, 0 deletionscrawler/Readers/HttpsReader.cpp
- crawler/UrlFrontier.cpp 47 additions, 21 deletionscrawler/UrlFrontier.cpp
- crawler/UrlFrontier.h 13 additions, 11 deletionscrawler/UrlFrontier.h
- crawler/crawler.cpp 2 additions, 2 deletionscrawler/crawler.cpp
- crawler/crawler.h 1 addition, 1 deletioncrawler/crawler.h
- crawler/spider.cpp 23 additions, 22 deletionscrawler/spider.cpp
- crawler/spider.h 7 additions, 4 deletionscrawler/spider.h
- crawler/tests/urlFrontierTest.cpp 2 additions, 2 deletionscrawler/tests/urlFrontierTest.cpp
- main.cpp 26 additions, 9 deletionsmain.cpp
- parser/Parser.cpp 3 additions, 3 deletionsparser/Parser.cpp
Loading
Please register or sign in to comment