merged queue refactor crawler
No related branches found
No related tags found
Showing
- CMakeLists.txt 23 additions, 0 deletionsCMakeLists.txt
- crawler-parser-indexer-test 0 additions, 0 deletionscrawler-parser-indexer-test
- crawler/Readers/HttpReader.cpp 8 additions, 0 deletionscrawler/Readers/HttpReader.cpp
- crawler/Readers/HttpsReader.cpp 6 additions, 0 deletionscrawler/Readers/HttpsReader.cpp
- crawler/UrlFrontier.cpp 51 additions, 25 deletionscrawler/UrlFrontier.cpp
- crawler/UrlFrontier.h 12 additions, 10 deletionscrawler/UrlFrontier.h
- crawler/crawler.cpp 2 additions, 2 deletionscrawler/crawler.cpp
- crawler/crawler.h 1 addition, 1 deletioncrawler/crawler.h
- crawler/spider.cpp 24 additions, 32 deletionscrawler/spider.cpp
- crawler/spider.h 7 additions, 4 deletionscrawler/spider.h
- crawler/tests/urlFrontierTest.cpp 2 additions, 2 deletionscrawler/tests/urlFrontierTest.cpp
- main.cpp 33 additions, 5 deletionsmain.cpp
- parser/Parser.cpp 3 additions, 3 deletionsparser/Parser.cpp
- seedCreate.py 6 additions, 0 deletionsseedCreate.py
- shared/ProducerConsumerQueue.cpp 36 additions, 6 deletionsshared/ProducerConsumerQueue.cpp
- shared/ProducerConsumerQueue.h 13 additions, 9 deletionsshared/ProducerConsumerQueue.h
- shared/TryPopTest.cpp 54 additions, 0 deletionsshared/TryPopTest.cpp
- tests/testwebSeed.txt 1 addition, 0 deletionstests/testwebSeed.txt
- tests/testwebSeed2.txt 6 additions, 0 deletionstests/testwebSeed2.txt
Loading
Please register or sign in to comment