building out more error handling for crawler, also can build for a certain...
building out more error handling for crawler, also can build for a certain number of docs mode, modified url crawling scoring
Showing
- ISRAnd-tests 0 additions, 0 deletionsISRAnd-tests
- ISRWord-Multi-Test 0 additions, 0 deletionsISRWord-Multi-Test
- constraintSolver/ISR.h 1 addition, 1 deletionconstraintSolver/ISR.h
- constraintSolver/ISRAnd.cpp 2 additions, 2 deletionsconstraintSolver/ISRAnd.cpp
- constraintSolver/ISRAnd.h 1 addition, 1 deletionconstraintSolver/ISRAnd.h
- constraintSolver/ISRWord.cpp 7 additions, 6 deletionsconstraintSolver/ISRWord.cpp
- constraintSolver/ISRWord.h 2 additions, 2 deletionsconstraintSolver/ISRWord.h
- constraintSolver/tests/ISRWordMultiTest.cpp 1 addition, 1 deletionconstraintSolver/tests/ISRWordMultiTest.cpp
- crawler-parser-indexer-test 0 additions, 0 deletionscrawler-parser-indexer-test
- crawler/Readers/HttpReader.cpp 4 additions, 0 deletionscrawler/Readers/HttpReader.cpp
- crawler/Readers/HttpsReader.cpp 4 additions, 0 deletionscrawler/Readers/HttpsReader.cpp
- crawler/UrlFrontier.cpp 20 additions, 17 deletionscrawler/UrlFrontier.cpp
- crawler/UrlFrontier.h 1 addition, 1 deletioncrawler/UrlFrontier.h
- crawler/spider.cpp 1 addition, 1 deletioncrawler/spider.cpp
- main.cpp 32 additions, 2 deletionsmain.cpp
- shared/url.h 2 additions, 2 deletionsshared/url.h
- tests/webSeed.txt 2 additions, 0 deletionstests/webSeed.txt
Loading
Please register or sign in to comment