Created a checkstatus function for the web readers so that we dont pull from a site that is bad
Showing
- crawler-parser-test 0 additions, 0 deletionscrawler-parser-test
- crawler/Readers/HttpReader.cpp 18 additions, 0 deletionscrawler/Readers/HttpReader.cpp
- crawler/Readers/HttpReader.h 1 addition, 0 deletionscrawler/Readers/HttpReader.h
- crawler/Readers/HttpsReader.cpp 22 additions, 0 deletionscrawler/Readers/HttpsReader.cpp
- crawler/Readers/HttpsReader.h 1 addition, 1 deletioncrawler/Readers/HttpsReader.h
- crawler/Readers/LocalReader.cpp 4 additions, 0 deletionscrawler/Readers/LocalReader.cpp
- crawler/Readers/LocalReader.h 1 addition, 0 deletionscrawler/Readers/LocalReader.h
- crawler/Readers/StreamReader.h 1 addition, 0 deletionscrawler/Readers/StreamReader.h
- main.cpp 2 additions, 2 deletionsmain.cpp
- parser/Parser.cpp 48 additions, 46 deletionsparser/Parser.cpp
No preview for this file type
Please register or sign in to comment