working on testing url + robots.txt in spider.h
Showing
- crawler/StreamReader.h 0 additions, 3 deletionscrawler/StreamReader.h
- crawler/spider.cpp 41 additions, 0 deletionscrawler/spider.cpp
- crawler/spider.h 4 additions, 1 deletioncrawler/spider.h
- docMap.txt 0 additions, 0 deletionsdocMap.txt
- shared/url.h 26 additions, 120 deletionsshared/url.h
- shared/urlTest.cpp 14 additions, 19 deletionsshared/urlTest.cpp
- url_test 0 additions, 0 deletionsurl_test
No preview for this file type
url_test
0 → 100755
File added
Please register or sign in to comment