-
jsclose authored
modifiying all of the parsed urls to parsed url pointers for better error handling, also implementing an abstract urlfrontier class to handle alot of the more balanced crawler work
jsclose authoredmodifiying all of the parsed urls to parsed url pointers for better error handling, also implementing an abstract urlfrontier class to handle alot of the more balanced crawler work