Commits · 9a1995c4b8fe16e58e7fd69727f08ccb03bbfa00 · vcday / eecs398-search

Mar 29, 2018
- shutdown mechanism for the crawler + indexer with atomic bool working · 9a1995c4
  jsclose authored 6 years ago
  
  9a1995c4
- working tests, trying to add a shutdown method · 7b25b094
  jsclose authored 6 years ago
  
  7b25b094
Mar 28, 2018
- refactor · a63621a6
  jsclose authored 6 years ago
  
  a63621a6
Mar 27, 2018
- same as above · 43d67dc8
  jsclose authored 7 years ago
  
  43d67dc8
Mar 21, 2018
- removed the on disk doc map look upstuff, and created an isolated crawler test · 3cc58b8e
  jsclose authored 7 years ago
  
  3cc58b8e
- code reformat for style · 58f44a4f
  jsclose authored 7 years ago
  
  58f44a4f
Mar 20, 2018
- Style changes · 9ea59286
  vcday authored 7 years ago
  
  9ea59286
- indexer thread is now receiving from the parser · 36fc45a2
  jsclose authored 7 years ago
  
  36fc45a2
- intergrated indexer producer consumer queue · d8cc4e0c
  jsclose authored 7 years ago
  
  d8cc4e0c
- added a kill all spiders function so that we can start to terminate a run and... · 1e92c676
  jsclose authored 7 years ago
  
  added a kill all spiders function so that we can start to terminate a run and then restart it at the same point
  1e92c676
- modifiying duplicate url · 8364f3db
  jsclose authored 7 years ago
  
  8364f3db
Mar 19, 2018
- converted url frontier · b181bd3f
  jsclose authored 7 years ago
  
  b181bd3f
Mar 13, 2018
- initial refactored commit · 82eb00c1
  benbergk authored 7 years ago
  
  82eb00c1
Mar 07, 2018
- stable crawler with parse · 71e0bafc
  jsclose authored 7 years ago
  
  71e0bafc
- compiles without error · 121f98ed
  benbergk authored 7 years ago
  
  121f98ed
Mar 06, 2018
- trying to integrate parser and crawler · f96179eb
  jsclose authored 7 years ago
  
  f96179eb
Feb 22, 2018
- working on reading · 6edd284d
  jsclose authored 7 years ago
  
  6edd284d
- working on converting urls to ParsedUrl instances, trying to fill buffer · 937302fb
  jsclose authored 7 years ago
  
  937302fb
Feb 21, 2018
- working on testing url + robots.txt in spider.h · c42194a6
  jsclose authored 7 years ago
  
  c42194a6
Feb 15, 2018
- added command line args · e8774451
  benbergk authored 7 years ago
  
  e8774451
- formatting changes and added lock around file · 0fe06957
  benbergk authored 7 years ago
  
  0fe06957
Feb 14, 2018
- fixed linker error, made formatting changes · 2693bb0f
  benbergk authored 7 years ago
  
  2693bb0f
- formating · 7e4404cc
  jsclose authored 7 years ago
  
  7e4404cc
Feb 13, 2018
- implementation of stream reader · 02c39b5b
  jsclose authored 7 years ago
  
  02c39b5b
Feb 12, 2018
- working on shared docMap and docMapLookup · 32fcdac0
  jsclose authored 7 years ago
  
  32fcdac0
- working on doc map, url obj · 1cddffb7
  jsclose authored 7 years ago
  
  1cddffb7
Feb 06, 2018
- refactoring with utils · 0ae2c4d8
  jsclose authored 7 years ago
  
  0ae2c4d8
Feb 01, 2018
- Created Crawler Statistics · 3685c6b9
  benbergk authored 7 years ago
  
  3685c6b9
- Made thread class, fixed bugs · e6bbbee1
  benbergk authored 7 years ago
  
  e6bbbee1
Jan 31, 2018
- working to compile · 80b2b69f
  jsclose authored 7 years ago
  
  80b2b69f
Jan 28, 2018
- initial spider + crawler classes · 5d939592
  jsclose authored 7 years ago
  
  5d939592