Commits · 9a1995c4b8fe16e58e7fd69727f08ccb03bbfa00 · vcday / eecs398-search

Mar 29, 2018
- shutdown mechanism for the crawler + indexer with atomic bool working · 9a1995c4
  jsclose authored 6 years ago
  
  9a1995c4
- working tests, trying to add a shutdown method · 7b25b094
  jsclose authored 6 years ago
  
  7b25b094
Mar 28, 2018
- refactor · a63621a6
  jsclose authored 6 years ago
  
  a63621a6
Mar 27, 2018
- same as above · 43d67dc8
  jsclose authored 7 years ago
  
  43d67dc8
Mar 21, 2018
- changed ParsedUrl to be strings · 9d465238
  benbergk authored 7 years ago
  
  9d465238
- stable crawler · 3d5f1a5e
  jsclose authored 7 years ago
  
  3d5f1a5e
- testing integration · eee8ee6b
  jsclose authored 7 years ago
  
  eee8ee6b
- fixed stemming bug when it tried to stem just the letter s, caused a weird infinite loop · 6efe9a83
  jsclose authored 7 years ago
  
  6efe9a83
- removed the on disk doc map look upstuff, and created an isolated crawler test · 3cc58b8e
  jsclose authored 7 years ago
  
  3cc58b8e
- code reformat for style · 58f44a4f
  jsclose authored 7 years ago
  
  58f44a4f
- push · 9f3b7562
  jsclose authored 7 years ago
  
  9f3b7562
- fixed bug in SR_factory · d5831e07
  benbergk authored 7 years ago
  
  d5831e07
Mar 20, 2018
- Style changes · 9ea59286
  vcday authored 7 years ago
  
  9ea59286
- modified point · ce4a804e
  jsclose authored 7 years ago
  
  ce4a804e
- merge conflict · 1cef72a4
  vcday authored 7 years ago
  
  1cef72a4
- indexer thread is now receiving from the parser · 36fc45a2
  jsclose authored 7 years ago
  
  36fc45a2
- intergrated indexer producer consumer queue · d8cc4e0c
  jsclose authored 7 years ago
  
  d8cc4e0c
- added a kill all spiders function so that we can start to terminate a run and... · 1e92c676
  jsclose authored 7 years ago
  
  added a kill all spiders function so that we can start to terminate a run and then restart it at the same point
  1e92c676
- modifiying duplicate url · 8364f3db
  jsclose authored 7 years ago
  
  8364f3db
Mar 19, 2018
- crawler-parser test consistent · 02e3c897
  vcday authored 7 years ago
  
  02e3c897
- change string pointers to index · d95e47de
  vcday authored 7 years ago
  
  d95e47de
- converted url frontier · b181bd3f
  jsclose authored 7 years ago
  
  b181bd3f
Mar 17, 2018
- fixed weird parsing errors · 2159787c
  vcday authored 7 years ago
  
  2159787c
Mar 16, 2018
- added verbose · d69dc520
  vcday authored 7 years ago
  
  d69dc520
Mar 15, 2018
- fixing crawl/parse · f3a234af
  vcday authored 7 years ago
  
  f3a234af
Mar 13, 2018
- added factory function · c1c6aca9
  benbergk authored 7 years ago
  
  c1c6aca9
- initial refactored commit · 82eb00c1
  benbergk authored 7 years ago
  
  82eb00c1
- refactoring stream reader - > parser methodology · ac7893d4
  jsclose authored 7 years ago
  
  ac7893d4
Mar 07, 2018
- stable crawler with parse · 71e0bafc
  jsclose authored 7 years ago
  
  71e0bafc
- compiles without error · 121f98ed
  benbergk authored 7 years ago
  
  121f98ed
Mar 06, 2018
- trying to integrate parser and crawler · f96179eb
  jsclose authored 7 years ago
  
  f96179eb
Feb 22, 2018
- changed parser function · 2f0739e4
  vcday authored 7 years ago
  
  2f0739e4
- working on reading · 6edd284d
  jsclose authored 7 years ago
  
  6edd284d
- working on converting urls to ParsedUrl instances, trying to fill buffer · 937302fb
  jsclose authored 7 years ago
  
  937302fb
- working on crawler buffer · 6f1b122b
  jsclose authored 7 years ago
  
  6f1b122b
Feb 21, 2018
- working on testing url + robots.txt in spider.h · c42194a6
  jsclose authored 7 years ago
  
  c42194a6
Feb 18, 2018
- working OpenSSL · 81d48785
  jsclose authored 7 years ago
  
  81d48785
- working on ssl · 8f7de9b7
  jsclose authored 7 years ago
  
  8f7de9b7
Feb 15, 2018
- added command line args · e8774451
  benbergk authored 7 years ago
  
  e8774451
- formatting changes and added lock around file · 0fe06957
  benbergk authored 7 years ago
  
  0fe06957