Commits · 0f202a74532f731c7082792c267a75811bc3f681 · vcday / eecs398-search

Apr 11, 2018
- update · 42646d26
  jsclose authored 6 years ago
  
  42646d26
Apr 10, 2018
- restricted host · b3a48dcb
  jsclose authored 6 years ago
  
  b3a48dcb
Apr 05, 2018
- updated word tests indxer debugging · e95e6dd5
  jsclose authored 6 years ago
  
  e95e6dd5
- most up to date crawler/indexer · faebcefc
  jsclose authored 6 years ago
  
  faebcefc
Apr 04, 2018
- crawler can restart from a saved Queue · 9e71946f
  jsclose authored 6 years ago
  
  9e71946f
- Removing dead code, adding comments · 3408dee6
  jsclose authored 6 years ago
  
  3408dee6
- added url->doc ending map for anchor text lookup · 7fce908d
  jsclose authored 6 years ago
  
  7fce908d
- crawler now passing indexer the anchor text dict · 0f11d91c
  jsclose authored 6 years ago
  
  0f11d91c
Apr 03, 2018
- working with nick on end doc · 4ff7503e
  jsclose authored 6 years ago
  
  4ff7503e
- set up architecture for saving the anchor text after build is complete · 5ebf22d8
  jsclose authored 6 years ago
  
  5ebf22d8
Apr 02, 2018
- fixed issue with indexer shutting down · 9df25828
  jsclose authored 7 years ago
  
  9df25828
- fixed path issue and indexer not finishing build with alll index in queue · 12f2214a
  jsclose authored 7 years ago
  
  12f2214a
- working on isrword with built index · db2e6090
  jsclose authored 7 years ago
  
  db2e6090
- washington post build, crawler gets 1600 docs, all from same site · 815d04fd
  jsclose authored 7 years ago
  
  815d04fd
- building out more error handling for crawler, also can build for a certain... · 64ce4c5c
  jsclose authored 7 years ago
  
  building out more error handling for crawler, also can build for a certain number of docs mode, modified url crawling scoring
  64ce4c5c
Mar 30, 2018
- url->anchortext map working, added addiontal features for checking valid url · fc704f06
  jsclose authored 7 years ago
  
  fc704f06
Mar 29, 2018
- url parser error handling · 01c790b6
  jsclose authored 7 years ago
  
  01c790b6
- modified local reader to take in a parsed url pointer to fix test case · 421e47ea
  jsclose authored 7 years ago
  
  421e47ea
- shutdown mechanism for the crawler + indexer with atomic bool working · 9a1995c4
  jsclose authored 7 years ago
  
  9a1995c4
- modifying queue rate · 24f56373
  jsclose authored 7 years ago
  
  24f56373
- housekeeping thread to write urls in queue to disk · 70e42436
  jsclose authored 7 years ago
  
  70e42436
- working tests, trying to add a shutdown method · 7b25b094
  jsclose authored 7 years ago
  
  7b25b094
Mar 28, 2018
- refactor · a63621a6
  jsclose authored 7 years ago
  
  a63621a6
Mar 27, 2018
- same as above · 43d67dc8
  jsclose authored 7 years ago
  
  43d67dc8
Mar 26, 2018
- updating dht with error checking · 8158a10c
  Nicholas Yang authored 7 years ago
  
  8158a10c
- using dht for seeker · 67b444c7
  Nicholas Yang authored 7 years ago
  
  67b444c7
Mar 21, 2018
- hacked into making queries · c2667b49
  Nicholas Yang authored 7 years ago
  
  c2667b49
- stable crawler · 3d5f1a5e
  jsclose authored 7 years ago
  
  3d5f1a5e
- error checking for readers and end of html check for parser · 8eaaf7c5
  jsclose authored 7 years ago
  
  8eaaf7c5
- testing integration · eee8ee6b
  jsclose authored 7 years ago
  
  eee8ee6b
- fixed stemming bug when it tried to stem just the letter s, caused a weird infinite loop · 6efe9a83
  jsclose authored 7 years ago
  
  6efe9a83
- push · 9f3b7562
  jsclose authored 7 years ago
  
  9f3b7562
Mar 20, 2018
- modified point · ce4a804e
  jsclose authored 7 years ago
  
  ce4a804e
- indexer thread is now receiving from the parser · 36fc45a2
  jsclose authored 7 years ago
  
  36fc45a2