Commits · e95e6dd5d8cea75e2ca1cbfc0dea99c88966d023 · vcday / eecs398-search

Apr 05, 2018
- updated word tests indxer debugging · e95e6dd5
  jsclose authored 6 years ago
  
  e95e6dd5
- most up to date crawler/indexer · faebcefc
  jsclose authored 6 years ago
  
  faebcefc
Apr 02, 2018
- washington post build, crawler gets 1600 docs, all from same site · 815d04fd
  jsclose authored 6 years ago
  
  815d04fd
- building out more error handling for crawler, also can build for a certain... · 64ce4c5c
  jsclose authored 6 years ago
  
  building out more error handling for crawler, also can build for a certain number of docs mode, modified url crawling scoring
  64ce4c5c
Mar 30, 2018
- url->anchortext map working, added addiontal features for checking valid url · fc704f06
  jsclose authored 6 years ago
  
  fc704f06
Mar 29, 2018
- url parser error handling · 01c790b6
  jsclose authored 6 years ago
  
  01c790b6
- modifying queue rate · 24f56373
  jsclose authored 6 years ago
  
  24f56373
- working tests, trying to add a shutdown method · 7b25b094
  jsclose authored 6 years ago
  
  7b25b094
Mar 28, 2018
- refactor · a63621a6
  jsclose authored 6 years ago
  
  a63621a6
Mar 27, 2018
- same as above · 43d67dc8
  jsclose authored 6 years ago
  
  43d67dc8
Mar 22, 2018
- some parser tests working · d2900242
  vcday authored 6 years ago
  
  d2900242
Mar 21, 2018
- made simple test for parser with new style · 1ab1c97d
  benbergk authored 6 years ago
  
  1ab1c97d
- changed ParsedUrl to be strings · 9d465238
  benbergk authored 6 years ago
  
  9d465238
- stable crawler · 3d5f1a5e
  jsclose authored 6 years ago
  
  3d5f1a5e
Mar 20, 2018
- Style changes · 9ea59286
  vcday authored 6 years ago
  
  9ea59286
- indexer thread is now receiving from the parser · 36fc45a2
  jsclose authored 6 years ago
  
  36fc45a2
- added framework for anchor text parsing · e809b071
  vcday authored 6 years ago
  
  e809b071
- added a kill all spiders function so that we can start to terminate a run and... · 1e92c676
  jsclose authored 6 years ago
  
  added a kill all spiders function so that we can start to terminate a run and then restart it at the same point
  1e92c676
Mar 19, 2018
- working on shared hash_map · 8b53e797
  jsclose authored 7 years ago
  
  8b53e797
- working on shared hash table for duplicate url test · 39e7f357
  jsclose authored 7 years ago
  
  39e7f357
Mar 17, 2018
- fixed weird parsing errors · 2159787c
  vcday authored 7 years ago
  
  2159787c
Mar 13, 2018
- added stemmer and fixed parserE2E test · 8f5fa686
  vcday authored 7 years ago
  
  8f5fa686
Mar 07, 2018
- compiles without error · 121f98ed
  benbergk authored 7 years ago
  
  121f98ed
Mar 06, 2018
- implemented score element to url based off of length of url and domain · af2b73d2
  jsclose authored 7 years ago
  
  af2b73d2
- trying to integrate parser and crawler · f96179eb
  jsclose authored 7 years ago
  
  f96179eb
Feb 22, 2018
- changed parser function · 2f0739e4
  vcday authored 7 years ago
  
  2f0739e4
- working on converting urls to ParsedUrl instances, trying to fill buffer · 937302fb
  jsclose authored 7 years ago
  
  937302fb
- working on crawler buffer · 6f1b122b
  jsclose authored 7 years ago
  
  6f1b122b
Feb 21, 2018
- working on testing url + robots.txt in spider.h · c42194a6
  jsclose authored 7 years ago
  
  c42194a6
Feb 18, 2018
- working on ssl · 8f7de9b7
  jsclose authored 7 years ago
  
  8f7de9b7
Feb 15, 2018
- added command line args · e8774451
  benbergk authored 7 years ago
  
  e8774451
- formatting changes and added lock around file · 0fe06957
  benbergk authored 7 years ago
  
  0fe06957
Feb 14, 2018
- fixed linker error, made formatting changes · 2693bb0f
  benbergk authored 7 years ago
  
  2693bb0f
- formating · 7e4404cc
  jsclose authored 7 years ago
  
  7e4404cc
Feb 13, 2018
- implementation of stream reader · 02c39b5b
  jsclose authored 7 years ago
  
  02c39b5b
- formatting · 38615712
  jsclose authored 7 years ago
  
  38615712
- working on url testing + docMap work · e4c9b47b
  jsclose authored 7 years ago
  
  e4c9b47b
Feb 12, 2018
- working on shared docMap and docMapLookup · 32fcdac0
  jsclose authored 7 years ago
  
  32fcdac0
- working on doc map, url obj · 1cddffb7
  jsclose authored 7 years ago
  
  1cddffb7