Commits · e95e6dd5d8cea75e2ca1cbfc0dea99c88966d023 · vcday / eecs398-search

Apr 02, 2018
- washington post build, crawler gets 1600 docs, all from same site · 815d04fd
  jsclose authored 6 years ago
  
  815d04fd
Mar 29, 2018
- modified local reader to take in a parsed url pointer to fix test case · 421e47ea
  jsclose authored 6 years ago
  
  421e47ea
- test failing · 79e9c921
  vcday authored 6 years ago
  
  79e9c921
- add anchor text parsing · 15992b70
  vcday authored 6 years ago
  
  15992b70
Mar 28, 2018
- more tests passing · 23693af7
  jsclose authored 6 years ago
  
  23693af7
- refactor · a63621a6
  jsclose authored 6 years ago
  
  a63621a6
Mar 27, 2018
- same as above · 43d67dc8
  jsclose authored 6 years ago
  
  43d67dc8
Mar 24, 2018
- better url and string parsing · dc615c1e
  vcday authored 6 years ago
  
  dc615c1e
Mar 22, 2018
- fixed infinite loop · 80a30c16
  vcday authored 6 years ago
  
  80a30c16
- parser test http pass · 0a454d9b
  vcday authored 6 years ago
  
  0a454d9b
- parser test http pass · 46f1301c
  vcday authored 6 years ago
  
  46f1301c
- parser test working · 81a9772f
  vcday authored 6 years ago
  
  81a9772f
- added more parser tests · 2970f790
  vcday authored 6 years ago
  
  2970f790
- some parser tests working · d2900242
  vcday authored 6 years ago
  
  d2900242
Mar 21, 2018
- made simple test for parser with new style · 1ab1c97d
  benbergk authored 6 years ago
  
  1ab1c97d
- error checking for readers and end of html check for parser · 8eaaf7c5
  jsclose authored 6 years ago
  
  8eaaf7c5
- testing integration · eee8ee6b
  jsclose authored 6 years ago
  
  eee8ee6b
- fixed stemming bug when it tried to stem just the letter s, caused a weird infinite loop · 6efe9a83
  jsclose authored 6 years ago
  
  6efe9a83
- finish adding anvi's · 24970247
  vcday authored 6 years ago
  
  24970247
Mar 20, 2018
- Style changes · 9ea59286
  vcday authored 6 years ago
  
  9ea59286
- push to url queue · c6491fbc
  vcday authored 6 years ago
  
  c6491fbc
- indexer thread is now receiving from the parser · 36fc45a2
  jsclose authored 6 years ago
  
  36fc45a2
- intergrated indexer producer consumer queue · d8cc4e0c
  jsclose authored 6 years ago
  
  d8cc4e0c
- added framework for anchor text parsing · e809b071
  vcday authored 6 years ago
  
  e809b071
- Created a checkstatus function for the web readers so that we dont pull from a site that is bad · 4e2d4d5e
  jsclose authored 6 years ago
  
  4e2d4d5e
- Added body parsing · 22d29b60
  aanvi authored 6 years ago
  
  22d29b60
Mar 19, 2018
- crawler-parser test consistent · 02e3c897
  vcday authored 7 years ago
  
  02e3c897
- change string pointers to index · d95e47de
  vcday authored 7 years ago
  
  d95e47de
- Integrating wordData struct · fe658a59
  aanvi authored 7 years ago
  
  fe658a59
- converted url frontier · b181bd3f
  jsclose authored 7 years ago
  
  b181bd3f
- validate url b4 push · e18149f5
  vcday authored 7 years ago
  
  e18149f5
Mar 18, 2018
- fixed offsets · 06bbce9d
  vcday authored 7 years ago
  
  06bbce9d
Mar 17, 2018
- fixed weird parsing errors · 2159787c
  vcday authored 7 years ago
  
  2159787c
Mar 16, 2018
- fixed stemmer · b9a95bef
  vcday authored 7 years ago
  
  b9a95bef
- Added functionalites · acee5aa5
  aanvi authored 7 years ago
  
  acee5aa5
- added verbose · d69dc520
  vcday authored 7 years ago
  
  d69dc520
Mar 15, 2018
- fixing crawl/parse · f3a234af
  vcday authored 7 years ago
  
  f3a234af
- Added functions to parser; changed tokenizer data struct · 16a17aa6
  aanvi authored 7 years ago
  
  16a17aa6
- finished stemmer · 1f399459
  vcday authored 7 years ago
  
  1f399459
Mar 13, 2018
- added stemmer and fixed parserE2E test · 8f5fa686
  vcday authored 7 years ago
  
  8f5fa686