Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Crawler+Indexer+Frontend: Rename structs to follow logical relations | Baitinq | 2022-10-29 | 1 | -12/+19 |
| | | | | | | Now Resource is CrawledResource as it is created by the crawler, and the previous CrawledResource is now IndexedResource as its created by the indexer. | ||||
* | Indexer: Implement basic priority calculation of words in a site | Baitinq | 2022-10-29 | 1 | -7/+6 |
| | | | | | We just calculate priority to be the number of occurences of the word in the site. This is very basic and should be changed:)) | ||||
* | Indexer: Add website title and description to the CrawledResource | Baitinq | 2022-10-28 | 1 | -1/+24 |
| | | | | We now parse the HTML and extract the title and description of the site. | ||||
* | Frontend: Refactor search_word_in_db() to not need explicit lifetimes | Baitinq | 2022-10-28 | 1 | -6/+6 |
| | |||||
* | Misc: Add TODOs | Baitinq | 2022-10-28 | 1 | -0/+1 |
| | |||||
* | Crawler: Abstract database word fetching with search_word_in_db() | Baitinq | 2022-10-27 | 1 | -2/+10 |
| | |||||
* | Indexer: Add /search with no query endpoint | Baitinq | 2022-10-27 | 1 | -0/+6 |
| | | | | Just returns []. | ||||
* | Indexer: Setup permissive CORS | Baitinq | 2022-10-27 | 2 | -1/+5 |
| | |||||
* | Indexer: Return json from the /search endpoint | Baitinq | 2022-10-27 | 2 | -7/+5 |
| | |||||
* | Indexer: Use CrawledResource structure as values in the reverse index db | Baitinq | 2022-10-25 | 2 | -11/+44 |
| | | | | This will allow us to integrate priorities and other improvements. | ||||
* | Indexer: Add "correct" error handling | Baitinq | 2022-10-25 | 1 | -7/+7 |
| | |||||
* | Crawler+Indexer: Rust cleanup | Baitinq | 2022-10-23 | 1 | -11/+4 |
| | | | | | | Getting more familiar with the language so fixed some non optimal into_iter() usage, unnecessary .clone()s and unnecessary hack when we could just get a &mut for inserting into the indexer url database. | ||||
* | Indexer: Listen on 0.0.0.0 | Baitinq | 2022-10-23 | 1 | -1/+1 |
| | |||||
* | Indexer: Implement basic reverse index searching and adding | Baitinq | 2022-10-22 | 2 | -8/+83 |
| | | | | Very inefficient but kind of functional:::))))))) | ||||
* | Indexer: Add skeleton http rest endpoint functionality | Baitinq | 2022-10-21 | 2 | -1/+33 |
| | | | | /search and /resource endpoint. | ||||
* | Misc: Separate OSSE into components | Baitinq | 2022-10-19 | 2 | -0/+15 |
We now have a cargo workspace with the Crawler, Client and Indexer packages. |