about summary refs log tree commit diff
path: root/indexer (follow)
Commit message (Collapse)AuthorAgeFilesLines
* Crawler+Indexer+Frontend: Rename structs to follow logical relationsBaitinq2022-10-291-12/+19
| | | | | | Now Resource is CrawledResource as it is created by the crawler, and the previous CrawledResource is now IndexedResource as its created by the indexer.
* Indexer: Implement basic priority calculation of words in a siteBaitinq2022-10-291-7/+6
| | | | | We just calculate priority to be the number of occurences of the word in the site. This is very basic and should be changed:))
* Indexer: Add website title and description to the CrawledResourceBaitinq2022-10-281-1/+24
| | | | We now parse the HTML and extract the title and description of the site.
* Frontend: Refactor search_word_in_db() to not need explicit lifetimesBaitinq2022-10-281-6/+6
|
* Misc: Add TODOsBaitinq2022-10-281-0/+1
|
* Crawler: Abstract database word fetching with search_word_in_db()Baitinq2022-10-271-2/+10
|
* Indexer: Add /search with no query endpointBaitinq2022-10-271-0/+6
| | | | Just returns [].
* Indexer: Setup permissive CORSBaitinq2022-10-272-1/+5
|
* Indexer: Return json from the /search endpointBaitinq2022-10-272-7/+5
|
* Indexer: Use CrawledResource structure as values in the reverse index dbBaitinq2022-10-252-11/+44
| | | | This will allow us to integrate priorities and other improvements.
* Indexer: Add "correct" error handlingBaitinq2022-10-251-7/+7
|
* Crawler+Indexer: Rust cleanupBaitinq2022-10-231-11/+4
| | | | | | Getting more familiar with the language so fixed some non optimal into_iter() usage, unnecessary .clone()s and unnecessary hack when we could just get a &mut for inserting into the indexer url database.
* Indexer: Listen on 0.0.0.0Baitinq2022-10-231-1/+1
|
* Indexer: Implement basic reverse index searching and addingBaitinq2022-10-222-8/+83
| | | | Very inefficient but kind of functional:::)))))))
* Indexer: Add skeleton http rest endpoint functionalityBaitinq2022-10-212-1/+33
| | | | /search and /resource endpoint.
* Misc: Separate OSSE into componentsBaitinq2022-10-192-0/+15
We now have a cargo workspace with the Crawler, Client and Indexer packages.