about summary refs log tree commit diff
path: root/Cargo.lock (follow)
Commit message (Collapse)AuthorAgeFilesLines
* Frontend: Pin yew version to 0.20 HEAD masterBaitinq2022-11-261-8/+12
|
* Indexer: Stem words prior to adding/searching themBaitinq2022-11-111-0/+11
|
* Indexer: Decode html entities for website title and descriptionBaitinq2022-11-061-75/+19
| | | | Maybe we should do it for all the website's content too? :))
* Crawler: Add loging with env_loggerBaitinq2022-11-061-0/+2
|
* Indexer: Add logging with env_loggerBaitinq2022-11-061-0/+50
|
* Indexer+Frontend: Integrate with actixBaitinq2022-11-051-0/+52
|
* Indexer: Actix: Use the same service handler with multiple routesBaitinq2022-11-051-3/+151
|
* Frontend: Result component: Use the stylist crate to apply basic cssBaitinq2022-11-011-0/+73
|
* Indexer: Use kuchiki to split html content into wordsBaitinq2022-10-301-0/+13
| | | | This is better than html2text when using non-ascii characters.
* Frontend: URL encode and decode the search_queryBaitinq2022-10-301-0/+7
|
* Frontend: Update yew to follow masterBaitinq2022-10-301-39/+123
| | | | This enables us to use the new Router API
* Frontend: Setup skeleton route supportBaitinq2022-10-301-0/+41
| | | | | We now have the / and /search/ route boilerplate. This will allow us to switch to the /search/ route when searching.
* Misc: Remove unneeded dependenciesBaitinq2022-10-301-5/+0
|
* Misc: Add local lib crate to share common structsBaitinq2022-10-301-0/+10
|
* Indexer: Add website title and description to the CrawledResourceBaitinq2022-10-281-0/+1
| | | | We now parse the HTML and extract the title and description of the site.
* Fronted: Order search results by priorityBaitinq2022-10-271-0/+1
| | | | | | We do this by implementing the PartialOrd and Ord traits into the CrawledResource struct and then using Itertools::sorted() on the display iterator.
* Frontend: Fetch results from indexerBaitinq2022-10-271-0/+3
|
* Indexer: Setup permissive CORSBaitinq2022-10-271-0/+16
|
* Indexer: Return json from the /search endpointBaitinq2022-10-271-0/+1
|
* Frontend: Add basic search_query stateBaitinq2022-10-261-1/+103
|
* Crawler: Use async ClientBaitinq2022-10-251-40/+139
|
* Indexer: Use CrawledResource structure as values in the reverse index dbBaitinq2022-10-251-0/+1
| | | | This will allow us to integrate priorities and other improvements.
* Crawler: Shuffle crawled urlsBaitinq2022-10-251-0/+1
|
* Crawler: Parse urls with the "url" crateBaitinq2022-10-251-0/+1
| | | | | This fixes relative urls, makes url filtering and validation better, and many other improvements.
* Client->Frontend: Create yew frontend skeletonBaitinq2022-10-241-4/+215
| | | | We have replaced the client with a yew frontend.
* Crawler: Change blockingqueue to channelsBaitinq2022-10-231-7/+33
| | | | | We now use the async-channel channels implementation. This allows us to have bounded async channels.
* Indexer: Implement basic reverse index searching and addingBaitinq2022-10-221-7/+80
| | | | Very inefficient but kind of functional:::)))))))
* Crawler: Implement basic async functionalityBaitinq2022-10-221-54/+239
|
* Indexer: Add skeleton http rest endpoint functionalityBaitinq2022-10-211-0/+506
| | | | /search and /resource endpoint.
* Crawler: Remove duplicate parsed urlsBaitinq2022-10-201-0/+16
|
* Crawler: Add basic html parsing and link-followingBaitinq2022-10-201-0/+1525
| | | | | Extremely basic implementation. Needs max queue size, error handling, formatting of parsed links.
* Crawler: Add skeleton crawler implementationBaitinq2022-10-201-0/+9
| | | | | Starts by filling a queue with the top 1000 most visited sites. "Crawls" each one (empty fn), and blocks for new elements on the queue.
* Misc: Separate OSSE into componentsBaitinq2022-10-191-1/+9
| | | | | We now have a cargo workspace with the Crawler, Client and Indexer packages.
* Initial Commit!Baitinq2022-10-191-0/+7
This is the initial commit for this experiment of a search engine. I hope I can learn a lot from this!
generated by cgit-pink (baitinq) at 2025-01-23 01:09:25 +0000