about summary refs log tree commit diff
path: root/flake.lock (unfollow)
Commit message (Collapse)AuthorFilesLines
2022-11-11Indexer: Stem words prior to adding/searching themBaitinq3-4/+24
2022-11-08Misc: Update Readme to be more user friendlyBaitinq2-13/+83
2022-11-06Frontend: Append "..." to truncated titles and descriptionsBaitinq1-6/+10
2022-11-06Frontend: Display a loading animation when results have not been loadedBaitinq1-8/+26
We now have a way to represent unloaded results in the SearchResult struct. We simply wrap an Option over the results, meaning that None signifies that the results have not yet been fetched.
2022-11-06Indexer: Decode html entities for website title and descriptionBaitinq3-81/+22
Maybe we should do it for all the website's content too? :))
2022-11-06Frontend: Display a maximum number of chars for title and descBaitinq1-2/+16
2022-11-06Frontend: Store custom SearchResult struct in the app stateBaitinq1-45/+57
This allows us to store both the original query and the original results in the struct, being able to reference them while displaying. This fixes the search query below the search bar being updated with it.
2022-11-06Crawler: Add loging with env_loggerBaitinq3-15/+16
2022-11-06Indexer: Add logging with env_loggerBaitinq3-4/+60
2022-11-06Readme: Improve run instructions with frontend auto-openBaitinq1-6/+1
2022-11-05Indexer: Switch back to not serving frontend with actixBaitinq4-15/+23
This previously caused the frontend to be unresponsive when the crawler was passing results to the indexer. Now the frontend is again independently served by trunk and the api by actix, which makes them separate processes and the frontend can remain responsive.
2022-11-05Indexer: Hold indexer lock for less time when in search endpointBaitinq1-4/+2
2022-11-05Frontend: Display number of results below search barBaitinq1-8/+17
2022-11-05Frontend: Link the OSSE logo to /Baitinq1-1/+3
2022-11-05Indexer+Frontend: Integrate with actixBaitinq6-7/+69
2022-11-05Indexer: Actix: Use the same service handler with multiple routesBaitinq3-14/+171
2022-11-04Indexer: Add and use language field in IndexedResourceBaitinq3-10/+29
2022-11-04Indexer: Make & implement the trait insert() taking a [word] for insertBaitinq2-27/+24
This has the advantage of taking less calls to the insert() and being able to add all the logic previous to inertion to the actual Indexer implementation.
2022-11-03Indexer: Add missing /search/ routeBaitinq1-1/+4
This previously caused no output when doing an empty search through the frontend.
2022-11-02Lib: Only care about url for Eq and Hash implementation in IndexedResourceBaitinq1-4/+3
This fixes bugs with multiple word search not working as the IndexedResource.word are different and they are not considered to match.
2022-11-02Lib+Indexer: Make IndexedResource title and description OptionalBaitinq4-17/+27
2022-11-02Indexer: Abstract indexerBaitinq2-61/+132
We abstract an indexer's functionality into a trait (Indexer). We move the indexer specific code into the indexer_implementation.rs file. Im not sure if this causes a performance decrease. Should be investigated further.
2022-11-01Frontend: Result component: Add more font related cssBaitinq1-5/+17
2022-11-01Frontend: Result component: Show "No Description" if empty descriptionBaitinq1-2/+5
2022-11-01Frontend: Result component: Use the stylist crate to apply basic cssBaitinq3-2/+89
2022-11-01Frontend: Result component: Add basic structureBaitinq1-3/+6
2022-11-01Frontend: Reduce code duplication in the initial_search_query path of ↵Baitinq1-28/+3
component creation We now push a SearchSumbitted message if the initial_search_query is not none instead of duplicating the code present in the SearchSubmitted handler.
2022-11-01Frontend: Handle and show API errorsBaitinq1-32/+71
2022-10-30Misc: Cargo fmtBaitinq5-25/+30
2022-10-30Indexer: Use kuchiki to split html content into wordsBaitinq3-6/+32
This is better than html2text when using non-ascii characters.
2022-10-30Crawler: Set 4 as the maximum "crawl depth"Baitinq1-0/+1
Its not really crawl depth as we just count the path segments.
2022-10-30Crawler: Accept max_queue_size as an argument for crawler()Baitinq1-3/+5
We also now set the max queue size to the max of the root url list or the max_queue_size. This is useful because if someone changes the root url list the crawler would previously hang if it had more entries than the max_queue_size.
2022-10-30Frontend: Change navbar linksBaitinq1-4/+4
Now logo points to / and "Made by Baitinq" to the project's git
2022-10-30Indexer: Transform all queries into lowercaseBaitinq1-0/+3
This is because currently then reverse index only contains lowercase words as it transforms them when inserting them.
2022-10-30Frontend: URL encode and decode the search_queryBaitinq3-2/+10
2022-10-30Frontend: Implement support for searching with /search/* routesBaitinq2-6/+37
We now immediately search if we are in a /search/* route. This implementation is not that good as we have to duplicate the code that runs both when creating the component in /search/* route and when submitting a search query.
2022-10-30Frontend: Update yew to follow masterBaitinq4-45/+130
This enables us to use the new Router API
2022-10-30Frontend: Setup skeleton route supportBaitinq4-3/+78
We now have the / and /search/ route boilerplate. This will allow us to switch to the /search/ route when searching.
2022-10-30Frontend: Move app-specific code to app.rsBaitinq3-184/+181
2022-10-30Misc: Remove unneeded dependenciesBaitinq6-12/+3
2022-10-30Misc: Add local lib crate to share common structsBaitinq10-83/+77
2022-10-30Frontend: Add props to the OSSE ComponentBaitinq1-3/+9
We can now set the API endpoint in the props.
2022-10-30Frontend: Change OSSE component into a struct componentBaitinq1-76/+88
I think this improves readability for components with state.
2022-10-29Crawler+Indexer+Frontend: Rename structs to follow logical relationsBaitinq3-24/+31
Now Resource is CrawledResource as it is created by the crawler, and the previous CrawledResource is now IndexedResource as its created by the indexer.
2022-10-29Frontend: Use ResultComponent to display search resultsBaitinq1-3/+14
2022-10-29Indexer: Implement basic priority calculation of words in a siteBaitinq1-7/+6
We just calculate priority to be the number of occurences of the word in the site. This is very basic and should be changed:))
2022-10-28Frontend: Show results in reverse order with priorityBaitinq1-2/+2
2022-10-28Frontend: Show result website's title and descriptionBaitinq1-2/+4
2022-10-28Crawler: Only accept HTTP_STATUS_CODE: 200 as success in crawl_url()Baitinq1-3/+4
2022-10-28Indexer: Add website title and description to the CrawledResourceBaitinq3-1/+26
We now parse the HTML and extract the title and description of the site.