Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Frontend: Pin yew version to 0.20 HEAD master | Baitinq | 2022-11-26 | 2 | -11/+15 |
| | |||||
* | Indexer: Stem words prior to adding/searching them | Baitinq | 2022-11-11 | 3 | -4/+24 |
| | |||||
* | Misc: Update Readme to be more user friendly | Baitinq | 2022-11-08 | 2 | -13/+83 |
| | |||||
* | Frontend: Append "..." to truncated titles and descriptions | Baitinq | 2022-11-06 | 1 | -6/+10 |
| | |||||
* | Frontend: Display a loading animation when results have not been loaded | Baitinq | 2022-11-06 | 1 | -8/+26 |
| | | | | | | We now have a way to represent unloaded results in the SearchResult struct. We simply wrap an Option over the results, meaning that None signifies that the results have not yet been fetched. | ||||
* | Indexer: Decode html entities for website title and description | Baitinq | 2022-11-06 | 3 | -81/+22 |
| | | | | Maybe we should do it for all the website's content too? :)) | ||||
* | Frontend: Display a maximum number of chars for title and desc | Baitinq | 2022-11-06 | 1 | -2/+16 |
| | |||||
* | Frontend: Store custom SearchResult struct in the app state | Baitinq | 2022-11-06 | 1 | -45/+57 |
| | | | | | | This allows us to store both the original query and the original results in the struct, being able to reference them while displaying. This fixes the search query below the search bar being updated with it. | ||||
* | Crawler: Add loging with env_logger | Baitinq | 2022-11-06 | 3 | -15/+16 |
| | |||||
* | Indexer: Add logging with env_logger | Baitinq | 2022-11-06 | 3 | -4/+60 |
| | |||||
* | Readme: Improve run instructions with frontend auto-open | Baitinq | 2022-11-06 | 1 | -6/+1 |
| | |||||
* | Indexer: Switch back to not serving frontend with actix | Baitinq | 2022-11-05 | 4 | -15/+23 |
| | | | | | | | This previously caused the frontend to be unresponsive when the crawler was passing results to the indexer. Now the frontend is again independently served by trunk and the api by actix, which makes them separate processes and the frontend can remain responsive. | ||||
* | Indexer: Hold indexer lock for less time when in search endpoint | Baitinq | 2022-11-05 | 1 | -4/+2 |
| | |||||
* | Frontend: Display number of results below search bar | Baitinq | 2022-11-05 | 1 | -8/+17 |
| | |||||
* | Frontend: Link the OSSE logo to / | Baitinq | 2022-11-05 | 1 | -1/+3 |
| | |||||
* | Indexer+Frontend: Integrate with actix | Baitinq | 2022-11-05 | 6 | -7/+69 |
| | |||||
* | Indexer: Actix: Use the same service handler with multiple routes | Baitinq | 2022-11-05 | 3 | -14/+171 |
| | |||||
* | Indexer: Add and use language field in IndexedResource | Baitinq | 2022-11-04 | 3 | -10/+29 |
| | |||||
* | Indexer: Make & implement the trait insert() taking a [word] for insert | Baitinq | 2022-11-04 | 2 | -27/+24 |
| | | | | | | This has the advantage of taking less calls to the insert() and being able to add all the logic previous to inertion to the actual Indexer implementation. | ||||
* | Indexer: Add missing /search/ route | Baitinq | 2022-11-03 | 1 | -1/+4 |
| | | | | This previously caused no output when doing an empty search through the frontend. | ||||
* | Lib: Only care about url for Eq and Hash implementation in IndexedResource | Baitinq | 2022-11-02 | 1 | -4/+3 |
| | | | | | This fixes bugs with multiple word search not working as the IndexedResource.word are different and they are not considered to match. | ||||
* | Lib+Indexer: Make IndexedResource title and description Optional | Baitinq | 2022-11-02 | 4 | -17/+27 |
| | |||||
* | Indexer: Abstract indexer | Baitinq | 2022-11-02 | 2 | -61/+132 |
| | | | | | | | | We abstract an indexer's functionality into a trait (Indexer). We move the indexer specific code into the indexer_implementation.rs file. Im not sure if this causes a performance decrease. Should be investigated further. | ||||
* | Frontend: Result component: Add more font related css | Baitinq | 2022-11-01 | 1 | -5/+17 |
| | |||||
* | Frontend: Result component: Show "No Description" if empty description | Baitinq | 2022-11-01 | 1 | -2/+5 |
| | |||||
* | Frontend: Result component: Use the stylist crate to apply basic css | Baitinq | 2022-11-01 | 3 | -2/+89 |
| | |||||
* | Frontend: Result component: Add basic structure | Baitinq | 2022-11-01 | 1 | -3/+6 |
| | |||||
* | Frontend: Reduce code duplication in the initial_search_query path of ↵ | Baitinq | 2022-11-01 | 1 | -28/+3 |
| | | | | | | | | component creation We now push a SearchSumbitted message if the initial_search_query is not none instead of duplicating the code present in the SearchSubmitted handler. | ||||
* | Frontend: Handle and show API errors | Baitinq | 2022-11-01 | 1 | -32/+71 |
| | |||||
* | Misc: Cargo fmt | Baitinq | 2022-10-30 | 5 | -25/+30 |
| | |||||
* | Indexer: Use kuchiki to split html content into words | Baitinq | 2022-10-30 | 3 | -6/+32 |
| | | | | This is better than html2text when using non-ascii characters. | ||||
* | Crawler: Set 4 as the maximum "crawl depth" | Baitinq | 2022-10-30 | 1 | -0/+1 |
| | | | | Its not really crawl depth as we just count the path segments. | ||||
* | Crawler: Accept max_queue_size as an argument for crawler() | Baitinq | 2022-10-30 | 1 | -3/+5 |
| | | | | | | | We also now set the max queue size to the max of the root url list or the max_queue_size. This is useful because if someone changes the root url list the crawler would previously hang if it had more entries than the max_queue_size. | ||||
* | Frontend: Change navbar links | Baitinq | 2022-10-30 | 1 | -4/+4 |
| | | | | Now logo points to / and "Made by Baitinq" to the project's git | ||||
* | Indexer: Transform all queries into lowercase | Baitinq | 2022-10-30 | 1 | -0/+3 |
| | | | | | This is because currently then reverse index only contains lowercase words as it transforms them when inserting them. | ||||
* | Frontend: URL encode and decode the search_query | Baitinq | 2022-10-30 | 3 | -2/+10 |
| | |||||
* | Frontend: Implement support for searching with /search/* routes | Baitinq | 2022-10-30 | 2 | -6/+37 |
| | | | | | | | We now immediately search if we are in a /search/* route. This implementation is not that good as we have to duplicate the code that runs both when creating the component in /search/* route and when submitting a search query. | ||||
* | Frontend: Update yew to follow master | Baitinq | 2022-10-30 | 4 | -45/+130 |
| | | | | This enables us to use the new Router API | ||||
* | Frontend: Setup skeleton route support | Baitinq | 2022-10-30 | 4 | -3/+78 |
| | | | | | We now have the / and /search/ route boilerplate. This will allow us to switch to the /search/ route when searching. | ||||
* | Frontend: Move app-specific code to app.rs | Baitinq | 2022-10-30 | 3 | -184/+181 |
| | |||||
* | Misc: Remove unneeded dependencies | Baitinq | 2022-10-30 | 6 | -12/+3 |
| | |||||
* | Misc: Add local lib crate to share common structs | Baitinq | 2022-10-30 | 10 | -83/+77 |
| | |||||
* | Frontend: Add props to the OSSE Component | Baitinq | 2022-10-30 | 1 | -3/+9 |
| | | | | We can now set the API endpoint in the props. | ||||
* | Frontend: Change OSSE component into a struct component | Baitinq | 2022-10-30 | 1 | -76/+88 |
| | | | | I think this improves readability for components with state. | ||||
* | Crawler+Indexer+Frontend: Rename structs to follow logical relations | Baitinq | 2022-10-29 | 3 | -24/+31 |
| | | | | | | Now Resource is CrawledResource as it is created by the crawler, and the previous CrawledResource is now IndexedResource as its created by the indexer. | ||||
* | Frontend: Use ResultComponent to display search results | Baitinq | 2022-10-29 | 1 | -3/+14 |
| | |||||
* | Indexer: Implement basic priority calculation of words in a site | Baitinq | 2022-10-29 | 1 | -7/+6 |
| | | | | | We just calculate priority to be the number of occurences of the word in the site. This is very basic and should be changed:)) | ||||
* | Frontend: Show results in reverse order with priority | Baitinq | 2022-10-28 | 1 | -2/+2 |
| | |||||
* | Frontend: Show result website's title and description | Baitinq | 2022-10-28 | 1 | -2/+4 |
| | |||||
* | Crawler: Only accept HTTP_STATUS_CODE: 200 as success in crawl_url() | Baitinq | 2022-10-28 | 1 | -3/+4 |
| |