| Commit message (Collapse) | Author | Age | Files | Lines | |
|---|---|---|---|---|---|
| * | Indexer: Abstract indexer | Baitinq | 2022-11-02 | 2 | -61/+132 |
| | | | | | | | | | We abstract an indexer's functionality into a trait (Indexer). We move the indexer specific code into the indexer_implementation.rs file. Im not sure if this causes a performance decrease. Should be investigated further. | ||||
| * | Frontend: Result component: Add more font related css | Baitinq | 2022-11-01 | 1 | -5/+17 |
| | | |||||
| * | Frontend: Result component: Show "No Description" if empty description | Baitinq | 2022-11-01 | 1 | -2/+5 |
| | | |||||
| * | Frontend: Result component: Use the stylist crate to apply basic css | Baitinq | 2022-11-01 | 3 | -2/+89 |
| | | |||||
| * | Frontend: Result component: Add basic structure | Baitinq | 2022-11-01 | 1 | -3/+6 |
| | | |||||
| * | Frontend: Reduce code duplication in the initial_search_query path of ↵ | Baitinq | 2022-11-01 | 1 | -28/+3 |
| | | | | | | | | | component creation We now push a SearchSumbitted message if the initial_search_query is not none instead of duplicating the code present in the SearchSubmitted handler. | ||||
| * | Frontend: Handle and show API errors | Baitinq | 2022-11-01 | 1 | -32/+71 |
| | | |||||
| * | Misc: Cargo fmt | Baitinq | 2022-10-30 | 5 | -25/+30 |
| | | |||||
| * | Indexer: Use kuchiki to split html content into words | Baitinq | 2022-10-30 | 3 | -6/+32 |
| | | | | | This is better than html2text when using non-ascii characters. | ||||
| * | Crawler: Set 4 as the maximum "crawl depth" | Baitinq | 2022-10-30 | 1 | -0/+1 |
| | | | | | Its not really crawl depth as we just count the path segments. | ||||
| * | Crawler: Accept max_queue_size as an argument for crawler() | Baitinq | 2022-10-30 | 1 | -3/+5 |
| | | | | | | | | We also now set the max queue size to the max of the root url list or the max_queue_size. This is useful because if someone changes the root url list the crawler would previously hang if it had more entries than the max_queue_size. | ||||
| * | Frontend: Change navbar links | Baitinq | 2022-10-30 | 1 | -4/+4 |
| | | | | | Now logo points to / and "Made by Baitinq" to the project's git | ||||
| * | Indexer: Transform all queries into lowercase | Baitinq | 2022-10-30 | 1 | -0/+3 |
| | | | | | | This is because currently then reverse index only contains lowercase words as it transforms them when inserting them. | ||||
| * | Frontend: URL encode and decode the search_query | Baitinq | 2022-10-30 | 3 | -2/+10 |
| | | |||||
| * | Frontend: Implement support for searching with /search/* routes | Baitinq | 2022-10-30 | 2 | -6/+37 |
| | | | | | | | | We now immediately search if we are in a /search/* route. This implementation is not that good as we have to duplicate the code that runs both when creating the component in /search/* route and when submitting a search query. | ||||
| * | Frontend: Update yew to follow master | Baitinq | 2022-10-30 | 4 | -45/+130 |
| | | | | | This enables us to use the new Router API | ||||
| * | Frontend: Setup skeleton route support | Baitinq | 2022-10-30 | 4 | -3/+78 |
| | | | | | | We now have the / and /search/ route boilerplate. This will allow us to switch to the /search/ route when searching. | ||||
| * | Frontend: Move app-specific code to app.rs | Baitinq | 2022-10-30 | 3 | -184/+181 |
| | | |||||
| * | Misc: Remove unneeded dependencies | Baitinq | 2022-10-30 | 6 | -12/+3 |
| | | |||||
| * | Misc: Add local lib crate to share common structs | Baitinq | 2022-10-30 | 10 | -83/+77 |
| | | |||||
| * | Frontend: Add props to the OSSE Component | Baitinq | 2022-10-30 | 1 | -3/+9 |
| | | | | | We can now set the API endpoint in the props. | ||||
| * | Frontend: Change OSSE component into a struct component | Baitinq | 2022-10-30 | 1 | -76/+88 |
| | | | | | I think this improves readability for components with state. | ||||
| * | Crawler+Indexer+Frontend: Rename structs to follow logical relations | Baitinq | 2022-10-29 | 3 | -24/+31 |
| | | | | | | | Now Resource is CrawledResource as it is created by the crawler, and the previous CrawledResource is now IndexedResource as its created by the indexer. | ||||
| * | Frontend: Use ResultComponent to display search results | Baitinq | 2022-10-29 | 1 | -3/+14 |
| | | |||||
| * | Indexer: Implement basic priority calculation of words in a site | Baitinq | 2022-10-29 | 1 | -7/+6 |
| | | | | | | We just calculate priority to be the number of occurences of the word in the site. This is very basic and should be changed:)) | ||||
| * | Frontend: Show results in reverse order with priority | Baitinq | 2022-10-28 | 1 | -2/+2 |
| | | |||||
| * | Frontend: Show result website's title and description | Baitinq | 2022-10-28 | 1 | -2/+4 |
| | | |||||
| * | Crawler: Only accept HTTP_STATUS_CODE: 200 as success in crawl_url() | Baitinq | 2022-10-28 | 1 | -3/+4 |
| | | |||||
| * | Indexer: Add website title and description to the CrawledResource | Baitinq | 2022-10-28 | 3 | -1/+26 |
| | | | | | We now parse the HTML and extract the title and description of the site. | ||||
| * | Frontend: Refactor search_word_in_db() to not need explicit lifetimes | Baitinq | 2022-10-28 | 1 | -6/+6 |
| | | |||||
| * | Frontend: Improve responsive layout | Baitinq | 2022-10-28 | 1 | -34/+37 |
| | | | | | | We now kinda use flexbox i think? Needs lots of work regarding centering the search box. Kind of functional for now:) | ||||
| * | Frontend: Make the results state Optional | Baitinq | 2022-10-28 | 1 | -15/+27 |
| | | | | | | We now return "No result!" if the user has actually searched for something and no results were found. | ||||
| * | Misc: Add TODOs | Baitinq | 2022-10-28 | 3 | -1/+3 |
| | | |||||
| * | Frontend: Html: Set footer at the bottom of the page | Baitinq | 2022-10-28 | 1 | -36/+38 |
| | | |||||
| * | Frontend: Logically structure html | Baitinq | 2022-10-28 | 1 | -35/+39 |
| | | |||||
| * | Frontend: Add local bootstrap files | Baitinq | 2022-10-28 | 3 | -5/+18 |
| | | |||||
| * | Fronted: Order search results by priority | Baitinq | 2022-10-27 | 3 | -2/+20 |
| | | | | | | | We do this by implementing the PartialOrd and Ord traits into the CrawledResource struct and then using Itertools::sorted() on the display iterator. | ||||
| * | Frontend: Use display_results() function for rendering CrawledResources | Baitinq | 2022-10-27 | 1 | -5/+14 |
| | | |||||
| * | Frontend: Fetch results from indexer | Baitinq | 2022-10-27 | 3 | -33/+53 |
| | | |||||
| * | Crawler: Abstract database word fetching with search_word_in_db() | Baitinq | 2022-10-27 | 1 | -2/+10 |
| | | |||||
| * | Indexer: Add /search with no query endpoint | Baitinq | 2022-10-27 | 1 | -0/+6 |
| | | | | | Just returns []. | ||||
| * | Crawler: Replace String::from with .to_string() | Baitinq | 2022-10-27 | 1 | -3/+6 |
| | | |||||
| * | Indexer: Setup permissive CORS | Baitinq | 2022-10-27 | 3 | -1/+21 |
| | | |||||
| * | Indexer: Return json from the /search endpoint | Baitinq | 2022-10-27 | 3 | -7/+6 |
| | | |||||
| * | Frontend: Add results field to the state and set dummy results | Baitinq | 2022-10-26 | 1 | -2/+46 |
| | | |||||
| * | Frontend: Add basic search_query state | Baitinq | 2022-10-26 | 3 | -8/+158 |
| | | |||||
| * | Frontend: Add basic layout | Baitinq | 2022-10-26 | 2 | -1/+43 |
| | | |||||
| * | Frontend: Update index.html to include boostrap | Baitinq | 2022-10-25 | 1 | -3/+16 |
| | | | | | Also setup viewport and title. | ||||
| * | Crawler: Fix bad error handling with match handling | Baitinq | 2022-10-25 | 1 | -6/+9 |
| | | |||||
| * | Crawler: Use async Client | Baitinq | 2022-10-25 | 4 | -48/+152 |
| | | |||||