about summary refs log tree commit diff
Commit message (Collapse)AuthorAgeFilesLines
* Indexer+Frontend: Integrate with actixBaitinq2022-11-056-7/+69
|
* Indexer: Actix: Use the same service handler with multiple routesBaitinq2022-11-053-14/+171
|
* Indexer: Add and use language field in IndexedResourceBaitinq2022-11-043-10/+29
|
* Indexer: Make & implement the trait insert() taking a [word] for insertBaitinq2022-11-042-27/+24
| | | | | | This has the advantage of taking less calls to the insert() and being able to add all the logic previous to inertion to the actual Indexer implementation.
* Indexer: Add missing /search/ routeBaitinq2022-11-031-1/+4
| | | | This previously caused no output when doing an empty search through the frontend.
* Lib: Only care about url for Eq and Hash implementation in IndexedResourceBaitinq2022-11-021-4/+3
| | | | | This fixes bugs with multiple word search not working as the IndexedResource.word are different and they are not considered to match.
* Lib+Indexer: Make IndexedResource title and description OptionalBaitinq2022-11-024-17/+27
|
* Indexer: Abstract indexerBaitinq2022-11-022-61/+132
| | | | | | | | We abstract an indexer's functionality into a trait (Indexer). We move the indexer specific code into the indexer_implementation.rs file. Im not sure if this causes a performance decrease. Should be investigated further.
* Frontend: Result component: Add more font related cssBaitinq2022-11-011-5/+17
|
* Frontend: Result component: Show "No Description" if empty descriptionBaitinq2022-11-011-2/+5
|
* Frontend: Result component: Use the stylist crate to apply basic cssBaitinq2022-11-013-2/+89
|
* Frontend: Result component: Add basic structureBaitinq2022-11-011-3/+6
|
* Frontend: Reduce code duplication in the initial_search_query path of ↵Baitinq2022-11-011-28/+3
| | | | | | | | component creation We now push a SearchSumbitted message if the initial_search_query is not none instead of duplicating the code present in the SearchSubmitted handler.
* Frontend: Handle and show API errorsBaitinq2022-11-011-32/+71
|
* Misc: Cargo fmtBaitinq2022-10-305-25/+30
|
* Indexer: Use kuchiki to split html content into wordsBaitinq2022-10-303-6/+32
| | | | This is better than html2text when using non-ascii characters.
* Crawler: Set 4 as the maximum "crawl depth"Baitinq2022-10-301-0/+1
| | | | Its not really crawl depth as we just count the path segments.
* Crawler: Accept max_queue_size as an argument for crawler()Baitinq2022-10-301-3/+5
| | | | | | | We also now set the max queue size to the max of the root url list or the max_queue_size. This is useful because if someone changes the root url list the crawler would previously hang if it had more entries than the max_queue_size.
* Frontend: Change navbar linksBaitinq2022-10-301-4/+4
| | | | Now logo points to / and "Made by Baitinq" to the project's git
* Indexer: Transform all queries into lowercaseBaitinq2022-10-301-0/+3
| | | | | This is because currently then reverse index only contains lowercase words as it transforms them when inserting them.
* Frontend: URL encode and decode the search_queryBaitinq2022-10-303-2/+10
|
* Frontend: Implement support for searching with /search/* routesBaitinq2022-10-302-6/+37
| | | | | | | We now immediately search if we are in a /search/* route. This implementation is not that good as we have to duplicate the code that runs both when creating the component in /search/* route and when submitting a search query.
* Frontend: Update yew to follow masterBaitinq2022-10-304-45/+130
| | | | This enables us to use the new Router API
* Frontend: Setup skeleton route supportBaitinq2022-10-304-3/+78
| | | | | We now have the / and /search/ route boilerplate. This will allow us to switch to the /search/ route when searching.
* Frontend: Move app-specific code to app.rsBaitinq2022-10-303-184/+181
|
* Misc: Remove unneeded dependenciesBaitinq2022-10-306-12/+3
|
* Misc: Add local lib crate to share common structsBaitinq2022-10-3010-83/+77
|
* Frontend: Add props to the OSSE ComponentBaitinq2022-10-301-3/+9
| | | | We can now set the API endpoint in the props.
* Frontend: Change OSSE component into a struct componentBaitinq2022-10-301-76/+88
| | | | I think this improves readability for components with state.
* Crawler+Indexer+Frontend: Rename structs to follow logical relationsBaitinq2022-10-293-24/+31
| | | | | | Now Resource is CrawledResource as it is created by the crawler, and the previous CrawledResource is now IndexedResource as its created by the indexer.
* Frontend: Use ResultComponent to display search resultsBaitinq2022-10-291-3/+14
|
* Indexer: Implement basic priority calculation of words in a siteBaitinq2022-10-291-7/+6
| | | | | We just calculate priority to be the number of occurences of the word in the site. This is very basic and should be changed:))
* Frontend: Show results in reverse order with priorityBaitinq2022-10-281-2/+2
|
* Frontend: Show result website's title and descriptionBaitinq2022-10-281-2/+4
|
* Crawler: Only accept HTTP_STATUS_CODE: 200 as success in crawl_url()Baitinq2022-10-281-3/+4
|
* Indexer: Add website title and description to the CrawledResourceBaitinq2022-10-283-1/+26
| | | | We now parse the HTML and extract the title and description of the site.
* Frontend: Refactor search_word_in_db() to not need explicit lifetimesBaitinq2022-10-281-6/+6
|
* Frontend: Improve responsive layoutBaitinq2022-10-281-34/+37
| | | | | We now kinda use flexbox i think? Needs lots of work regarding centering the search box. Kind of functional for now:)
* Frontend: Make the results state OptionalBaitinq2022-10-281-15/+27
| | | | | We now return "No result!" if the user has actually searched for something and no results were found.
* Misc: Add TODOsBaitinq2022-10-283-1/+3
|
* Frontend: Html: Set footer at the bottom of the pageBaitinq2022-10-281-36/+38
|
* Frontend: Logically structure htmlBaitinq2022-10-281-35/+39
|
* Frontend: Add local bootstrap filesBaitinq2022-10-283-5/+18
|
* Fronted: Order search results by priorityBaitinq2022-10-273-2/+20
| | | | | | We do this by implementing the PartialOrd and Ord traits into the CrawledResource struct and then using Itertools::sorted() on the display iterator.
* Frontend: Use display_results() function for rendering CrawledResourcesBaitinq2022-10-271-5/+14
|
* Frontend: Fetch results from indexerBaitinq2022-10-273-33/+53
|
* Crawler: Abstract database word fetching with search_word_in_db()Baitinq2022-10-271-2/+10
|
* Indexer: Add /search with no query endpointBaitinq2022-10-271-0/+6
| | | | Just returns [].
* Crawler: Replace String::from with .to_string()Baitinq2022-10-271-3/+6
|
* Indexer: Setup permissive CORSBaitinq2022-10-273-1/+21
|