about summary refs log tree commit diff
Commit message (Collapse)AuthorAgeFilesLines
* Frontend: Pin yew version to 0.20 HEAD masterBaitinq2022-11-262-11/+15
|
* Indexer: Stem words prior to adding/searching themBaitinq2022-11-113-4/+24
|
* Misc: Update Readme to be more user friendlyBaitinq2022-11-082-13/+83
|
* Frontend: Append "..." to truncated titles and descriptionsBaitinq2022-11-061-6/+10
|
* Frontend: Display a loading animation when results have not been loadedBaitinq2022-11-061-8/+26
| | | | | | We now have a way to represent unloaded results in the SearchResult struct. We simply wrap an Option over the results, meaning that None signifies that the results have not yet been fetched.
* Indexer: Decode html entities for website title and descriptionBaitinq2022-11-063-81/+22
| | | | Maybe we should do it for all the website's content too? :))
* Frontend: Display a maximum number of chars for title and descBaitinq2022-11-061-2/+16
|
* Frontend: Store custom SearchResult struct in the app stateBaitinq2022-11-061-45/+57
| | | | | | This allows us to store both the original query and the original results in the struct, being able to reference them while displaying. This fixes the search query below the search bar being updated with it.
* Crawler: Add loging with env_loggerBaitinq2022-11-063-15/+16
|
* Indexer: Add logging with env_loggerBaitinq2022-11-063-4/+60
|
* Readme: Improve run instructions with frontend auto-openBaitinq2022-11-061-6/+1
|
* Indexer: Switch back to not serving frontend with actixBaitinq2022-11-054-15/+23
| | | | | | | This previously caused the frontend to be unresponsive when the crawler was passing results to the indexer. Now the frontend is again independently served by trunk and the api by actix, which makes them separate processes and the frontend can remain responsive.
* Indexer: Hold indexer lock for less time when in search endpointBaitinq2022-11-051-4/+2
|
* Frontend: Display number of results below search barBaitinq2022-11-051-8/+17
|
* Frontend: Link the OSSE logo to /Baitinq2022-11-051-1/+3
|
* Indexer+Frontend: Integrate with actixBaitinq2022-11-056-7/+69
|
* Indexer: Actix: Use the same service handler with multiple routesBaitinq2022-11-053-14/+171
|
* Indexer: Add and use language field in IndexedResourceBaitinq2022-11-043-10/+29
|
* Indexer: Make & implement the trait insert() taking a [word] for insertBaitinq2022-11-042-27/+24
| | | | | | This has the advantage of taking less calls to the insert() and being able to add all the logic previous to inertion to the actual Indexer implementation.
* Indexer: Add missing /search/ routeBaitinq2022-11-031-1/+4
| | | | This previously caused no output when doing an empty search through the frontend.
* Lib: Only care about url for Eq and Hash implementation in IndexedResourceBaitinq2022-11-021-4/+3
| | | | | This fixes bugs with multiple word search not working as the IndexedResource.word are different and they are not considered to match.
* Lib+Indexer: Make IndexedResource title and description OptionalBaitinq2022-11-024-17/+27
|
* Indexer: Abstract indexerBaitinq2022-11-022-61/+132
| | | | | | | | We abstract an indexer's functionality into a trait (Indexer). We move the indexer specific code into the indexer_implementation.rs file. Im not sure if this causes a performance decrease. Should be investigated further.
* Frontend: Result component: Add more font related cssBaitinq2022-11-011-5/+17
|
* Frontend: Result component: Show "No Description" if empty descriptionBaitinq2022-11-011-2/+5
|
* Frontend: Result component: Use the stylist crate to apply basic cssBaitinq2022-11-013-2/+89
|
* Frontend: Result component: Add basic structureBaitinq2022-11-011-3/+6
|
* Frontend: Reduce code duplication in the initial_search_query path of ↵Baitinq2022-11-011-28/+3
| | | | | | | | component creation We now push a SearchSumbitted message if the initial_search_query is not none instead of duplicating the code present in the SearchSubmitted handler.
* Frontend: Handle and show API errorsBaitinq2022-11-011-32/+71
|
* Misc: Cargo fmtBaitinq2022-10-305-25/+30
|
* Indexer: Use kuchiki to split html content into wordsBaitinq2022-10-303-6/+32
| | | | This is better than html2text when using non-ascii characters.
* Crawler: Set 4 as the maximum "crawl depth"Baitinq2022-10-301-0/+1
| | | | Its not really crawl depth as we just count the path segments.
* Crawler: Accept max_queue_size as an argument for crawler()Baitinq2022-10-301-3/+5
| | | | | | | We also now set the max queue size to the max of the root url list or the max_queue_size. This is useful because if someone changes the root url list the crawler would previously hang if it had more entries than the max_queue_size.
* Frontend: Change navbar linksBaitinq2022-10-301-4/+4
| | | | Now logo points to / and "Made by Baitinq" to the project's git
* Indexer: Transform all queries into lowercaseBaitinq2022-10-301-0/+3
| | | | | This is because currently then reverse index only contains lowercase words as it transforms them when inserting them.
* Frontend: URL encode and decode the search_queryBaitinq2022-10-303-2/+10
|
* Frontend: Implement support for searching with /search/* routesBaitinq2022-10-302-6/+37
| | | | | | | We now immediately search if we are in a /search/* route. This implementation is not that good as we have to duplicate the code that runs both when creating the component in /search/* route and when submitting a search query.
* Frontend: Update yew to follow masterBaitinq2022-10-304-45/+130
| | | | This enables us to use the new Router API
* Frontend: Setup skeleton route supportBaitinq2022-10-304-3/+78
| | | | | We now have the / and /search/ route boilerplate. This will allow us to switch to the /search/ route when searching.
* Frontend: Move app-specific code to app.rsBaitinq2022-10-303-184/+181
|
* Misc: Remove unneeded dependenciesBaitinq2022-10-306-12/+3
|
* Misc: Add local lib crate to share common structsBaitinq2022-10-3010-83/+77
|
* Frontend: Add props to the OSSE ComponentBaitinq2022-10-301-3/+9
| | | | We can now set the API endpoint in the props.
* Frontend: Change OSSE component into a struct componentBaitinq2022-10-301-76/+88
| | | | I think this improves readability for components with state.
* Crawler+Indexer+Frontend: Rename structs to follow logical relationsBaitinq2022-10-293-24/+31
| | | | | | Now Resource is CrawledResource as it is created by the crawler, and the previous CrawledResource is now IndexedResource as its created by the indexer.
* Frontend: Use ResultComponent to display search resultsBaitinq2022-10-291-3/+14
|
* Indexer: Implement basic priority calculation of words in a siteBaitinq2022-10-291-7/+6
| | | | | We just calculate priority to be the number of occurences of the word in the site. This is very basic and should be changed:))
* Frontend: Show results in reverse order with priorityBaitinq2022-10-281-2/+2
|
* Frontend: Show result website's title and descriptionBaitinq2022-10-281-2/+4
|
* Crawler: Only accept HTTP_STATUS_CODE: 200 as success in crawl_url()Baitinq2022-10-281-3/+4
|