about summary refs log tree commit diff
path: root/indexer/src/main.rs (unfollow)
Commit message (Expand)AuthorFilesLines
2022-10-25Indexer: Use CrawledResource structure as values in the reverse index dbBaitinq3-11/+45
2022-10-25Indexer: Add "correct" error handlingBaitinq1-7/+7
2022-10-25Crawler: Shuffle crawled urlsBaitinq3-4/+5
2022-10-25Crawler: Add "correct" error handlingBaitinq1-21/+23
2022-10-25Crawler: Parse urls with the "url" crateBaitinq3-25/+26
2022-10-24Crawler: Add crawled url filterBaitinq1-1/+8
2022-10-24Flake: Add rust-analyzer packageBaitinq1-0/+1
2022-10-24Crawler: Set queue size to 2222Baitinq1-1/+1
2022-10-24Misc: Update build/run instructionsBaitinq1-2/+4
2022-10-24Client->Frontend: Create yew frontend skeletonBaitinq8-14/+238
2022-10-23Crawler+Indexer: Rust cleanupBaitinq2-14/+6
2022-10-23Crawler: Replace println! with dbg!Baitinq1-7/+7
2022-10-23Crawler: Remove prepending of https:// to each urlBaitinq2-1006/+1006
2022-10-23Crawler: Only crawl 2 urls per urlBaitinq1-0/+6
2022-10-23Crawler: Change blockingqueue to channelsBaitinq3-19/+45
2022-10-23Indexer: Listen on 0.0.0.0Baitinq1-1/+1
2022-10-22Indexer: Implement basic reverse index searching and addingBaitinq3-15/+163
2022-10-22Crawler: Implement basic async functionalityBaitinq3-93/+285
2022-10-21Crawler: Add basic indexer communicationBaitinq2-11/+48
2022-10-21Indexer: Add skeleton http rest endpoint functionalityBaitinq3-1/+539
2022-10-20Crawler: Add Err string in the craw_url methodBaitinq1-3/+3
2022-10-20Crawler: Add indexer interaction skeletonBaitinq1-1/+5
2022-10-20Crawler: Wrap crawl response in Result typeBaitinq1-18/+23
2022-10-20Crawler: Normalise relative urlsBaitinq1-2/+17
2022-10-20Crawler: Remove duplicate parsed urlsBaitinq3-0/+20
2022-10-20Crawler: Add basic html parsing and link-followingBaitinq3-9/+1561
2022-10-20Crawler: Add skeleton crawler implementationBaitinq4-0/+1051
2022-10-19Misc: Change to use "oxalica/rust-overlay" for the nix development shellBaitinq3-26/+90
2022-10-19Misc: Separate OSSE into componentsBaitinq9-10/+56