about summary refs log tree commit diff
path: root/crawler/src (follow)
Commit message (Expand)AuthorAgeFilesLines
* Crawler: Shuffle crawled urlsBaitinq2022-10-251-3/+2
* Crawler: Add "correct" error handlingBaitinq2022-10-251-21/+23
* Crawler: Parse urls with the "url" crateBaitinq2022-10-251-25/+24
* Crawler: Add crawled url filterBaitinq2022-10-241-1/+8
* Crawler: Set queue size to 2222Baitinq2022-10-241-1/+1
* Crawler+Indexer: Rust cleanupBaitinq2022-10-231-3/+2
* Crawler: Replace println! with dbg!Baitinq2022-10-231-7/+7
* Crawler: Remove prepending of https:// to each urlBaitinq2022-10-231-5/+5
* Crawler: Only crawl 2 urls per urlBaitinq2022-10-231-0/+6
* Crawler: Change blockingqueue to channelsBaitinq2022-10-231-11/+11
* Crawler: Implement basic async functionalityBaitinq2022-10-221-39/+45
* Crawler: Add basic indexer communicationBaitinq2022-10-211-10/+46
* Crawler: Add Err string in the craw_url methodBaitinq2022-10-201-3/+3
* Crawler: Add indexer interaction skeletonBaitinq2022-10-201-1/+5
* Crawler: Wrap crawl response in Result typeBaitinq2022-10-201-18/+23
* Crawler: Normalise relative urlsBaitinq2022-10-201-2/+17
* Crawler: Remove duplicate parsed urlsBaitinq2022-10-201-0/+3
* Crawler: Add basic html parsing and link-followingBaitinq2022-10-201-9/+34
* Crawler: Add skeleton crawler implementationBaitinq2022-10-201-0/+40
* Misc: Separate OSSE into componentsBaitinq2022-10-191-0/+3
generated by cgit-pink (baitinq) at 2025-11-11 01:57:50 +0000